[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:14:39.204636  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:35699
I20260709 13:14:39.206076  9489 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:14:39.206985  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:39.223453  9495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:39.226315  9489 server_base.cc:1061] running on GCE node
W20260709 13:14:39.223461  9496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:39.224551  9498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:40.424479  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:40.424827  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:40.425061  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602880425027 us; error 0 us; skew 500 ppm
I20260709 13:14:40.426044  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:40.433565  9489 webserver.cc:533] Webserver started at http://127.9.68.126:46531/ using document root <none> and password file <none>
I20260709 13:14:40.434680  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:40.434953  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:40.435436  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:40.441083  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "cbebd86d7fa94b4bac71176908662866"
format_stamp: "Formatted at 2026-07-09 13:14:40 on dist-test-slave-9s6w"
I20260709 13:14:40.448419  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:14:40.453244  9504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:40.454519  9489 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:40.454955  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "cbebd86d7fa94b4bac71176908662866"
format_stamp: "Formatted at 2026-07-09 13:14:40 on dist-test-slave-9s6w"
I20260709 13:14:40.455291  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:40.513201  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:40.514766  9489 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:14:40.515221  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:40.587299  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:35699
I20260709 13:14:40.587405  9555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:35699 every 8 connection(s)
I20260709 13:14:40.595256  9556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:40.615411  9556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: Bootstrap starting.
I20260709 13:14:40.620891  9556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.622705  9556 log.cc:826] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: Log is configured to *not* fsync() on all Append() calls
I20260709 13:14:40.626943  9556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: No bootstrap required, opened a new log
I20260709 13:14:40.646509  9556 raft_consensus.cc:359] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER }
I20260709 13:14:40.646991  9556 raft_consensus.cc:385] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.647258  9556 raft_consensus.cc:740] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbebd86d7fa94b4bac71176908662866, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.648149  9556 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER }
I20260709 13:14:40.648625  9556 raft_consensus.cc:399] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:40.648942  9556 raft_consensus.cc:493] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:40.649284  9556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.653275  9556 raft_consensus.cc:515] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER }
I20260709 13:14:40.654031  9556 leader_election.cc:304] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbebd86d7fa94b4bac71176908662866; no voters: 
I20260709 13:14:40.655711  9556 leader_election.cc:290] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:40.656072  9559 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.658293  9559 raft_consensus.cc:697] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 1 LEADER]: Becoming Leader. State: Replica: cbebd86d7fa94b4bac71176908662866, State: Running, Role: LEADER
I20260709 13:14:40.659205  9559 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER }
I20260709 13:14:40.660188  9556 sys_catalog.cc:565] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:40.671000  9560 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbebd86d7fa94b4bac71176908662866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER } }
I20260709 13:14:40.671677  9560 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:40.671504  9561 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbebd86d7fa94b4bac71176908662866. Latest consensus state: current_term: 1 leader_uuid: "cbebd86d7fa94b4bac71176908662866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbebd86d7fa94b4bac71176908662866" member_type: VOTER } }
I20260709 13:14:40.672406  9561 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:40.674934  9569 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:40.685351  9569 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:40.687500  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:40.699874  9569 catalog_manager.cc:1383] Generated new cluster ID: 6d120b4da8da4a1a94c5e851f0b0f1c0
I20260709 13:14:40.700132  9569 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:40.727913  9569 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:40.729918  9569 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:40.747857  9569 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: Generated new TSK 0
I20260709 13:14:40.748926  9569 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:40.818495  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:40.828035  9578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:40.829147  9579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:40.832288  9581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:40.833349  9489 server_base.cc:1061] running on GCE node
I20260709 13:14:40.834180  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:40.834374  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:40.834558  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602880834539 us; error 0 us; skew 500 ppm
I20260709 13:14:40.835165  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:40.839573  9489 webserver.cc:533] Webserver started at http://127.9.68.65:46503/ using document root <none> and password file <none>
I20260709 13:14:40.840112  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:40.840313  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:40.840613  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:40.841739  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
format_stamp: "Formatted at 2026-07-09 13:14:40 on dist-test-slave-9s6w"
I20260709 13:14:40.847146  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:14:40.851373  9586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:40.852176  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:14:40.852469  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
format_stamp: "Formatted at 2026-07-09 13:14:40 on dist-test-slave-9s6w"
I20260709 13:14:40.852739  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:40.888844  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:40.890710  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:40.893836  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:40.898900  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:40.899139  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:40.899477  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:40.899631  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.005803  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:40507
I20260709 13:14:41.005878  9648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:40507 every 8 connection(s)
I20260709 13:14:41.012967  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:41.023799  9653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:41.026337  9654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:41.035290  9656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:41.036332  9489 server_base.cc:1061] running on GCE node
I20260709 13:14:41.037416  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:41.037657  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:41.037869  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602881037844 us; error 0 us; skew 500 ppm
I20260709 13:14:41.038513  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:41.042512  9649 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35699
I20260709 13:14:41.042981  9649 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:41.044116  9649 heartbeater.cc:507] Master 127.9.68.126:35699 requested a full tablet report, sending...
I20260709 13:14:41.047498  9521 ts_manager.cc:194] Registered new tserver with Master: 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507)
I20260709 13:14:41.047675  9489 webserver.cc:533] Webserver started at http://127.9.68.66:43617/ using document root <none> and password file <none>
I20260709 13:14:41.048357  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:41.048614  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:41.048935  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:41.050212  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
format_stamp: "Formatted at 2026-07-09 13:14:41 on dist-test-slave-9s6w"
I20260709 13:14:41.050338  9521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45408
I20260709 13:14:41.056186  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:14:41.060400  9661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.061208  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:14:41.061597  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
format_stamp: "Formatted at 2026-07-09 13:14:41 on dist-test-slave-9s6w"
I20260709 13:14:41.061889  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:41.078764  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:41.079918  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:41.082063  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:41.085482  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:41.085704  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.085937  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:41.086102  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.179430  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:34923
I20260709 13:14:41.179605  9723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:34923 every 8 connection(s)
I20260709 13:14:41.185923  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:41.194033  9727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:41.196667  9728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:41.200547  9724 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35699
I20260709 13:14:41.201004  9724 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:41.202205  9724 heartbeater.cc:507] Master 127.9.68.126:35699 requested a full tablet report, sending...
I20260709 13:14:41.205053  9521 ts_manager.cc:194] Registered new tserver with Master: e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:41.207284  9521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45412
I20260709 13:14:41.208452  9489 server_base.cc:1061] running on GCE node
W20260709 13:14:41.209749  9730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:41.210605  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:41.210788  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:41.210983  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602881210967 us; error 0 us; skew 500 ppm
I20260709 13:14:41.211511  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:41.214735  9489 webserver.cc:533] Webserver started at http://127.9.68.67:46699/ using document root <none> and password file <none>
I20260709 13:14:41.215224  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:41.215386  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:41.215693  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:41.216679  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "fc155e5e1abb4763a834f8a649caf28b"
format_stamp: "Formatted at 2026-07-09 13:14:41 on dist-test-slave-9s6w"
I20260709 13:14:41.221185  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:41.224514  9735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.225417  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:41.225688  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "fc155e5e1abb4763a834f8a649caf28b"
format_stamp: "Formatted at 2026-07-09 13:14:41 on dist-test-slave-9s6w"
I20260709 13:14:41.225939  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:41.252138  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:41.253564  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:41.255340  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:41.258342  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:41.258556  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.258808  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:41.258975  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:41.359623  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:46487
I20260709 13:14:41.359776  9797 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:46487 every 8 connection(s)
I20260709 13:14:41.376524  9798 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35699
I20260709 13:14:41.376886  9798 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:41.377753  9798 heartbeater.cc:507] Master 127.9.68.126:35699 requested a full tablet report, sending...
I20260709 13:14:41.379784  9521 ts_manager.cc:194] Registered new tserver with Master: fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:41.379966  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015507231s
I20260709 13:14:41.381474  9521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45426
I20260709 13:14:41.430080  9521 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45436:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:41.433488  9521 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:41.540968  9614 tablet_service.cc:1511] Processing CreateTablet for tablet 017fc75d215745b7afd84a4ced15fe4a (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:41.539608  9613 tablet_service.cc:1511] Processing CreateTablet for tablet e24cc891f0d14ab089ffcb364a31d257 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:41.541972  9610 tablet_service.cc:1511] Processing CreateTablet for tablet 5a67ab5006b74a21ad8c391d81b2d093 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:41.544968  9611 tablet_service.cc:1511] Processing CreateTablet for tablet 3149f500941a434a8e0c876a308bd71c (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:41.543272  9612 tablet_service.cc:1511] Processing CreateTablet for tablet 445b4f6e4ef54e7eacb6ab9f03549f21 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:41.550420  9614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017fc75d215745b7afd84a4ced15fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.550889  9609 tablet_service.cc:1511] Processing CreateTablet for tablet 36bfa97fbb0c4db385fc81c59adc8f67 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:41.553731  9608 tablet_service.cc:1511] Processing CreateTablet for tablet 7df20c98ead64f3f971e74e7ace93f4e (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:41.553079  9607 tablet_service.cc:1511] Processing CreateTablet for tablet 7309c0ff82f54e5fbb59494ec3616344 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:41.563241  9613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24cc891f0d14ab089ffcb364a31d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.567251  9606 tablet_service.cc:1511] Processing CreateTablet for tablet febed4d753194e2fa67a8c4b262aab93 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:41.575289  9611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3149f500941a434a8e0c876a308bd71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.576295  9609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bfa97fbb0c4db385fc81c59adc8f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.577157  9612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445b4f6e4ef54e7eacb6ab9f03549f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.578197  9608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df20c98ead64f3f971e74e7ace93f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.580718  9606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet febed4d753194e2fa67a8c4b262aab93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.581425  9607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309c0ff82f54e5fbb59494ec3616344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.602566  9761 tablet_service.cc:1511] Processing CreateTablet for tablet 445b4f6e4ef54e7eacb6ab9f03549f21 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:41.604100  9761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445b4f6e4ef54e7eacb6ab9f03549f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.603799  9758 tablet_service.cc:1511] Processing CreateTablet for tablet 36bfa97fbb0c4db385fc81c59adc8f67 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:41.604405  9763 tablet_service.cc:1511] Processing CreateTablet for tablet 017fc75d215745b7afd84a4ced15fe4a (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:41.606424  9760 tablet_service.cc:1511] Processing CreateTablet for tablet 3149f500941a434a8e0c876a308bd71c (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:41.606858  9756 tablet_service.cc:1511] Processing CreateTablet for tablet 7309c0ff82f54e5fbb59494ec3616344 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:41.608117  9757 tablet_service.cc:1511] Processing CreateTablet for tablet 7df20c98ead64f3f971e74e7ace93f4e (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:41.608939  9758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bfa97fbb0c4db385fc81c59adc8f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.606895  9759 tablet_service.cc:1511] Processing CreateTablet for tablet 5a67ab5006b74a21ad8c391d81b2d093 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:41.618767  9762 tablet_service.cc:1511] Processing CreateTablet for tablet e24cc891f0d14ab089ffcb364a31d257 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:41.618865  9760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3149f500941a434a8e0c876a308bd71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.622512  9689 tablet_service.cc:1511] Processing CreateTablet for tablet 017fc75d215745b7afd84a4ced15fe4a (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:41.628738  9688 tablet_service.cc:1511] Processing CreateTablet for tablet e24cc891f0d14ab089ffcb364a31d257 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:41.629081  9610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a67ab5006b74a21ad8c391d81b2d093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.639079  9688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24cc891f0d14ab089ffcb364a31d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.639137  9687 tablet_service.cc:1511] Processing CreateTablet for tablet 445b4f6e4ef54e7eacb6ab9f03549f21 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:41.640066  9759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a67ab5006b74a21ad8c391d81b2d093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.642588  9755 tablet_service.cc:1511] Processing CreateTablet for tablet febed4d753194e2fa67a8c4b262aab93 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:41.650559  9689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017fc75d215745b7afd84a4ced15fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.642498  9686 tablet_service.cc:1511] Processing CreateTablet for tablet 3149f500941a434a8e0c876a308bd71c (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:41.661700  9816 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:41.667187  9683 tablet_service.cc:1511] Processing CreateTablet for tablet 7df20c98ead64f3f971e74e7ace93f4e (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:41.668479  9763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017fc75d215745b7afd84a4ced15fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.671361  9687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445b4f6e4ef54e7eacb6ab9f03549f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.657625  9682 tablet_service.cc:1511] Processing CreateTablet for tablet 7309c0ff82f54e5fbb59494ec3616344 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:41.680912  9757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df20c98ead64f3f971e74e7ace93f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.680984  9686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3149f500941a434a8e0c876a308bd71c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:41.682641  9568 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:41.666293  9685 tablet_service.cc:1511] Processing CreateTablet for tablet 5a67ab5006b74a21ad8c391d81b2d093 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:41.664774  9684 tablet_service.cc:1511] Processing CreateTablet for tablet 36bfa97fbb0c4db385fc81c59adc8f67 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:41.683347  9756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309c0ff82f54e5fbb59494ec3616344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.686184  9681 tablet_service.cc:1511] Processing CreateTablet for tablet febed4d753194e2fa67a8c4b262aab93 (DEFAULT_TABLE table=test-workload [id=f66947d6cc9f49c087e847b70420de5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:41.695361  9755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet febed4d753194e2fa67a8c4b262aab93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.698845  9683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df20c98ead64f3f971e74e7ace93f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.700770  9762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24cc891f0d14ab089ffcb364a31d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.700878  9684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bfa97fbb0c4db385fc81c59adc8f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.712158  9682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7309c0ff82f54e5fbb59494ec3616344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.720067  9681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet febed4d753194e2fa67a8c4b262aab93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.722756  9685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a67ab5006b74a21ad8c391d81b2d093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:41.820219  9816 tablet_bootstrap.cc:654] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.870522  9816 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:41.871055  9816 ts_tablet_manager.cc:1403] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.216s	user 0.002s	sys 0.026s
I20260709 13:14:41.873790  9818 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:41.872062  9819 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:41.881178  9816 raft_consensus.cc:359] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.889350  9816 raft_consensus.cc:385] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.889779  9816 raft_consensus.cc:740] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.890842  9816 consensus_queue.cc:260] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.911751  9649 heartbeater.cc:499] Master 127.9.68.126:35699 was elected leader, sending a full tablet report...
I20260709 13:14:41.912573  9818 tablet_bootstrap.cc:654] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.916208  9816 ts_tablet_manager.cc:1434] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.011s
I20260709 13:14:41.917253  9816 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:41.919113  9819 tablet_bootstrap.cc:654] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.923671  9818 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:41.924172  9818 ts_tablet_manager.cc:1403] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.004s
I20260709 13:14:41.932436  9818 raft_consensus.cc:359] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.934026  9818 raft_consensus.cc:385] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.934377  9818 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.935528  9816 tablet_bootstrap.cc:654] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.935250  9818 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.936062  9819 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:41.936745  9819 ts_tablet_manager.cc:1403] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.008s
I20260709 13:14:41.939770  9819 raft_consensus.cc:359] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.940423  9819 raft_consensus.cc:385] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.940719  9819 raft_consensus.cc:740] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.941452  9819 consensus_queue.cc:260] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.955597  9724 heartbeater.cc:499] Master 127.9.68.126:35699 was elected leader, sending a full tablet report...
I20260709 13:14:41.956337  9818 ts_tablet_manager.cc:1434] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.012s
I20260709 13:14:41.957351  9818 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:41.958777  9816 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:41.959297  9816 ts_tablet_manager.cc:1403] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:14:41.962174  9816 raft_consensus.cc:359] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.962852  9816 raft_consensus.cc:385] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.963120  9816 raft_consensus.cc:740] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.963774  9818 tablet_bootstrap.cc:654] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.965049  9798 heartbeater.cc:499] Master 127.9.68.126:35699 was elected leader, sending a full tablet report...
I20260709 13:14:41.965127  9816 consensus_queue.cc:260] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:41.972029  9819 ts_tablet_manager.cc:1434] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.012s
I20260709 13:14:41.972899  9819 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:41.970717  9816 ts_tablet_manager.cc:1434] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:14:41.976408  9816 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:41.987183  9819 tablet_bootstrap.cc:654] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.991102  9816 tablet_bootstrap.cc:654] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.997730  9819 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:41.999444  9819 ts_tablet_manager.cc:1403] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 13:14:41.999585  9818 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.000133  9818 ts_tablet_manager.cc:1403] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.011s
I20260709 13:14:42.002632  9819 raft_consensus.cc:359] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.002954  9818 raft_consensus.cc:359] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.003398  9819 raft_consensus.cc:385] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.003712  9818 raft_consensus.cc:385] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.003821  9819 raft_consensus.cc:740] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.004071  9818 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.004752  9819 consensus_queue.cc:260] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.006956  9819 ts_tablet_manager.cc:1434] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:42.007802  9819 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.011267  9816 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.011682  9816 ts_tablet_manager.cc:1403] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.006s
I20260709 13:14:42.004813  9818 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
W20260709 13:14:42.013707  9650 tablet.cc:2406] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:42.016273  9816 raft_consensus.cc:359] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.016947  9818 ts_tablet_manager.cc:1434] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:14:42.017107  9816 raft_consensus.cc:385] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.017596  9816 raft_consensus.cc:740] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.018527  9819 tablet_bootstrap.cc:654] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.017850  9818 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.024869  9818 tablet_bootstrap.cc:654] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.018476  9816 consensus_queue.cc:260] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.028251  9816 ts_tablet_manager.cc:1434] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:42.029188  9816 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.035555  9819 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.035981  9819 ts_tablet_manager.cc:1403] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.010s
I20260709 13:14:42.038697  9816 tablet_bootstrap.cc:654] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.038684  9819 raft_consensus.cc:359] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.039485  9819 raft_consensus.cc:385] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.039774  9819 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.040482  9819 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.042888  9819 ts_tablet_manager.cc:1434] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:42.043649  9818 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.043715  9819 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.044152  9818 ts_tablet_manager.cc:1403] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.008s
I20260709 13:14:42.047482  9818 raft_consensus.cc:359] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.048228  9818 raft_consensus.cc:385] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.048542  9818 raft_consensus.cc:740] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.049440  9818 consensus_queue.cc:260] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.051658  9818 ts_tablet_manager.cc:1434] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:42.051824  9819 tablet_bootstrap.cc:654] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.052757  9818 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.059514  9818 tablet_bootstrap.cc:654] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.063150  9819 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.063586  9819 ts_tablet_manager.cc:1403] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:14:42.065570  9824 raft_consensus.cc:493] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.066028  9824 raft_consensus.cc:515] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.068703  9824 leader_election.cc:290] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.074714  9819 raft_consensus.cc:359] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.075525  9819 raft_consensus.cc:385] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.075835  9819 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.076691  9819 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.078975  9819 ts_tablet_manager.cc:1434] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:42.079845  9819 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.080686  9820 raft_consensus.cc:493] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.081259  9820 raft_consensus.cc:515] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.087659  9819 tablet_bootstrap.cc:654] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.097747  9820 leader_election.cc:290] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.098781  9818 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.099347  9818 ts_tablet_manager.cc:1403] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:14:42.103828  9816 tablet_bootstrap.cc:492] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.105041  9816 ts_tablet_manager.cc:1403] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.010s
I20260709 13:14:42.106356  9818 raft_consensus.cc:359] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.107065  9818 raft_consensus.cc:385] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.107432  9818 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.109779  9816 raft_consensus.cc:359] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.113651  9816 raft_consensus.cc:385] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.114560  9816 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.116066  9816 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.117748  9819 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.118247  9819 ts_tablet_manager.cc:1403] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.011s
I20260709 13:14:42.119518  9816 ts_tablet_manager.cc:1434] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:42.121277  9819 raft_consensus.cc:359] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.122219  9819 raft_consensus.cc:385] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.122563  9819 raft_consensus.cc:740] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.123734  9819 consensus_queue.cc:260] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.124347  9818 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.125450  9816 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.131268  9819 ts_tablet_manager.cc:1434] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:14:42.132727  9820 raft_consensus.cc:493] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.138706  9818 ts_tablet_manager.cc:1434] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:14:42.144809  9820 raft_consensus.cc:515] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.148366  9818 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.149045  9820 leader_election.cc:290] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.150309  9819 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.153331  9816 tablet_bootstrap.cc:654] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.165488  9819 tablet_bootstrap.cc:654] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.172134  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.173848  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.175705  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
W20260709 13:14:42.179515  9738 leader_election.cc:343] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:42.179649  9588 leader_election.cc:343] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:42.180323  9588 leader_election.cc:343] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.188846  9820 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.188992  9816 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.189340  9820 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.190227  9816 ts_tablet_manager.cc:1403] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.016s
I20260709 13:14:42.192087  9820 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.192009  9818 tablet_bootstrap.cc:654] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.193535  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.196463  9816 raft_consensus.cc:359] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.198657  9699 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
I20260709 13:14:42.199076  9816 raft_consensus.cc:385] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.199255  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.199424  9816 raft_consensus.cc:740] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.200052  9588 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
W20260709 13:14:42.201148  9737 leader_election.cc:343] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.201632  9820 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.202153  9820 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.202031  9737 leader_election.cc:304] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:42.202503  9820 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.202788  9824 raft_consensus.cc:2749] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.200357  9816 consensus_queue.cc:260] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.204113  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.204921  9773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.204586  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.205277  9772 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
I20260709 13:14:42.206609  9771 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
W20260709 13:14:42.208403  9587 leader_election.cc:343] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.208889  9587 leader_election.cc:304] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727; no voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.211256  9818 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.211725  9818 ts_tablet_manager.cc:1403] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.001s
I20260709 13:14:42.213332  9819 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.215320  9819 ts_tablet_manager.cc:1403] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.019s
I20260709 13:14:42.215435  9824 raft_consensus.cc:493] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.216709  9845 raft_consensus.cc:2749] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.216492  9824 raft_consensus.cc:515] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.215040  9818 raft_consensus.cc:359] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.217468  9818 raft_consensus.cc:385] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.217777  9818 raft_consensus.cc:740] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.218521  9824 leader_election.cc:290] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.219512  9816 ts_tablet_manager.cc:1434] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.009s
I20260709 13:14:42.215045  9820 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.220044  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.220654  9698 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 0.
I20260709 13:14:42.220808  9816 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.222153  9820 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.223497  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.223939  9819 raft_consensus.cc:359] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.224859  9819 raft_consensus.cc:385] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.225587  9819 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.226423  9737 leader_election.cc:304] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:42.226334  9819 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.227171  9824 raft_consensus.cc:2804] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.227573  9824 raft_consensus.cc:493] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.227423  9818 consensus_queue.cc:260] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.227908  9824 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.224867  9698 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.229938  9818 ts_tablet_manager.cc:1434] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:14:42.230877  9818 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.234666  9824 raft_consensus.cc:515] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.236624  9824 leader_election.cc:290] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.237854  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.238445  9699 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.238729  9819 ts_tablet_manager.cc:1434] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.006s
I20260709 13:14:42.239656  9819 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.239940  9698 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.243983  9588 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:42.244961  9846 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.245520  9846 raft_consensus.cc:697] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:42.246568  9819 tablet_bootstrap.cc:654] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.246361  9846 consensus_queue.cc:237] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.250583  9816 tablet_bootstrap.cc:654] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.252555  9587 leader_election.cc:304] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:42.255457  9820 raft_consensus.cc:2804] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.255854  9820 raft_consensus.cc:493] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.256204  9820 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.257754  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:42.258394  9772 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.261761  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.261395  9519 catalog_manager.cc:5697] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:42.265741  9738 leader_election.cc:343] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.261300  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:42.267761  9772 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
W20260709 13:14:42.268261  9738 leader_election.cc:343] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.252804  9699 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 1.
I20260709 13:14:42.253733  9818 tablet_bootstrap.cc:654] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.270514  9737 leader_election.cc:304] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:42.271328  9824 raft_consensus.cc:2804] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.275924  9820 raft_consensus.cc:515] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.280157  9820 leader_election.cc:290] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Requested vote from peers fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.281234  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:42.281347  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.282721  9823 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.284409  9772 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.284534  9823 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
W20260709 13:14:42.285472  9588 leader_election.cc:343] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.283061  9816 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.286773  9816 ts_tablet_manager.cc:1403] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.003s
I20260709 13:14:42.287528  9824 raft_consensus.cc:697] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:42.287739  9823 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.293496  9820 raft_consensus.cc:493] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.294047  9820 raft_consensus.cc:515] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.303972  9816 raft_consensus.cc:359] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.304826  9816 raft_consensus.cc:385] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.288780  9824 consensus_queue.cc:237] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.308198  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.306226  9816 raft_consensus.cc:740] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
W20260709 13:14:42.312378  9588 leader_election.cc:343] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.311545  9820 leader_election.cc:290] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.313728  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.314517  9771 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
I20260709 13:14:42.313899  9816 consensus_queue.cc:260] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.315299  9772 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.315725  9587 leader_election.cc:304] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:42.316506  9820 raft_consensus.cc:2804] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.317152  9820 raft_consensus.cc:493] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.317430  9587 leader_election.cc:304] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:42.317866  9820 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.317495  9816 ts_tablet_manager.cc:1434] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:14:42.320220  9846 raft_consensus.cc:2804] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.321034  9846 raft_consensus.cc:697] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:42.322220  9846 consensus_queue.cc:237] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.325603  9819 tablet_bootstrap.cc:492] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.330803  9819 ts_tablet_manager.cc:1403] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.018s
I20260709 13:14:42.330962  9818 tablet_bootstrap.cc:492] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.325763  9816 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.335301  9819 raft_consensus.cc:359] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.338260  9819 raft_consensus.cc:385] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.342196  9819 raft_consensus.cc:740] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.342972  9820 raft_consensus.cc:515] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.338670  9818 ts_tablet_manager.cc:1403] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.007s
I20260709 13:14:42.342993  9819 consensus_queue.cc:260] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.346383  9819 ts_tablet_manager.cc:1434] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:14:42.348485  9819 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.351176  9518 catalog_manager.cc:5697] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.357054  9816 tablet_bootstrap.cc:654] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.351748  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.359529  9820 leader_election.cc:290] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.350836  9818 raft_consensus.cc:359] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.360982  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:42.361550  9772 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.361913  9818 raft_consensus.cc:385] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.363379  9818 raft_consensus.cc:740] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.364172  9818 consensus_queue.cc:260] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.366103  9699 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.367928  9818 ts_tablet_manager.cc:1434] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:14:42.370326  9818 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.370512  9824 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.370958  9824 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.372843  9824 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.373559  9772 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.374184  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.374485  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.374779  9698 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 0.
I20260709 13:14:42.376444  9587 leader_election.cc:304] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:42.377084  9737 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
W20260709 13:14:42.377796  9738 leader_election.cc:343] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.377913  9820 raft_consensus.cc:493] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.378479  9846 raft_consensus.cc:2804] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.378616  9824 raft_consensus.cc:2804] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.378433  9820 raft_consensus.cc:515] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.379073  9824 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.379186  9846 raft_consensus.cc:697] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:42.379463  9824 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.380488  9820 leader_election.cc:290] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.381453  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.381762  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.382264  9698 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
I20260709 13:14:42.383436  9772 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 0.
I20260709 13:14:42.380187  9846 consensus_queue.cc:237] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.384940  9588 leader_election.cc:304] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:42.387746  9820 raft_consensus.cc:2804] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.391316  9820 raft_consensus.cc:493] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.391666  9820 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.391928  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
W20260709 13:14:42.393586  9664 leader_election.cc:343] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.393481  9699 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.407409  9519 catalog_manager.cc:5697] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.408560  9824 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.409425  9820 raft_consensus.cc:515] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.412467  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.413422  9772 raft_consensus.cc:2393] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6b5dfd6933547b2b9bebf6ccb608c99 in current term 1: Already voted for candidate fc155e5e1abb4763a834f8a649caf28b in this term.
I20260709 13:14:42.413870  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:42.415328  9819 tablet_bootstrap.cc:654] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:42.416685  9738 leader_election.cc:343] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.418073  9662 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.421664  9818 tablet_bootstrap.cc:654] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.424121  9823 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.427492  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.418684  9824 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.428052  9698 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.430401  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:42.430938  9772 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.432636  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.428932  9820 leader_election.cc:290] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.442921  9772 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.443753  9698 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 1.
I20260709 13:14:42.444024  9587 leader_election.cc:304] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:42.439851  9823 raft_consensus.cc:2749] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.444768  9820 raft_consensus.cc:2804] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.445346  9820 raft_consensus.cc:697] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:42.448474  9816 tablet_bootstrap.cc:492] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.448364  9519 catalog_manager.cc:5697] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.450492  9818 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.446528  9820 consensus_queue.cc:237] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.450927  9818 ts_tablet_manager.cc:1403] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.008s
I20260709 13:14:42.448927  9816 ts_tablet_manager.cc:1403] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.005s
I20260709 13:14:42.453900  9818 raft_consensus.cc:359] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.454612  9818 raft_consensus.cc:385] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.455212  9818 raft_consensus.cc:740] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.457510  9816 raft_consensus.cc:359] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.457468  9818 consensus_queue.cc:260] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.458259  9816 raft_consensus.cc:385] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.458544  9816 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.453423  9699 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 1.
I20260709 13:14:42.459232  9816 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.460246  9737 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:42.461004  9824 raft_consensus.cc:2804] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.461167  9818 ts_tablet_manager.cc:1434] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:14:42.461508  9824 raft_consensus.cc:697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:42.462218  9818 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.462309  9824 consensus_queue.cc:237] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.467208  9819 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.467619  9819 ts_tablet_manager.cc:1403] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.014s
I20260709 13:14:42.471757  9819 raft_consensus.cc:359] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.472126  9818 tablet_bootstrap.cc:654] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.472394  9819 raft_consensus.cc:385] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.472668  9819 raft_consensus.cc:740] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.475010  9816 ts_tablet_manager.cc:1434] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:14:42.474813  9519 catalog_manager.cc:5697] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.476166  9816 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.480499  9823 raft_consensus.cc:493] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.480742  9819 consensus_queue.cc:260] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.480959  9823 raft_consensus.cc:515] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.482949  9819 ts_tablet_manager.cc:1434] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:42.482896  9823 leader_election.cc:290] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.483857  9819 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: Bootstrap starting.
I20260709 13:14:42.484088  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.485983  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.486665  9623 raft_consensus.cc:2468] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 0.
W20260709 13:14:42.487927  9662 leader_election.cc:343] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.490612  9664 leader_election.cc:304] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.492359  9823 raft_consensus.cc:2804] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.494029  9823 raft_consensus.cc:493] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.490660  9520 catalog_manager.cc:5697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.494980  9824 raft_consensus.cc:493] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.495338  9823 raft_consensus.cc:3060] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.495570  9824 raft_consensus.cc:515] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.498572  9824 leader_election.cc:290] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.499615  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.499935  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.500523  9699 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 0.
W20260709 13:14:42.500979  9738 leader_election.cc:343] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.502279  9818 tablet_bootstrap.cc:492] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.502121  9737 leader_election.cc:304] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:42.502696  9818 ts_tablet_manager.cc:1403] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.002s
I20260709 13:14:42.500588  9816 tablet_bootstrap.cc:654] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.503170  9824 raft_consensus.cc:2804] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.503949  9824 raft_consensus.cc:493] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.504360  9824 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.504676  9819 tablet_bootstrap.cc:654] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.506922  9823 raft_consensus.cc:515] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.508901  9823 leader_election.cc:290] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.510955  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
W20260709 13:14:42.541604  9662 leader_election.cc:343] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.542508  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:42.542956  9623 raft_consensus.cc:3060] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.543660  9818 raft_consensus.cc:359] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.544291  9818 raft_consensus.cc:385] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.544425  9816 tablet_bootstrap.cc:492] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.544570  9818 raft_consensus.cc:740] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.544899  9816 ts_tablet_manager.cc:1403] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.009s
I20260709 13:14:42.545244  9818 consensus_queue.cc:260] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.547500  9816 raft_consensus.cc:359] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.548134  9816 raft_consensus.cc:385] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.548398  9816 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.548694  9819 tablet_bootstrap.cc:492] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: No bootstrap required, opened a new log
I20260709 13:14:42.549113  9819 ts_tablet_manager.cc:1403] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.004s
I20260709 13:14:42.549002  9816 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.550694  9623 raft_consensus.cc:2468] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 1.
I20260709 13:14:42.551411  9816 ts_tablet_manager.cc:1434] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:42.551715  9664 leader_election.cc:304] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.551645  9819 raft_consensus.cc:359] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.552238  9816 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: Bootstrap starting.
I20260709 13:14:42.552374  9819 raft_consensus.cc:385] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.552678  9819 raft_consensus.cc:740] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.554675  9818 ts_tablet_manager.cc:1434] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 13:14:42.555823  9823 raft_consensus.cc:2804] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.555167  9819 consensus_queue.cc:260] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.562021  9818 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: Bootstrap starting.
I20260709 13:14:42.558736  9824 raft_consensus.cc:515] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.566242  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
W20260709 13:14:42.567541  9738 leader_election.cc:343] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.568605  9824 leader_election.cc:290] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.570572  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:42.571121  9699 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.577911  9816 tablet_bootstrap.cc:654] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.578778  9823 raft_consensus.cc:697] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:42.579603  9823 consensus_queue.cc:237] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.578368  9699 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 1.
I20260709 13:14:42.581939  9737 leader_election.cc:304] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:42.582713  9824 raft_consensus.cc:2804] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.583190  9824 raft_consensus.cc:697] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:42.583967  9824 consensus_queue.cc:237] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.586033  9819 ts_tablet_manager.cc:1434] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:14:42.590690  9818 tablet_bootstrap.cc:654] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.596910  9521 catalog_manager.cc:5697] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.599614  9519 catalog_manager.cc:5697] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.604825  9818 tablet_bootstrap.cc:492] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: No bootstrap required, opened a new log
I20260709 13:14:42.605434  9818 ts_tablet_manager.cc:1403] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:14:42.608134  9818 raft_consensus.cc:359] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.608716  9818 raft_consensus.cc:385] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.609036  9818 raft_consensus.cc:740] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.609928  9818 consensus_queue.cc:260] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.611910  9818 ts_tablet_manager.cc:1434] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:42.614590  9816 tablet_bootstrap.cc:492] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: No bootstrap required, opened a new log
I20260709 13:14:42.614997  9816 ts_tablet_manager.cc:1403] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.003s
I20260709 13:14:42.617141  9816 raft_consensus.cc:359] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.617718  9816 raft_consensus.cc:385] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.617965  9816 raft_consensus.cc:740] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.618566  9816 consensus_queue.cc:260] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.620396  9816 ts_tablet_manager.cc:1434] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:14:42.629455  9820 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.642947  9845 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.666533  9820 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.667027  9820 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.669165  9820 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.669742  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.670080  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.670495  9699 raft_consensus.cc:2393] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06c7a2aff9c34cf2abcb2f76c8585727 in current term 1: Already voted for candidate fc155e5e1abb4763a834f8a649caf28b in this term.
I20260709 13:14:42.671497  9587 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727; no voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.672091  9820 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.676378  9820 raft_consensus.cc:2749] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:42.694101  9568 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:42.700446  9824 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.709682  9623 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.717903  9824 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.758973  9823 raft_consensus.cc:493] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.759459  9823 raft_consensus.cc:515] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.761127  9823 leader_election.cc:290] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.761997  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309c0ff82f54e5fbb59494ec3616344" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.762210  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309c0ff82f54e5fbb59494ec3616344" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.762621  9624 raft_consensus.cc:2468] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 0.
I20260709 13:14:42.762820  9772 raft_consensus.cc:2468] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 0.
I20260709 13:14:42.763652  9664 leader_election.cc:304] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:42.764420  9823 raft_consensus.cc:2804] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.764766  9823 raft_consensus.cc:493] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.765096  9823 raft_consensus.cc:3060] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.770439  9869 raft_consensus.cc:493] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.771008  9869 raft_consensus.cc:515] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:42.771673  9823 raft_consensus.cc:515] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.773192  9869 leader_election.cc:290] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.774245  9823 leader_election.cc:290] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.775094  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.774801  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309c0ff82f54e5fbb59494ec3616344" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:42.783692  9623 raft_consensus.cc:3060] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.783856  9772 raft_consensus.cc:2393] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6b5dfd6933547b2b9bebf6ccb608c99 in current term 1: Already voted for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in this term.
I20260709 13:14:42.776620  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7309c0ff82f54e5fbb59494ec3616344" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:42.784906  9771 raft_consensus.cc:3060] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.778223  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.786518  9664 leader_election.cc:304] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.787602  9823 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.789307  9820 raft_consensus.cc:493] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.789798  9820 raft_consensus.cc:515] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.791803  9820 leader_election.cc:290] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:42.792820  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc155e5e1abb4763a834f8a649caf28b" is_pre_election: true
I20260709 13:14:42.793864  9623 raft_consensus.cc:2468] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 1.
I20260709 13:14:42.794708  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.794838  9664 leader_election.cc:304] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:42.794415  9823 raft_consensus.cc:2749] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.795379  9699 raft_consensus.cc:2393] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06c7a2aff9c34cf2abcb2f76c8585727 in current term 1: Already voted for candidate fc155e5e1abb4763a834f8a649caf28b in this term.
I20260709 13:14:42.795749  9869 raft_consensus.cc:2804] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.796367  9869 raft_consensus.cc:697] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:42.797132  9588 leader_election.cc:304] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727; no voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:42.797470  9869 consensus_queue.cc:237] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.798173  9820 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.791661  9771 raft_consensus.cc:2468] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 1.
I20260709 13:14:42.804239  9820 raft_consensus.cc:2749] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.806181  9519 catalog_manager.cc:5697] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.824186  9820 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.835686  9846 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.845368  9846 consensus_queue.cc:1048] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.856063  9880 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.863513  9845 consensus_queue.cc:1048] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.874917  9851 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.917069  9880 raft_consensus.cc:493] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.917513  9880 raft_consensus.cc:515] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:42.919060  9880 leader_election.cc:290] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:42.920037  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" is_pre_election: true
I20260709 13:14:42.920097  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df20c98ead64f3f971e74e7ace93f4e" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" is_pre_election: true
I20260709 13:14:42.920702  9623 raft_consensus.cc:2393] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc155e5e1abb4763a834f8a649caf28b in current term 1: Already voted for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in this term.
I20260709 13:14:42.921614  9738 leader_election.cc:304] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc155e5e1abb4763a834f8a649caf28b; no voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:42.922240  9880 raft_consensus.cc:3060] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.929680  9880 raft_consensus.cc:2749] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.932312  9845 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.942652  9820 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.974669  9869 consensus_queue.cc:1048] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.985141  9869 consensus_queue.cc:1048] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.060591  9771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
mode: GRACEFUL
new_leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:33832
I20260709 13:14:43.061172  9771 raft_consensus.cc:606] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Received request to transfer leadership to TS 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:43.067034  9771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
mode: GRACEFUL
new_leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:33832
I20260709 13:14:43.067492  9771 raft_consensus.cc:606] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Received request to transfer leadership to TS 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:43.074956  9771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:33832
I20260709 13:14:43.075399  9771 raft_consensus.cc:606] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:43.087883  9623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:50706
I20260709 13:14:43.088366  9623 raft_consensus.cc:606] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:43.098730  9623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:50706
I20260709 13:14:43.099187  9623 raft_consensus.cc:606] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Received request to transfer leadership to TS fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:43.108675  9880 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.115552  9851 raft_consensus.cc:993] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:43.115958  9851 raft_consensus.cc:1081] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:43.117791  9699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44096
I20260709 13:14:43.118343  9699 raft_consensus.cc:493] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.118680  9699 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.121544  9824 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.127091  9699 raft_consensus.cc:515] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.128229  9698 raft_consensus.cc:1240] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Rejecting Update request from peer fc155e5e1abb4763a834f8a649caf28b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:43.129742  9623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:43.130282  9623 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.132086  9699 leader_election.cc:290] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:43.133347  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:43.133888  9771 raft_consensus.cc:3055] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.134186  9771 raft_consensus.cc:740] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:43.134402  9824 consensus_queue.cc:1059] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.135551  9771 consensus_queue.cc:260] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.136868  9771 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.139403  9623 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
I20260709 13:14:43.140412  9664 leader_election.cc:304] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:43.141222  9869 raft_consensus.cc:2804] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.141711  9869 raft_consensus.cc:697] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:43.142482  9869 consensus_queue.cc:237] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.143951  9771 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
W20260709 13:14:43.145591  9824 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:14:43.150701  9519 catalog_manager.cc:5697] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 1 to 2, leader changed from fc155e5e1abb4763a834f8a649caf28b (127.9.68.67) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.270658  9846 raft_consensus.cc:993] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:43.271101  9820 raft_consensus.cc:1081] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Signalling peer fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:43.272493  9771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:33816
I20260709 13:14:43.272943  9771 raft_consensus.cc:493] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.273307  9771 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.277765  9880 raft_consensus.cc:993] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: : Instructing follower 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:43.278190  9880 raft_consensus.cc:1081] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Signalling peer 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:43.279781  9624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:50690
I20260709 13:14:43.279850  9771 raft_consensus.cc:515] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.280362  9624 raft_consensus.cc:493] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.280725  9624 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.281770  9771 leader_election.cc:290] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 2 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:43.282784  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:43.283162  9699 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.286269  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "febed4d753194e2fa67a8c4b262aab93" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:43.286892  9622 raft_consensus.cc:3055] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.287223  9622 raft_consensus.cc:740] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:43.287218  9624 raft_consensus.cc:515] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.288127  9622 consensus_queue.cc:260] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.288650  9699 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 2.
I20260709 13:14:43.289408  9622 raft_consensus.cc:3060] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.289857  9737 leader_election.cc:304] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:43.290038  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:43.290575  9824 raft_consensus.cc:2804] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.290620  9698 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.291069  9824 raft_consensus.cc:697] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:43.291823  9824 consensus_queue.cc:237] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.296564  9622 raft_consensus.cc:2468] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 2.
I20260709 13:14:43.297674  9698 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 2.
I20260709 13:14:43.298923  9588 leader_election.cc:304] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:43.299904  9820 raft_consensus.cc:2804] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.299230  9519 catalog_manager.cc:5697] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 1 to 2, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:43.300199  9624 leader_election.cc:290] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 2 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:43.301577  9820 raft_consensus.cc:697] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:43.301488  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:43.302889  9771 raft_consensus.cc:3055] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.303253  9771 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:43.302527  9820 consensus_queue.cc:237] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.304080  9771 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.305416  9771 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.313885  9771 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 2.
I20260709 13:14:43.313458  9521 catalog_manager.cc:5697] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 1 to 2, leader changed from fc155e5e1abb4763a834f8a649caf28b (127.9.68.67) to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.354866  9869 consensus_queue.cc:1048] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.369400  9899 consensus_queue.cc:1048] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.415931  9851 raft_consensus.cc:993] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: : Instructing follower 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:43.416368  9824 raft_consensus.cc:1081] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Signalling peer 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:43.417773  9624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:50690
I20260709 13:14:43.418236  9624 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.418562  9624 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.424553  9624 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.426193  9624 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 2 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:43.426937  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:43.427209  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:43.427501  9698 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.427922  9771 raft_consensus.cc:3055] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.428292  9771 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:43.428984  9771 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.429913  9771 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.433940  9771 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 2.
I20260709 13:14:43.434005  9698 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 2.
I20260709 13:14:43.434993  9587 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:43.435635  9820 raft_consensus.cc:2804] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.436093  9820 raft_consensus.cc:697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:43.436826  9820 consensus_queue.cc:237] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.442610  9519 catalog_manager.cc:5697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 1 to 2, leader changed from fc155e5e1abb4763a834f8a649caf28b (127.9.68.67) to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.651801  9845 raft_consensus.cc:993] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:43.652232  9820 raft_consensus.cc:1081] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:43.653561  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:14:43.653962  9698 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:43.654248  9698 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.658466  9698 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.659930  9698 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:43.660893  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:43.661062  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:43.661492  9624 raft_consensus.cc:3055] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:43.661665  9771 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.661885  9624 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:43.662729  9624 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.663892  9624 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.668081  9771 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
I20260709 13:14:43.668107  9624 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
I20260709 13:14:43.669485  9662 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:43.670184  9869 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.670671  9869 raft_consensus.cc:697] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:43.671347  9869 consensus_queue.cc:237] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:43.677529  9519 catalog_manager.cc:5697] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 1 to 2, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.718672  9698 raft_consensus.cc:1275] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.719961  9824 consensus_queue.cc:1048] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.727202  9624 raft_consensus.cc:1275] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.729537  9851 consensus_queue.cc:1048] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.730170  9622 raft_consensus.cc:1275] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.731679  9869 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.734520  9771 raft_consensus.cc:1275] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.735749  9869 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:43.894742  9698 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.896164  9820 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.904500  9771 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.905680  9772 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.907742  9845 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.908209  9903 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:43.921200  9698 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.922495  9845 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:44.165517  9772 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:44.167171  9869 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:44.176158  9624 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:44.178050  9899 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.128399  9489 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:14:46.129518  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:46.150238  9624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:50716
I20260709 13:14:46.150756  9624 raft_consensus.cc:606] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Received request to transfer leadership to TS fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:46.160873  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:46.161461  9698 raft_consensus.cc:606] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Received request to transfer leadership to TS fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:46.162879  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:46.163514  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.335593  9911 raft_consensus.cc:993] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:46.336058  9911 raft_consensus.cc:1081] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Signalling peer fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:46.337366  9772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:33816
I20260709 13:14:46.337761  9772 raft_consensus.cc:493] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.338043  9772 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.343730  9772 raft_consensus.cc:515] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.345095  9772 leader_election.cc:290] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 2 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:46.345932  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:46.346087  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:46.346447  9624 raft_consensus.cc:3055] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.346607  9698 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.346781  9624 raft_consensus.cc:740] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:46.347541  9624 consensus_queue.cc:260] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.348416  9624 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.350848  9698 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 2.
I20260709 13:14:46.351785  9737 leader_election.cc:304] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:46.352463  9851 raft_consensus.cc:2804] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.352721  9624 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 2.
I20260709 13:14:46.353609  9851 raft_consensus.cc:697] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:46.354310  9851 consensus_queue.cc:237] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.360122  9519 catalog_manager.cc:5697] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 1 to 2, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.514575  9823 raft_consensus.cc:993] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:46.515111  9923 raft_consensus.cc:1081] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Signalling peer fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:46.516712  9772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:33826
I20260709 13:14:46.517225  9772 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.517589  9772 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.522079  9772 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.523654  9772 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 3 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:46.524415  9624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:46.524786  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:46.525084  9624 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.525497  9698 raft_consensus.cc:3055] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.525840  9698 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:46.526459  9698 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.527426  9698 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.530591  9624 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 3.
I20260709 13:14:46.531628  9738 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:46.532045  9698 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 3.
I20260709 13:14:46.532377  9851 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:46.532907  9851 raft_consensus.cc:697] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:46.533718  9851 consensus_queue.cc:237] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:46.542897  9519 catalog_manager.cc:5697] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 2 to 3, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.883955  9624 raft_consensus.cc:1275] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.885427  9851 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.895620  9698 raft_consensus.cc:1275] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.897207  9851 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.010350  9698 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:47.011615  9927 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.019910  9622 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:47.021783  9851 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.164348  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.173834  9622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:50706
I20260709 13:14:47.174407  9622 raft_consensus.cc:606] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:47.178938  9622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:50706
I20260709 13:14:47.179401  9622 raft_consensus.cc:606] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:47.184008  9622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:50706
I20260709 13:14:47.184592  9622 raft_consensus.cc:606] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:47.189941  9772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:33832
I20260709 13:14:47.190392  9772 raft_consensus.cc:606] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:47.197364  9772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
mode: GRACEFUL
new_leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:33832
I20260709 13:14:47.197783  9772 raft_consensus.cc:606] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Received request to transfer leadership to TS e6b5dfd6933547b2b9bebf6ccb608c99
I20260709 13:14:47.202373  9934 raft_consensus.cc:993] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.202834  9911 raft_consensus.cc:1081] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.204326  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:14:47.204841  9698 raft_consensus.cc:493] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.205575  9698 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.210649  9698 raft_consensus.cc:515] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:47.211961  9698 leader_election.cc:290] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:47.212797  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:47.212944  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:47.213408  9622 raft_consensus.cc:3055] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.213418  9772 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.213903  9622 raft_consensus.cc:740] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:47.214679  9622 consensus_queue.cc:260] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:47.215811  9622 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.219846  9772 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
I20260709 13:14:47.221024  9662 leader_election.cc:304] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:47.221640  9622 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 2.
I20260709 13:14:47.221691  9923 raft_consensus.cc:2804] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.222716  9923 raft_consensus.cc:697] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:47.223358  9923 consensus_queue.cc:237] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:47.229182  9519 catalog_manager.cc:5697] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 1 to 2, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.415146  9851 raft_consensus.cc:993] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.415575  9927 raft_consensus.cc:1081] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.417022  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44096
I20260709 13:14:47.417475  9698 raft_consensus.cc:493] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.417793  9698 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.422042  9698 raft_consensus.cc:515] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.423930  9698 leader_election.cc:290] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:47.424271  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:47.424832  9622 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.425911  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3149f500941a434a8e0c876a308bd71c" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:47.426414  9772 raft_consensus.cc:3055] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.426723  9772 raft_consensus.cc:740] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:47.427435  9772 consensus_queue.cc:260] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.428782  9772 raft_consensus.cc:3060] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.430984  9622 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.431953  9664 leader_election.cc:304] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:47.432844  9923 raft_consensus.cc:2804] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.433275  9923 raft_consensus.cc:697] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:47.434381  9772 raft_consensus.cc:2468] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.434361  9923 consensus_queue.cc:237] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.440438  9519 catalog_manager.cc:5697] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 2 to 3, leader changed from fc155e5e1abb4763a834f8a649caf28b (127.9.68.67) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.486009  9917 raft_consensus.cc:993] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.486716  9851 raft_consensus.cc:1081] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.488440  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44096
I20260709 13:14:47.488873  9698 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.489113  9698 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.493112  9698 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.494522  9698 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 4 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:47.495424  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:47.495424  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:47.496102  9622 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.496311  9772 raft_consensus.cc:3055] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:47.496690  9772 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:47.497406  9772 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.498315  9772 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.500708  9622 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 4.
I20260709 13:14:47.501822  9664 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:47.502635  9935 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:47.503053  9935 raft_consensus.cc:697] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:47.503381  9772 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 4.
I20260709 13:14:47.503933  9935 consensus_queue.cc:237] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.512984  9519 catalog_manager.cc:5697] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 3 to 4, leader changed from fc155e5e1abb4763a834f8a649caf28b (127.9.68.67) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 4 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.575109  9934 raft_consensus.cc:993] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.575613  9934 raft_consensus.cc:1081] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.576900  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:14:47.577275  9698 raft_consensus.cc:493] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.577508  9698 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.581043  9698 raft_consensus.cc:515] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.582494  9698 leader_election.cc:290] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:47.583382  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:47.583850  9622 raft_consensus.cc:3055] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.583681  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:47.584149  9622 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:47.584415  9772 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.584903  9622 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.585964  9622 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.589768  9772 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.590574  9622 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.590806  9662 leader_election.cc:304] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:47.591591  9935 raft_consensus.cc:2804] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.592042  9935 raft_consensus.cc:697] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:47.592648  9935 consensus_queue.cc:237] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.598810  9519 catalog_manager.cc:5697] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 2 to 3, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.609458  9911 raft_consensus.cc:993] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: : Instructing follower e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.609936  9934 raft_consensus.cc:1081] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Signalling peer e6b5dfd6933547b2b9bebf6ccb608c99 to start an election
I20260709 13:14:47.611454  9698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:14:47.611831  9698 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.612062  9698 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.615681  9698 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.617110  9698 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:47.617998  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:47.618304  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:47.618681  9622 raft_consensus.cc:3055] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.618768  9772 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.619215  9622 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:47.620023  9622 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.621184  9622 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.624692  9772 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.625730  9662 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6b5dfd6933547b2b9bebf6ccb608c99, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:47.626586  9935 raft_consensus.cc:2804] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.627274  9622 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6b5dfd6933547b2b9bebf6ccb608c99 in term 3.
I20260709 13:14:47.627884  9935 raft_consensus.cc:697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Becoming Leader. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:47.628787  9935 consensus_queue.cc:237] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:47.629705  9622 raft_consensus.cc:1275] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:47.631250  9941 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.637476  9519 catalog_manager.cc:5697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 reported cstate change: term changed from 2 to 3, leader changed from 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65) to e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.646706  9772 raft_consensus.cc:1275] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:47.647879  9935 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.815507  9622 raft_consensus.cc:1275] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:47.816702  9935 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.823766  9772 raft_consensus.cc:1275] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:47.824932  9941 consensus_queue.cc:1048] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.987936  9772 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:47.989197  9941 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.999266  9622 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.000671  9935 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.006759  9624 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:48.008623  9935 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.015671  9772 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:48.017097  9950 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.198612  9624 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.199882  9950 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.208026  9772 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Refusing update from remote peer e6b5dfd6933547b2b9bebf6ccb608c99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.209614  9923 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:50.208148  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.215277  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:50.215987  9698 raft_consensus.cc:606] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Received request to transfer leadership to TS 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:50.218410  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:50.218809  9698 raft_consensus.cc:606] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 LEADER]: Received request to transfer leadership to TS 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:50.220865  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:50.221302  9698 raft_consensus.cc:606] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Received request to transfer leadership to TS 06c7a2aff9c34cf2abcb2f76c8585727
I20260709 13:14:50.223876  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:50.224416  9698 raft_consensus.cc:606] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Received request to transfer leadership to TS fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:50.226928  9698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
mode: GRACEFUL
new_leader_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:44120
I20260709 13:14:50.227370  9698 raft_consensus.cc:606] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Received request to transfer leadership to TS fc155e5e1abb4763a834f8a649caf28b
I20260709 13:14:50.228515  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:50.229007  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:50.267623  9941 raft_consensus.cc:993] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:50.268165  9955 raft_consensus.cc:1081] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Signalling peer fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:50.269908  9771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:33826
I20260709 13:14:50.270390  9771 raft_consensus.cc:493] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.270732  9771 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.276037  9771 raft_consensus.cc:515] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.277817  9771 leader_election.cc:290] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 3 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:50.278729  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:50.279491  9622 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.279191  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a67ab5006b74a21ad8c391d81b2d093" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:50.280071  9698 raft_consensus.cc:3055] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:50.280329  9698 raft_consensus.cc:740] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:50.281004  9698 consensus_queue.cc:260] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.282163  9698 raft_consensus.cc:3060] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.284749  9622 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 3.
I20260709 13:14:50.285928  9738 leader_election.cc:304] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:50.286814  9917 raft_consensus.cc:2804] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.286868  9698 raft_consensus.cc:2468] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 3.
I20260709 13:14:50.288542  9917 raft_consensus.cc:697] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:50.289553  9917 consensus_queue.cc:237] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.297101  9520 catalog_manager.cc:5697] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 2 to 3, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:50.425694  9941 raft_consensus.cc:993] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:50.426222  9941 raft_consensus.cc:1081] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Signalling peer fc155e5e1abb4763a834f8a649caf28b to start an election
I20260709 13:14:50.427863  9771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257"
dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
 from {username='slave'} at 127.0.0.1:33826
I20260709 13:14:50.428417  9771 raft_consensus.cc:493] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.428719  9771 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.432991  9771 raft_consensus.cc:515] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.434505  9771 leader_election.cc:290] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 4 election: Requested vote from peers 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:50.435235  9622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
I20260709 13:14:50.435431  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24cc891f0d14ab089ffcb364a31d257" candidate_uuid: "fc155e5e1abb4763a834f8a649caf28b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:50.435801  9622 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.435881  9698 raft_consensus.cc:3055] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:50.436213  9698 raft_consensus.cc:740] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:50.436957  9698 consensus_queue.cc:260] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.438055  9698 raft_consensus.cc:3060] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.441972  9622 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 4.
I20260709 13:14:50.442940  9738 leader_election.cc:304] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:50.443534  9698 raft_consensus.cc:2468] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc155e5e1abb4763a834f8a649caf28b in term 4.
I20260709 13:14:50.443630  9917 raft_consensus.cc:2804] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:50.444123  9917 raft_consensus.cc:697] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 4 LEADER]: Becoming Leader. State: Replica: fc155e5e1abb4763a834f8a649caf28b, State: Running, Role: LEADER
I20260709 13:14:50.444893  9917 consensus_queue.cc:237] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.451949  9520 catalog_manager.cc:5697] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b reported cstate change: term changed from 3 to 4, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to fc155e5e1abb4763a834f8a649caf28b (127.9.68.67). New cstate: current_term: 4 leader_uuid: "fc155e5e1abb4763a834f8a649caf28b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:50.600024  9955 raft_consensus.cc:993] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.600428  9941 raft_consensus.cc:1081] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Signalling peer 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.601959  9622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:50700
I20260709 13:14:50.602595  9622 raft_consensus.cc:493] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.602911  9622 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.608793  9622 raft_consensus.cc:515] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.609351  9955 raft_consensus.cc:993] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.609840  9941 raft_consensus.cc:1081] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 LEADER]: Signalling peer 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.611008  9622 leader_election.cc:290] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 4 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:50.611757  9624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:50700
I20260709 13:14:50.612370  9624 raft_consensus.cc:493] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.612814  9624 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.612432  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:50.612434  9698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445b4f6e4ef54e7eacb6ab9f03549f21" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:50.613374  9771 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.613415  9698 raft_consensus.cc:3055] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:50.614078  9698 raft_consensus.cc:740] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:50.614862  9698 consensus_queue.cc:260] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.616003  9698 raft_consensus.cc:3060] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.619513  9624 raft_consensus.cc:515] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.620465  9771 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 4.
I20260709 13:14:50.621040  9955 raft_consensus.cc:993] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: : Instructing follower 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.621927  9941 raft_consensus.cc:1081] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Signalling peer 06c7a2aff9c34cf2abcb2f76c8585727 to start an election
I20260709 13:14:50.622987  9699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:50.623695  9699 raft_consensus.cc:3055] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:50.624025  9699 raft_consensus.cc:740] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:50.623857  9623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a"
dest_uuid: "06c7a2aff9c34cf2abcb2f76c8585727"
 from {username='slave'} at 127.0.0.1:50700
I20260709 13:14:50.624531  9623 raft_consensus.cc:493] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.624926  9623 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.624717  9699 consensus_queue.cc:260] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.625813  9699 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.625813  9587 leader_election.cc:304] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:50.631582  9623 raft_consensus.cc:515] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:50.623059  9624 leader_election.cc:290] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 5 election: Requested vote from peers e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923), fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487)
I20260709 13:14:50.632445  9771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bfa97fbb0c4db385fc81c59adc8f67" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:50.634829  9699 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 5.
I20260709 13:14:50.634994  9771 raft_consensus.cc:3060] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.635339  9697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99"
I20260709 13:14:50.635602  9772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017fc75d215745b7afd84a4ced15fe4a" candidate_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc155e5e1abb4763a834f8a649caf28b"
I20260709 13:14:50.635900  9697 raft_consensus.cc:3055] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:50.636113  9588 leader_election.cc:304] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, e6b5dfd6933547b2b9bebf6ccb608c99; no voters: 
I20260709 13:14:50.634824  9698 raft_consensus.cc:2468] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 4.
I20260709 13:14:50.636169  9772 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.634408  9623 leader_election.cc:290] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 3 election: Requested vote from peers fc155e5e1abb4763a834f8a649caf28b (127.9.68.67:46487), e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923)
I20260709 13:14:50.636256  9697 raft_consensus.cc:740] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6b5dfd6933547b2b9bebf6ccb608c99, State: Running, Role: LEADER
I20260709 13:14:50.639488  9697 consensus_queue.cc:260] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:50.633976  9963 raft_consensus.cc:2804] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:50.640743  9697 raft_consensus.cc:3060] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.640748  9771 raft_consensus.cc:2468] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 5.
I20260709 13:14:50.642678  9772 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 3.
I20260709 13:14:50.643745  9587 leader_election.cc:304] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06c7a2aff9c34cf2abcb2f76c8585727, fc155e5e1abb4763a834f8a649caf28b; no voters: 
I20260709 13:14:50.643663  9963 raft_consensus.cc:697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:50.644693  9965 raft_consensus.cc:2804] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.645181  9963 consensus_queue.cc:237] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.645946  9965 raft_consensus.cc:697] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:50.646744  9965 consensus_queue.cc:237] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } }
I20260709 13:14:50.648046  9697 raft_consensus.cc:2468] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06c7a2aff9c34cf2abcb2f76c8585727 in term 3.
I20260709 13:14:50.638620  9964 raft_consensus.cc:2804] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:50.649470  9964 raft_consensus.cc:697] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 5 LEADER]: Becoming Leader. State: Replica: 06c7a2aff9c34cf2abcb2f76c8585727, State: Running, Role: LEADER
I20260709 13:14:50.650499  9964 consensus_queue.cc:237] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } }
I20260709 13:14:50.653831  9520 catalog_manager.cc:5697] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 3 to 4, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.665009  9520 catalog_manager.cc:5697] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 4 to 5, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.666098  9520 catalog_manager.cc:5697] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 reported cstate change: term changed from 2 to 3, leader changed from e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66) to 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.826470  9697 raft_consensus.cc:1275] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:50.828037  9917 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:50.838889  9623 raft_consensus.cc:1275] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:50.840349  9917 consensus_queue.cc:1048] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:51.032665  9697 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:51.034070  9964 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:51.042613  9772 raft_consensus.cc:1275] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:51.043985  9963 consensus_queue.cc:1048] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:51.045835  9623 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:51.047699  9917 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06c7a2aff9c34cf2abcb2f76c8585727" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:51.049124  9697 raft_consensus.cc:1275] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Refusing update from remote peer fc155e5e1abb4763a834f8a649caf28b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:51.050520  9917 consensus_queue.cc:1048] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:51.176893  9772 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 5 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:51.178228  9963 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:51.187045  9697 raft_consensus.cc:1275] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 5 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:51.188686  9965 consensus_queue.cc:1048] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:51.205431  9772 raft_consensus.cc:1275] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.206480  9965 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc155e5e1abb4763a834f8a649caf28b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:51.215797  9697 raft_consensus.cc:1275] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Refusing update from remote peer 06c7a2aff9c34cf2abcb2f76c8585727: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.217147  9963 consensus_queue.cc:1048] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6b5dfd6933547b2b9bebf6ccb608c99" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:51.230057  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.235602  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
W20260709 13:14:51.244515  9664 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:51.249282  9664 consensus_peers.cc:597] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 -> Peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Couldn't send request to peer 06c7a2aff9c34cf2abcb2f76c8585727. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.252803  9664 consensus_peers.cc:597] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 -> Peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Couldn't send request to peer 06c7a2aff9c34cf2abcb2f76c8585727. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.262004  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:51.262862  9489 tablet_replica.cc:333] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.264006  9489 raft_consensus.cc:2243] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.264547  9489 raft_consensus.cc:2272] T 5a67ab5006b74a21ad8c391d81b2d093 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.267537  9489 tablet_replica.cc:333] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.268213  9489 raft_consensus.cc:2243] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.269002  9489 raft_consensus.cc:2272] T 445b4f6e4ef54e7eacb6ab9f03549f21 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.270658  9489 tablet_replica.cc:333] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.271098  9489 raft_consensus.cc:2243] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.271445  9489 raft_consensus.cc:2272] T e24cc891f0d14ab089ffcb364a31d257 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.273075  9489 tablet_replica.cc:333] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.273573  9489 raft_consensus.cc:2243] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.273900  9489 raft_consensus.cc:2272] T 7309c0ff82f54e5fbb59494ec3616344 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.275454  9489 tablet_replica.cc:333] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.275945  9489 raft_consensus.cc:2243] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.276573  9489 raft_consensus.cc:2272] T 36bfa97fbb0c4db385fc81c59adc8f67 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.278350  9489 tablet_replica.cc:333] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.278846  9489 raft_consensus.cc:2243] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.279493  9489 raft_consensus.cc:2272] T 017fc75d215745b7afd84a4ced15fe4a P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.281461  9489 tablet_replica.cc:333] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.281903  9489 raft_consensus.cc:2243] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.282290  9489 raft_consensus.cc:2272] T febed4d753194e2fa67a8c4b262aab93 P 06c7a2aff9c34cf2abcb2f76c8585727 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.283854  9489 tablet_replica.cc:333] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.284276  9489 raft_consensus.cc:2243] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.284705  9489 raft_consensus.cc:2272] T 7df20c98ead64f3f971e74e7ace93f4e P 06c7a2aff9c34cf2abcb2f76c8585727 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.286329  9489 tablet_replica.cc:333] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727: stopping tablet replica
I20260709 13:14:51.286757  9489 raft_consensus.cc:2243] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.287135  9489 raft_consensus.cc:2272] T 3149f500941a434a8e0c876a308bd71c P 06c7a2aff9c34cf2abcb2f76c8585727 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.381057  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
I20260709 13:14:51.401427  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
I20260709 13:14:51.430792  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:51.431566  9489 tablet_replica.cc:333] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.432500  9489 raft_consensus.cc:2243] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.433151  9489 raft_consensus.cc:2272] T 017fc75d215745b7afd84a4ced15fe4a P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.438896  9489 tablet_replica.cc:333] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.439483  9489 raft_consensus.cc:2243] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:51.439610  9738 consensus_peers.cc:597] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b -> Peer 06c7a2aff9c34cf2abcb2f76c8585727 (127.9.68.65:40507): Couldn't send request to peer 06c7a2aff9c34cf2abcb2f76c8585727. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:40507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.439994  9489 raft_consensus.cc:2272] T 5a67ab5006b74a21ad8c391d81b2d093 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.442088  9489 tablet_replica.cc:333] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.442500  9489 raft_consensus.cc:2243] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.443114  9489 raft_consensus.cc:2272] T 3149f500941a434a8e0c876a308bd71c P e6b5dfd6933547b2b9bebf6ccb608c99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.444615  9489 tablet_replica.cc:333] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.445019  9489 raft_consensus.cc:2243] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.445734  9489 raft_consensus.cc:2272] T 7df20c98ead64f3f971e74e7ace93f4e P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.447300  9489 tablet_replica.cc:333] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.447719  9489 raft_consensus.cc:2243] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.448055  9489 raft_consensus.cc:2272] T febed4d753194e2fa67a8c4b262aab93 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.449580  9489 tablet_replica.cc:333] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.450006  9489 raft_consensus.cc:2243] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.450310  9489 raft_consensus.cc:2272] T 36bfa97fbb0c4db385fc81c59adc8f67 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.452003  9489 tablet_replica.cc:333] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.452373  9489 raft_consensus.cc:2243] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.452694  9489 raft_consensus.cc:2272] T 445b4f6e4ef54e7eacb6ab9f03549f21 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.454574  9489 tablet_replica.cc:333] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.454948  9489 raft_consensus.cc:2243] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.455519  9489 raft_consensus.cc:2272] T 7309c0ff82f54e5fbb59494ec3616344 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.456868  9489 tablet_replica.cc:333] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99: stopping tablet replica
I20260709 13:14:51.457233  9489 raft_consensus.cc:2243] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.457612  9489 raft_consensus.cc:2272] T e24cc891f0d14ab089ffcb364a31d257 P e6b5dfd6933547b2b9bebf6ccb608c99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.485603  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
W20260709 13:14:51.486994  9737 consensus_peers.cc:597] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b -> Peer e6b5dfd6933547b2b9bebf6ccb608c99 (127.9.68.66:34923): Couldn't send request to peer e6b5dfd6933547b2b9bebf6ccb608c99. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.502300  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:14:51.526280  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:51.526904  9489 tablet_replica.cc:333] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.527796  9489 raft_consensus.cc:2243] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.528573  9489 raft_consensus.cc:2272] T 7df20c98ead64f3f971e74e7ace93f4e P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.530323  9489 tablet_replica.cc:333] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.530761  9489 raft_consensus.cc:2243] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.531394  9489 raft_consensus.cc:2272] T febed4d753194e2fa67a8c4b262aab93 P fc155e5e1abb4763a834f8a649caf28b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.532800  9489 tablet_replica.cc:333] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.533213  9489 raft_consensus.cc:2243] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.533632  9489 raft_consensus.cc:2272] T 445b4f6e4ef54e7eacb6ab9f03549f21 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.535218  9489 tablet_replica.cc:333] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.535722  9489 raft_consensus.cc:2243] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.536090  9489 raft_consensus.cc:2272] T 017fc75d215745b7afd84a4ced15fe4a P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.538224  9489 tablet_replica.cc:333] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.538697  9489 raft_consensus.cc:2243] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.539104  9489 raft_consensus.cc:2272] T 7309c0ff82f54e5fbb59494ec3616344 P fc155e5e1abb4763a834f8a649caf28b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.540573  9489 tablet_replica.cc:333] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.541007  9489 raft_consensus.cc:2243] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.541702  9489 raft_consensus.cc:2272] T e24cc891f0d14ab089ffcb364a31d257 P fc155e5e1abb4763a834f8a649caf28b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.543284  9489 tablet_replica.cc:333] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.543747  9489 raft_consensus.cc:2243] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.544126  9489 raft_consensus.cc:2272] T 36bfa97fbb0c4db385fc81c59adc8f67 P fc155e5e1abb4763a834f8a649caf28b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.546139  9489 tablet_replica.cc:333] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.546590  9489 raft_consensus.cc:2243] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.547227  9489 raft_consensus.cc:2272] T 5a67ab5006b74a21ad8c391d81b2d093 P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.548982  9489 tablet_replica.cc:333] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b: stopping tablet replica
I20260709 13:14:51.549456  9489 raft_consensus.cc:2243] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.549842  9489 raft_consensus.cc:2272] T 3149f500941a434a8e0c876a308bd71c P fc155e5e1abb4763a834f8a649caf28b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.575208  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:14:51.593271  9489 master.cc:562] Master@127.9.68.126:35699 shutting down...
I20260709 13:14:51.637192  9576 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:14:51.790537  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.791225  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.791594  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P cbebd86d7fa94b4bac71176908662866: stopping tablet replica
I20260709 13:14:51.812249  9489 master.cc:584] Master@127.9.68.126:35699 shutdown complete.
06c7a2aff9c34cf2abcb2f76c8585727  4
e6b5dfd6933547b2b9bebf6ccb608c99  4
fc155e5e1abb4763a834f8a649caf28b  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12653 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:14:51.856016  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:37711
I20260709 13:14:51.857048  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:51.862442  9987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:51.862646  9988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:51.865097  9489 server_base.cc:1061] running on GCE node
W20260709 13:14:51.865106  9990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:51.866180  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:51.866364  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:51.866539  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602891866524 us; error 0 us; skew 500 ppm
I20260709 13:14:51.867079  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:51.870023  9489 webserver.cc:533] Webserver started at http://127.9.68.126:40049/ using document root <none> and password file <none>
I20260709 13:14:51.870651  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:51.870822  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:51.871189  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:51.872416  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "efde2403010d470cbbee35dab66d2613"
format_stamp: "Formatted at 2026-07-09 13:14:51 on dist-test-slave-9s6w"
I20260709 13:14:51.876981  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:14:51.880152  9995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:51.881098  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:51.881414  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "efde2403010d470cbbee35dab66d2613"
format_stamp: "Formatted at 2026-07-09 13:14:51 on dist-test-slave-9s6w"
I20260709 13:14:51.881695  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:51.898805  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:51.899909  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:51.943476  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:37711
I20260709 13:14:51.943607 10046 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:37711 every 8 connection(s)
I20260709 13:14:51.947926 10047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.958045 10047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613: Bootstrap starting.
I20260709 13:14:51.963107 10047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:51.967697 10047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613: No bootstrap required, opened a new log
I20260709 13:14:51.969823 10047 raft_consensus.cc:359] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER }
I20260709 13:14:51.970163 10047 raft_consensus.cc:385] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:51.970431 10047 raft_consensus.cc:740] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efde2403010d470cbbee35dab66d2613, State: Initialized, Role: FOLLOWER
I20260709 13:14:51.971086 10047 consensus_queue.cc:260] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER }
I20260709 13:14:51.971649 10047 raft_consensus.cc:399] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:51.971866 10047 raft_consensus.cc:493] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:51.972167 10047 raft_consensus.cc:3060] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:51.976089 10047 raft_consensus.cc:515] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER }
I20260709 13:14:51.976588 10047 leader_election.cc:304] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efde2403010d470cbbee35dab66d2613; no voters: 
I20260709 13:14:51.977687 10047 leader_election.cc:290] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:51.977998 10050 raft_consensus.cc:2804] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:51.979197 10050 raft_consensus.cc:697] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 1 LEADER]: Becoming Leader. State: Replica: efde2403010d470cbbee35dab66d2613, State: Running, Role: LEADER
I20260709 13:14:51.979816 10050 consensus_queue.cc:237] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER }
I20260709 13:14:51.980464 10047 sys_catalog.cc:565] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:51.984843 10052 sys_catalog.cc:455] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efde2403010d470cbbee35dab66d2613. Latest consensus state: current_term: 1 leader_uuid: "efde2403010d470cbbee35dab66d2613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER } }
I20260709 13:14:51.984906 10051 sys_catalog.cc:455] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efde2403010d470cbbee35dab66d2613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efde2403010d470cbbee35dab66d2613" member_type: VOTER } }
I20260709 13:14:51.985678 10052 sys_catalog.cc:458] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:51.985743 10051 sys_catalog.cc:458] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:51.988654 10057 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:51.993553 10057 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:51.996603  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:52.002085 10057 catalog_manager.cc:1383] Generated new cluster ID: 071f4d96ea804d278932092fae1403d9
I20260709 13:14:52.002456 10057 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:52.022912 10057 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:52.024047 10057 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:52.040874 10057 catalog_manager.cc:6070] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613: Generated new TSK 0
I20260709 13:14:52.041390 10057 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:52.062836  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:52.068750 10068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.069506 10069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.071192 10071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:52.071892  9489 server_base.cc:1061] running on GCE node
I20260709 13:14:52.072580  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:52.072759  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:52.072875  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602892072864 us; error 0 us; skew 500 ppm
I20260709 13:14:52.073295  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:52.075392  9489 webserver.cc:533] Webserver started at http://127.9.68.65:37417/ using document root <none> and password file <none>
I20260709 13:14:52.075831  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:52.076020  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:52.076231  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:52.077175  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "6e6e098bf0524026a28e56596c54498f"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.081496  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:14:52.085220 10076 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.086181  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:52.086508  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "6e6e098bf0524026a28e56596c54498f"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.086759  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:52.105732  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:52.106851  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:52.108237  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:52.110378  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:52.110622  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.110854  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:52.111033  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.153272  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:43215
I20260709 13:14:52.153437 10138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:43215 every 8 connection(s)
I20260709 13:14:52.158082  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:52.164566 10143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.166057 10144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.170114 10146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:52.170291  9489 server_base.cc:1061] running on GCE node
I20260709 13:14:52.171627  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:52.171978  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:52.172230  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602892172204 us; error 0 us; skew 500 ppm
I20260709 13:14:52.172799  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:52.175539 10139 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37711
I20260709 13:14:52.175643  9489 webserver.cc:533] Webserver started at http://127.9.68.66:34027/ using document root <none> and password file <none>
I20260709 13:14:52.175909 10139 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:52.176229  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:52.176443  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:52.176721  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:52.176689 10139 heartbeater.cc:507] Master 127.9.68.126:37711 requested a full tablet report, sending...
I20260709 13:14:52.178166  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "1fbdbb04fe4949a9b6a4135171748287"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.178943 10012 ts_manager.cc:194] Registered new tserver with Master: 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215)
I20260709 13:14:52.181221 10012 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34478
I20260709 13:14:52.184394  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:14:52.188267 10151 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.189231  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:52.189569  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "1fbdbb04fe4949a9b6a4135171748287"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.189797  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:52.201360  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:52.202771  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:52.204349  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:52.206709  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:52.206897  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.207078  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:52.207201  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.246551  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:36583
I20260709 13:14:52.246801 10213 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:36583 every 8 connection(s)
I20260709 13:14:52.250975  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:52.257768 10217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.259819 10218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:52.261785 10220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:52.262317  9489 server_base.cc:1061] running on GCE node
I20260709 13:14:52.263123  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:52.263341  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:52.263411 10214 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37711
I20260709 13:14:52.263566  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602892263547 us; error 0 us; skew 500 ppm
I20260709 13:14:52.263770 10214 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:52.264277  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:52.264567 10214 heartbeater.cc:507] Master 127.9.68.126:37711 requested a full tablet report, sending...
I20260709 13:14:52.266903  9489 webserver.cc:533] Webserver started at http://127.9.68.67:46385/ using document root <none> and password file <none>
I20260709 13:14:52.267257 10012 ts_manager.cc:194] Registered new tserver with Master: 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:52.267489  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:52.267743  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:52.268033  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:52.268913 10012 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34494
I20260709 13:14:52.269435  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "7e5b019e61434aa9a537d13645535952"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.274008  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:14:52.277004 10225 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.277840  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:52.278061  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "7e5b019e61434aa9a537d13645535952"
format_stamp: "Formatted at 2026-07-09 13:14:52 on dist-test-slave-9s6w"
I20260709 13:14:52.278282  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:52.310611  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:52.311640  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:52.313042  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:52.315057  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:52.315227  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.315514  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:52.315663  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:52.356683  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:41237
I20260709 13:14:52.356779 10287 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:41237 every 8 connection(s)
I20260709 13:14:52.371888 10288 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37711
I20260709 13:14:52.372249 10288 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:52.372949 10288 heartbeater.cc:507] Master 127.9.68.126:37711 requested a full tablet report, sending...
I20260709 13:14:52.374706 10012 ts_manager.cc:194] Registered new tserver with Master: 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:52.375008  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015009048s
I20260709 13:14:52.376323 10012 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34500
I20260709 13:14:52.400444 10012 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34510:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:52.403153 10012 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:52.473766 10253 tablet_service.cc:1511] Processing CreateTablet for tablet 0070e5a8558e465a8d1500532ca9d508 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:52.475169 10253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0070e5a8558e465a8d1500532ca9d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.477403 10252 tablet_service.cc:1511] Processing CreateTablet for tablet d1fdac09e93a4487a72f2b0618ae1983 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:52.478703 10252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fdac09e93a4487a72f2b0618ae1983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.481218 10104 tablet_service.cc:1511] Processing CreateTablet for tablet 0070e5a8558e465a8d1500532ca9d508 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:52.482488 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0070e5a8558e465a8d1500532ca9d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.483091 10251 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbeb3975784839900434533aeaea29 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:52.484387 10251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbeb3975784839900434533aeaea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.488706 10250 tablet_service.cc:1511] Processing CreateTablet for tablet 52f2d79582634a89a500cd9e58e134c9 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:52.489944 10250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f2d79582634a89a500cd9e58e134c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.492029 10249 tablet_service.cc:1511] Processing CreateTablet for tablet 78d4bbf02be4416980e887a39abc3977 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:52.494717 10103 tablet_service.cc:1511] Processing CreateTablet for tablet d1fdac09e93a4487a72f2b0618ae1983 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:52.494976 10248 tablet_service.cc:1511] Processing CreateTablet for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:52.495996 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fdac09e93a4487a72f2b0618ae1983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.496547 10249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d4bbf02be4416980e887a39abc3977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.499620 10303 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.502425 10101 tablet_service.cc:1511] Processing CreateTablet for tablet 52f2d79582634a89a500cd9e58e134c9 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:52.504093 10102 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbeb3975784839900434533aeaea29 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:52.507294 10248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.514882 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f2d79582634a89a500cd9e58e134c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.516487 10100 tablet_service.cc:1511] Processing CreateTablet for tablet 78d4bbf02be4416980e887a39abc3977 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:52.527400 10252 tablet_service.cc:1511] Processing CreateTablet for tablet 455b0029d139403688436f6403979e4b (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:52.528625 10252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b0029d139403688436f6403979e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.532338 10247 tablet_service.cc:1511] Processing CreateTablet for tablet 203a87563b6b4c468ea8a7707468fc92 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:52.533818 10247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203a87563b6b4c468ea8a7707468fc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.537715 10100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d4bbf02be4416980e887a39abc3977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.516022 10253 tablet_service.cc:1511] Processing CreateTablet for tablet edc07fd9b44f456cb60c638015761f2f (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:52.538700 10253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc07fd9b44f456cb60c638015761f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.522907 10303 tablet_bootstrap.cc:654] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.541608 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbeb3975784839900434533aeaea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.526305 10099 tablet_service.cc:1511] Processing CreateTablet for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:52.548699 10099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.550122 10176 tablet_service.cc:1511] Processing CreateTablet for tablet 52f2d79582634a89a500cd9e58e134c9 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:52.550678 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 0070e5a8558e465a8d1500532ca9d508 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:52.551466 10176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f2d79582634a89a500cd9e58e134c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.552126 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0070e5a8558e465a8d1500532ca9d508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.554562 10104 tablet_service.cc:1511] Processing CreateTablet for tablet edc07fd9b44f456cb60c638015761f2f (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:52.556062 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc07fd9b44f456cb60c638015761f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.556517 10177 tablet_service.cc:1511] Processing CreateTablet for tablet 71fbeb3975784839900434533aeaea29 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:52.557794 10177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fbeb3975784839900434533aeaea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.562454 10098 tablet_service.cc:1511] Processing CreateTablet for tablet 455b0029d139403688436f6403979e4b (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:52.563712 10098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b0029d139403688436f6403979e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.566331 10097 tablet_service.cc:1511] Processing CreateTablet for tablet 203a87563b6b4c468ea8a7707468fc92 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:52.567530 10097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203a87563b6b4c468ea8a7707468fc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.570433 10175 tablet_service.cc:1511] Processing CreateTablet for tablet 78d4bbf02be4416980e887a39abc3977 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:52.571692 10175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d4bbf02be4416980e887a39abc3977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.571815 10174 tablet_service.cc:1511] Processing CreateTablet for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:52.573046 10174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e88f6b0f1a44eb8078fcab6e6c8f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.574493 10173 tablet_service.cc:1511] Processing CreateTablet for tablet edc07fd9b44f456cb60c638015761f2f (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:52.576627 10172 tablet_service.cc:1511] Processing CreateTablet for tablet 455b0029d139403688436f6403979e4b (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:52.578795 10096 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7a31d7b4b4602be303a8e94c2b6a1 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:52.580066 10096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7a31d7b4b4602be303a8e94c2b6a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.581435 10247 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7a31d7b4b4602be303a8e94c2b6a1 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:52.582839 10247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7a31d7b4b4602be303a8e94c2b6a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.583500 10171 tablet_service.cc:1511] Processing CreateTablet for tablet 203a87563b6b4c468ea8a7707468fc92 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:52.554677 10178 tablet_service.cc:1511] Processing CreateTablet for tablet d1fdac09e93a4487a72f2b0618ae1983 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:52.591225 10170 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7a31d7b4b4602be303a8e94c2b6a1 (DEFAULT_TABLE table=test-workload [id=18b76c82556f418f9801c8888de4455a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:52.592686 10173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc07fd9b44f456cb60c638015761f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.593390 10172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455b0029d139403688436f6403979e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.597621 10171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203a87563b6b4c468ea8a7707468fc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.598516 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1fdac09e93a4487a72f2b0618ae1983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.602226 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7a31d7b4b4602be303a8e94c2b6a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:52.650564 10306 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:52.651836 10303 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:52.652275 10303 ts_tablet_manager.cc:1403] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.011s
I20260709 13:14:52.655224 10303 raft_consensus.cc:359] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.655973 10303 raft_consensus.cc:385] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.656277 10303 raft_consensus.cc:740] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.657114 10306 tablet_bootstrap.cc:654] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.658284 10303 consensus_queue.cc:260] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.665278 10304 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:52.667884 10303 ts_tablet_manager.cc:1434] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:14:52.674454 10288 heartbeater.cc:499] Master 127.9.68.126:37711 was elected leader, sending a full tablet report...
I20260709 13:14:52.677719 10303 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.683684 10304 tablet_bootstrap.cc:654] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.693404 10303 tablet_bootstrap.cc:654] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.695350 10306 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:52.696029 10306 ts_tablet_manager.cc:1403] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:14:52.702405 10306 raft_consensus.cc:359] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.703096 10306 raft_consensus.cc:385] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.703413 10306 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.704738 10306 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.706974 10304 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:52.707183 10214 heartbeater.cc:499] Master 127.9.68.126:37711 was elected leader, sending a full tablet report...
I20260709 13:14:52.707356 10304 ts_tablet_manager.cc:1403] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.013s
I20260709 13:14:52.708247 10306 ts_tablet_manager.cc:1434] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:52.709233 10306 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:52.709619 10304 raft_consensus.cc:359] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.710167 10304 raft_consensus.cc:385] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.710409 10304 raft_consensus.cc:740] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.711012 10304 consensus_queue.cc:260] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.714598 10303 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:52.715130 10303 ts_tablet_manager.cc:1403] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.007s
I20260709 13:14:52.716671 10306 tablet_bootstrap.cc:654] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.718202 10303 raft_consensus.cc:359] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.718969 10303 raft_consensus.cc:385] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.719280 10303 raft_consensus.cc:740] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.720347 10303 consensus_queue.cc:260] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.723227 10303 ts_tablet_manager.cc:1434] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:52.724541 10303 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.733695 10303 tablet_bootstrap.cc:654] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.743649 10139 heartbeater.cc:499] Master 127.9.68.126:37711 was elected leader, sending a full tablet report...
I20260709 13:14:52.744298 10304 ts_tablet_manager.cc:1434] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.021s
I20260709 13:14:52.745211 10304 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:52.749537 10306 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:52.750003 10306 ts_tablet_manager.cc:1403] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.025s
I20260709 13:14:52.751906 10304 tablet_bootstrap.cc:654] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.753237 10306 raft_consensus.cc:359] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.753993 10306 raft_consensus.cc:385] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.754282 10306 raft_consensus.cc:740] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.754693 10303 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:52.755340 10303 ts_tablet_manager.cc:1403] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.014s
I20260709 13:14:52.755115 10306 consensus_queue.cc:260] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.759191 10303 raft_consensus.cc:359] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.760156 10303 raft_consensus.cc:385] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.760592 10306 ts_tablet_manager.cc:1434] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:52.760594 10303 raft_consensus.cc:740] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.761754 10306 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:52.762068 10303 consensus_queue.cc:260] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.767665 10303 ts_tablet_manager.cc:1434] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:14:52.768177 10306 tablet_bootstrap.cc:654] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.769001 10303 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.773252 10304 tablet_bootstrap.cc:492] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:52.773734 10304 ts_tablet_manager.cc:1403] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:14:52.775866 10303 tablet_bootstrap.cc:654] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.776594 10304 raft_consensus.cc:359] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.777340 10304 raft_consensus.cc:385] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.777634 10304 raft_consensus.cc:740] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.778455 10304 consensus_queue.cc:260] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.781306 10304 ts_tablet_manager.cc:1434] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:52.782582 10304 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:52.790915 10303 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:52.791316 10304 tablet_bootstrap.cc:654] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.791375 10303 ts_tablet_manager.cc:1403] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:14:52.794276 10306 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:52.794716 10306 ts_tablet_manager.cc:1403] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.007s
I20260709 13:14:52.794644 10303 raft_consensus.cc:359] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.795536 10303 raft_consensus.cc:385] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.795871 10303 raft_consensus.cc:740] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.796646 10303 consensus_queue.cc:260] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.797492 10306 raft_consensus.cc:359] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.798164 10306 raft_consensus.cc:385] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.798444 10306 raft_consensus.cc:740] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.799328 10303 ts_tablet_manager.cc:1434] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:52.799139 10306 consensus_queue.cc:260] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.800336 10303 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.801399 10306 ts_tablet_manager.cc:1434] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:52.806764 10306 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:52.806819 10303 tablet_bootstrap.cc:654] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.808221 10304 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:52.808663 10304 ts_tablet_manager.cc:1403] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 13:14:52.811976 10304 raft_consensus.cc:359] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.812855 10304 raft_consensus.cc:385] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.813158 10306 tablet_bootstrap.cc:654] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.813210 10304 raft_consensus.cc:740] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.814611 10304 consensus_queue.cc:260] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.820768 10304 ts_tablet_manager.cc:1434] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:14:52.821071 10307 raft_consensus.cc:493] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.821974 10304 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:52.821691 10307 raft_consensus.cc:515] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.829484 10304 tablet_bootstrap.cc:654] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.831835 10312 raft_consensus.cc:493] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.832261 10312 raft_consensus.cc:515] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.835086 10312 leader_election.cc:290] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:52.846194 10307 leader_election.cc:290] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:52.858628 10304 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:52.859217 10304 ts_tablet_manager.cc:1403] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.011s
I20260709 13:14:52.862691 10304 raft_consensus.cc:359] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.863747 10304 raft_consensus.cc:385] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.864367 10304 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.872280 10304 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.877255 10304 ts_tablet_manager.cc:1434] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:14:52.878383 10304 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:52.897938 10304 tablet_bootstrap.cc:654] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:52.907114 10307 raft_consensus.cc:493] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.907719 10307 raft_consensus.cc:515] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.910154 10307 leader_election.cc:290] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:52.917264 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:52.918128 10114 raft_consensus.cc:2468] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 0.
I20260709 13:14:52.919924 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:52.920646 10114 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 0.
I20260709 13:14:52.921883 10229 leader_election.cc:304] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:52.922891 10307 raft_consensus.cc:2804] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:52.923358 10307 raft_consensus.cc:493] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.923792 10307 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:52.930473 10229 leader_election.cc:304] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:52.960062 10304 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:52.960322 10306 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:52.960362 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fdac09e93a4487a72f2b0618ae1983" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:52.960649 10304 ts_tablet_manager.cc:1403] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.033s
I20260709 13:14:52.960855 10306 ts_tablet_manager.cc:1403] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.154s	user 0.065s	sys 0.086s
I20260709 13:14:52.961102 10263 raft_consensus.cc:2468] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 0.
I20260709 13:14:52.962477 10078 leader_election.cc:304] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:52.963305 10312 raft_consensus.cc:2804] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:52.963647 10312 raft_consensus.cc:493] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.963999 10312 raft_consensus.cc:3060] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:52.963771 10306 raft_consensus.cc:359] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.964450 10306 raft_consensus.cc:385] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.964838 10306 raft_consensus.cc:740] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.964315 10304 raft_consensus.cc:359] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.965358 10304 raft_consensus.cc:385] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.965727 10304 raft_consensus.cc:740] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.966439 10304 consensus_queue.cc:260] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.967178 10307 raft_consensus.cc:515] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.969061 10307 leader_election.cc:290] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:52.969604 10307 raft_consensus.cc:2804] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:52.969933 10307 raft_consensus.cc:493] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:52.970257 10307 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:52.971143 10312 raft_consensus.cc:515] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.973570 10312 leader_election.cc:290] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:52.974604 10306 consensus_queue.cc:260] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.977834 10306 ts_tablet_manager.cc:1434] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.009s
I20260709 13:14:52.977965 10303 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:52.978469 10303 ts_tablet_manager.cc:1403] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.178s	user 0.052s	sys 0.095s
I20260709 13:14:52.978781 10306 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:52.981406 10303 raft_consensus.cc:359] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.982125 10303 raft_consensus.cc:385] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:52.982463 10303 raft_consensus.cc:740] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:52.983174 10303 consensus_queue.cc:260] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:52.985348 10303 ts_tablet_manager.cc:1434] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:14:52.985065 10307 raft_consensus.cc:515] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:52.986337 10303 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:52.986943 10307 leader_election.cc:290] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:52.991127 10306 tablet_bootstrap.cc:654] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:52.992329 10060 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:52.995889 10303 tablet_bootstrap.cc:654] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.003631 10306 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.004109 10306 ts_tablet_manager.cc:1403] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.010s
I20260709 13:14:53.007666 10306 raft_consensus.cc:359] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.008569 10306 raft_consensus.cc:385] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.008877 10306 raft_consensus.cc:740] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.009785 10306 consensus_queue.cc:260] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.011135 10303 tablet_bootstrap.cc:492] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:53.011760 10303 ts_tablet_manager.cc:1403] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
W20260709 13:14:52.974350 10229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:43215, user_credentials={real_user=slave}} blocked reactor thread for 43998.4us
I20260709 13:14:52.974908 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fdac09e93a4487a72f2b0618ae1983" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.012501 10263 raft_consensus.cc:3060] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.014804 10303 raft_consensus.cc:359] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.015533 10303 raft_consensus.cc:385] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.015882 10303 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.016721 10303 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.019002 10303 ts_tablet_manager.cc:1434] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:53.019909 10303 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:53.020799 10306 ts_tablet_manager.cc:1434] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:14:53.022099 10306 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:53.023293 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.023886 10114 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.027935 10303 tablet_bootstrap.cc:654] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.030632 10114 raft_consensus.cc:2468] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 1.
I20260709 13:14:53.022094 10263 raft_consensus.cc:2468] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 1.
I20260709 13:14:53.033197 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.033957 10113 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.034885 10311 raft_consensus.cc:493] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.035475 10311 raft_consensus.cc:515] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.037598 10078 leader_election.cc:304] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.038420 10312 raft_consensus.cc:2804] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.038851 10312 raft_consensus.cc:697] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 1 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:53.039372 10303 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:53.039872 10303 ts_tablet_manager.cc:1403] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:14:53.039660 10312 consensus_queue.cc:237] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.042685 10303 raft_consensus.cc:359] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.043558 10303 raft_consensus.cc:385] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.043889 10303 raft_consensus.cc:740] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.045104 10303 consensus_queue.cc:260] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.046932 10311 leader_election.cc:290] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.050312 10307 raft_consensus.cc:493] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.050113 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.050858 10307 raft_consensus.cc:515] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.051621 10303 ts_tablet_manager.cc:1434] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:14:53.054760 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.055374 10189 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 0.
I20260709 13:14:53.053064 10307 leader_election.cc:290] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:53.057600 10303 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:53.057554 10306 tablet_bootstrap.cc:654] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.066134 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.067996 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.068519 10189 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.071090 10112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.071730 10112 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.071748 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.072609 10303 tablet_bootstrap.cc:654] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.073091 10155 leader_election.cc:304] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:53.073772 10229 leader_election.cc:304] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
W20260709 13:14:53.073848 10153 leader_election.cc:343] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.074069 10311 raft_consensus.cc:2804] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.075040 10311 raft_consensus.cc:493] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.075515 10311 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.078428 10189 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 1.
I20260709 13:14:53.079543 10188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fdac09e93a4487a72f2b0618ae1983" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.079847 10307 raft_consensus.cc:2804] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.080686 10307 raft_consensus.cc:697] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:53.081163 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1fdac09e93a4487a72f2b0618ae1983" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.081918 10307 consensus_queue.cc:237] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
W20260709 13:14:53.083302 10080 leader_election.cc:343] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:53.084493 10080 leader_election.cc:343] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.047631 10113 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 1.
I20260709 13:14:53.087231 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.089192 10303 tablet_bootstrap.cc:492] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:53.089784 10303 ts_tablet_manager.cc:1403] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:14:53.090467 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.091583 10311 raft_consensus.cc:515] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.093401 10303 raft_consensus.cc:359] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.094295 10303 raft_consensus.cc:385] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.094619 10303 raft_consensus.cc:740] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.095408 10303 consensus_queue.cc:260] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.096194 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
W20260709 13:14:53.092099 10229 leader_election.cc:343] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.096732 10263 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.097082 10311 leader_election.cc:290] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.101958 10303 ts_tablet_manager.cc:1434] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:14:53.103077 10303 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:53.104288 10306 tablet_bootstrap.cc:492] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.104720 10306 ts_tablet_manager.cc:1403] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.005s
I20260709 13:14:53.107024 10263 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.107550 10306 raft_consensus.cc:359] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.108228 10306 raft_consensus.cc:385] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.108130 10153 leader_election.cc:304] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.108541 10306 raft_consensus.cc:740] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.109028 10311 raft_consensus.cc:2804] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.112566 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.113525 10114 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.115710 10303 tablet_bootstrap.cc:654] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:53.121973 10229 leader_election.cc:343] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.123193 10229 leader_election.cc:304] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
W20260709 13:14:53.124353 10229 leader_election.cc:343] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.125491 10307 raft_consensus.cc:2804] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.125547 10012 catalog_manager.cc:5697] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 1 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.109277 10306 consensus_queue.cc:260] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.128959 10307 raft_consensus.cc:697] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
W20260709 13:14:53.129477 10229 leader_election.cc:343] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.128479 10011 catalog_manager.cc:5697] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.133353 10311 raft_consensus.cc:697] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.137449 10307 consensus_queue.cc:237] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:53.137708 10311 consensus_queue.cc:237] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.134445 10229 leader_election.cc:304] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e5b019e61434aa9a537d13645535952; no voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.145141 10327 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.145637 10327 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.145957 10342 raft_consensus.cc:493] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.146490 10342 raft_consensus.cc:515] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.147372 10306 ts_tablet_manager.cc:1434] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 13:14:53.147611 10327 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:53.148857 10327 raft_consensus.cc:2749] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:53.147909 10114 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.151142 10306 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:53.150751 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.150733 10304 ts_tablet_manager.cc:1434] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.190s	user 0.080s	sys 0.076s
I20260709 13:14:53.153291 10113 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 0.
I20260709 13:14:53.153594 10338 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.153961 10304 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:53.154039 10338 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.155441 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.156208 10338 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.157507 10229 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.157595 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.157819 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.158228 10263 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.158324 10189 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 0.
W20260709 13:14:53.159439 10155 leader_election.cc:343] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.160627 10307 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.161767 10307 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.162092 10307 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.162324 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.159428 10153 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.163036 10113 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.163498 10338 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.163869 10338 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.164181 10338 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.177063 10303 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:53.177924 10306 tablet_bootstrap.cc:654] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.178081 10342 leader_election.cc:290] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.173446 10307 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.179126 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.179772 10263 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.180054 10304 tablet_bootstrap.cc:654] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.180297 10307 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:53.180413 10303 ts_tablet_manager.cc:1403] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.005s
I20260709 13:14:53.181859 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.185045 10113 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.183571 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.186985 10303 raft_consensus.cc:359] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.187609 10303 raft_consensus.cc:385] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.187860 10303 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.185961 10153 leader_election.cc:304] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.193771 10342 raft_consensus.cc:2804] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.194782 10342 raft_consensus.cc:493] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.195232 10342 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.197214 10303 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.212419 10303 ts_tablet_manager.cc:1434] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:14:53.214008 10303 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: Bootstrap starting.
I20260709 13:14:53.218765 10113 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 1.
I20260709 13:14:53.188799 10338 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.231578 10189 raft_consensus.cc:2393] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e5b019e61434aa9a537d13645535952 in current term 1: Already voted for candidate 1fbdbb04fe4949a9b6a4135171748287 in this term.
I20260709 13:14:53.230464 10009 catalog_manager.cc:5697] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.234310 10229 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.235134 10307 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.235570 10307 raft_consensus.cc:697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:53.236339 10307 consensus_queue.cc:237] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.238991 10012 catalog_manager.cc:5697] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.240154 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.208009 10342 raft_consensus.cc:515] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.240299 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.242926 10113 raft_consensus.cc:2393] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1fbdbb04fe4949a9b6a4135171748287 in current term 1: Already voted for candidate 7e5b019e61434aa9a537d13645535952 in this term.
I20260709 13:14:53.243247 10338 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.243952 10155 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287; no voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952
I20260709 13:14:53.221908 10303 tablet_bootstrap.cc:654] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.246161 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.247164 10263 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.247808 10311 raft_consensus.cc:2749] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:53.249405 10342 leader_election.cc:290] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.250501 10304 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:53.250964 10304 ts_tablet_manager.cc:1403] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.025s
I20260709 13:14:53.253746 10304 raft_consensus.cc:359] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.254396 10304 raft_consensus.cc:385] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.254690 10304 raft_consensus.cc:740] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.255431 10304 consensus_queue.cc:260] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.257580 10304 ts_tablet_manager.cc:1434] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:53.257850 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.258544 10304 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:53.259058 10263 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.260102 10153 leader_election.cc:304] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.260982 10342 raft_consensus.cc:2804] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:53.261287 10155 leader_election.cc:343] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.261535 10342 raft_consensus.cc:697] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.262661 10342 consensus_queue.cc:237] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.264330 10306 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.264523 10304 tablet_bootstrap.cc:654] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.264792 10306 ts_tablet_manager.cc:1403] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.018s
I20260709 13:14:53.267112 10306 raft_consensus.cc:359] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.267638 10306 raft_consensus.cc:385] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.267926 10306 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.268613 10306 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.274478 10338 raft_consensus.cc:493] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.275074 10338 raft_consensus.cc:515] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.277941 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.278493 10303 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: No bootstrap required, opened a new log
I20260709 13:14:53.278903 10303 ts_tablet_manager.cc:1403] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.000s
I20260709 13:14:53.278990 10338 leader_election.cc:290] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
W20260709 13:14:53.279165 10155 leader_election.cc:343] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.279783 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.280405 10263 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.282445 10306 ts_tablet_manager.cc:1434] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:53.282707 10153 leader_election.cc:304] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.283360 10306 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:53.282953 10012 catalog_manager.cc:5697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.283758 10338 raft_consensus.cc:2804] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.284488 10338 raft_consensus.cc:493] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.285097 10338 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.284850 10009 catalog_manager.cc:5697] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.290105 10306 tablet_bootstrap.cc:654] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.292518 10338 raft_consensus.cc:515] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.293437 10304 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:53.293893 10304 ts_tablet_manager.cc:1403] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.036s	user 0.002s	sys 0.020s
I20260709 13:14:53.295194 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.295498 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.296027 10263 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:53.296546 10155 leader_election.cc:343] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.296638 10304 raft_consensus.cc:359] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.297394 10304 raft_consensus.cc:385] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.297685 10304 raft_consensus.cc:740] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.297570 10303 raft_consensus.cc:359] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.298383 10303 raft_consensus.cc:385] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.298691 10303 raft_consensus.cc:740] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.298458 10304 consensus_queue.cc:260] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.299432 10303 consensus_queue.cc:260] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.300662 10304 ts_tablet_manager.cc:1434] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:53.303140 10304 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:53.303290 10263 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.304324 10153 leader_election.cc:304] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.305096 10342 raft_consensus.cc:2804] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.306026 10342 raft_consensus.cc:697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.308182 10342 consensus_queue.cc:237] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.309754 10303 ts_tablet_manager.cc:1434] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:14:53.310060 10304 tablet_bootstrap.cc:654] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.311725 10338 leader_election.cc:290] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.314702 10306 tablet_bootstrap.cc:492] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.315117 10306 ts_tablet_manager.cc:1403] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:14:53.317579 10306 raft_consensus.cc:359] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.318172 10306 raft_consensus.cc:385] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.318414 10306 raft_consensus.cc:740] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.319185 10306 consensus_queue.cc:260] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.321156 10306 ts_tablet_manager.cc:1434] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:53.322094 10306 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:53.326243 10304 tablet_bootstrap.cc:492] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:53.326632 10304 ts_tablet_manager.cc:1403] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:14:53.327580 10306 tablet_bootstrap.cc:654] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.328116 10012 catalog_manager.cc:5697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.329058 10304 raft_consensus.cc:359] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.329746 10304 raft_consensus.cc:385] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.330071 10304 raft_consensus.cc:740] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.330782 10304 consensus_queue.cc:260] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.331954 10306 tablet_bootstrap.cc:492] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.332332 10306 ts_tablet_manager.cc:1403] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:14:53.332624 10304 ts_tablet_manager.cc:1434] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:53.333456 10304 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
I20260709 13:14:53.334764 10306 raft_consensus.cc:359] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.335366 10306 raft_consensus.cc:385] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.335616 10306 raft_consensus.cc:740] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.336320 10306 consensus_queue.cc:260] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.338104 10306 ts_tablet_manager.cc:1434] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:53.338800 10306 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: Bootstrap starting.
I20260709 13:14:53.339053 10304 tablet_bootstrap.cc:654] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.341964 10342 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.342427 10342 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.343452 10304 tablet_bootstrap.cc:492] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:53.343827 10304 ts_tablet_manager.cc:1403] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:14:53.344153 10306 tablet_bootstrap.cc:654] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.344383 10342 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.345955 10304 raft_consensus.cc:359] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.346578 10304 raft_consensus.cc:385] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.346822 10304 raft_consensus.cc:740] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.347452 10304 consensus_queue.cc:260] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.348935 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.349275 10304 ts_tablet_manager.cc:1434] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:14:53.350080 10304 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: Bootstrap starting.
W20260709 13:14:53.350221 10155 leader_election.cc:343] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.350229 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.351217 10263 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.352326 10153 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.353413 10342 raft_consensus.cc:2804] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.353778 10342 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.354115 10342 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.356289 10304 tablet_bootstrap.cc:654] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:53.361904 10342 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.364284 10306 tablet_bootstrap.cc:492] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: No bootstrap required, opened a new log
I20260709 13:14:53.364338 10304 tablet_bootstrap.cc:492] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: No bootstrap required, opened a new log
I20260709 13:14:53.364841 10306 ts_tablet_manager.cc:1403] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 13:14:53.364915 10304 ts_tablet_manager.cc:1403] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.013s
I20260709 13:14:53.364823 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.366031 10342 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.366338 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
W20260709 13:14:53.366750 10155 leader_election.cc:343] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:53.366842 10263 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.367633 10304 raft_consensus.cc:359] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.367537 10306 raft_consensus.cc:359] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.368155 10304 raft_consensus.cc:385] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.368229 10306 raft_consensus.cc:385] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:53.368461 10304 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.368564 10306 raft_consensus.cc:740] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Initialized, Role: FOLLOWER
I20260709 13:14:53.369236 10304 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.369402 10306 consensus_queue.cc:260] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.371058 10304 ts_tablet_manager.cc:1434] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:53.371292 10306 ts_tablet_manager.cc:1434] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:53.372925 10263 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.373974 10153 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.374571 10342 raft_consensus.cc:2804] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.374996 10342 raft_consensus.cc:697] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.375761 10342 consensus_queue.cc:237] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.385241 10009 catalog_manager.cc:5697] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.398667 10328 raft_consensus.cc:493] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.399152 10328 raft_consensus.cc:515] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.401119 10328 leader_election.cc:290] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.401859 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.402336 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.402935 10263 raft_consensus.cc:2393] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6e098bf0524026a28e56596c54498f in current term 1: Already voted for candidate 1fbdbb04fe4949a9b6a4135171748287 in this term.
I20260709 13:14:53.403887 10078 leader_election.cc:304] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f; no voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952
I20260709 13:14:53.404681 10328 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.409828 10328 raft_consensus.cc:2749] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:53.414392 10342 raft_consensus.cc:493] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.414901 10342 raft_consensus.cc:515] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.416675 10342 leader_election.cc:290] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.417973 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.418218 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.418493 10113 raft_consensus.cc:2468] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.418991 10263 raft_consensus.cc:2468] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.419591 10155 leader_election.cc:304] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:53.420511 10342 raft_consensus.cc:2804] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.420907 10342 raft_consensus.cc:493] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.421209 10342 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.426086 10342 raft_consensus.cc:515] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.427629 10342 leader_election.cc:290] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.428360 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.428606 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.428857 10113 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.429116 10263 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.433228 10113 raft_consensus.cc:2468] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.433421 10263 raft_consensus.cc:2468] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.434264 10155 leader_election.cc:304] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:53.435052 10342 raft_consensus.cc:2804] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.435475 10342 raft_consensus.cc:697] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.436262 10342 consensus_queue.cc:237] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.443178 10009 catalog_manager.cc:5697] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.449633 10189 raft_consensus.cc:3060] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.455799 10328 consensus_queue.cc:1048] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.467964 10338 raft_consensus.cc:493] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.468469 10338 raft_consensus.cc:515] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.470454 10338 leader_election.cc:290] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.471560 10328 consensus_queue.cc:1048] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.472067 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.472492 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f" is_pre_election: true
I20260709 13:14:53.472640 10263 raft_consensus.cc:2468] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.473074 10113 raft_consensus.cc:2468] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 0.
I20260709 13:14:53.474184 10155 leader_election.cc:304] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.474984 10338 raft_consensus.cc:2804] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:53.475349 10338 raft_consensus.cc:493] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.475733 10338 raft_consensus.cc:3060] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.482613 10338 raft_consensus.cc:515] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.484541 10338 leader_election.cc:290] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.485028 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.485049 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203a87563b6b4c468ea8a7707468fc92" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.485687 10113 raft_consensus.cc:3060] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.485754 10263 raft_consensus.cc:3060] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.490471 10263 raft_consensus.cc:2468] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.491470 10153 leader_election.cc:304] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.492163 10113 raft_consensus.cc:2468] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 1.
I20260709 13:14:53.492194 10338 raft_consensus.cc:2804] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:53.492762 10338 raft_consensus.cc:697] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.493583 10338 consensus_queue.cc:237] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.501015 10009 catalog_manager.cc:5697] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.547439 10338 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.557277 10338 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.560336 10307 consensus_queue.cc:1048] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.573693 10327 consensus_queue.cc:1048] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.574892 10189 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.586979 10327 consensus_queue.cc:1048] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.587809 10263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:34794
I20260709 13:14:53.588359 10263 raft_consensus.cc:606] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.600467 10263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fbeb3975784839900434533aeaea29"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:34794
I20260709 13:14:53.601109 10263 raft_consensus.cc:606] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.603057 10376 consensus_queue.cc:1048] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:53.606596 10263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:34794
I20260709 13:14:53.607117 10263 raft_consensus.cc:606] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.612542 10307 raft_consensus.cc:993] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.612942 10327 raft_consensus.cc:1081] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.614598 10114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fbeb3975784839900434533aeaea29"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39684
I20260709 13:14:53.615113 10114 raft_consensus.cc:493] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.615478 10114 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.621119 10114 raft_consensus.cc:515] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.621975 10189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:14:53.622524 10189 raft_consensus.cc:606] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.623447 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.623960 10187 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.624145 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fbeb3975784839900434533aeaea29" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.624666 10263 raft_consensus.cc:3055] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.624974 10263 raft_consensus.cc:740] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:53.625744 10263 consensus_queue.cc:260] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.626755 10263 raft_consensus.cc:3060] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.628294 10114 leader_election.cc:290] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.630334 10187 raft_consensus.cc:2468] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.631345 10080 leader_election.cc:304] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:53.632113 10312 raft_consensus.cc:2804] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:53.632603 10312 raft_consensus.cc:697] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:53.633774 10263 raft_consensus.cc:2468] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.633491 10312 consensus_queue.cc:237] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.640033 10009 catalog_manager.cc:5697] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 7e5b019e61434aa9a537d13645535952 (127.9.68.67) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.642208 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
mode: GRACEFUL
new_leader_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:14:53.642894 10187 raft_consensus.cc:606] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Received request to transfer leadership to TS 7e5b019e61434aa9a537d13645535952
I20260709 13:14:53.665133 10327 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.675177 10376 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.676934 10312 raft_consensus.cc:493] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.677415 10312 raft_consensus.cc:515] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.679388 10312 leader_election.cc:290] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.680387 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.680620 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.681128 10263 raft_consensus.cc:2393] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6e098bf0524026a28e56596c54498f in current term 1: Already voted for candidate 1fbdbb04fe4949a9b6a4135171748287 in this term.
I20260709 13:14:53.682868 10080 leader_election.cc:304] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f; no voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952
I20260709 13:14:53.683596 10312 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.685166 10307 raft_consensus.cc:993] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.685590 10376 raft_consensus.cc:1081] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.686919 10114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39684
I20260709 13:14:53.687341 10114 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.687628 10114 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.690176 10312 raft_consensus.cc:2749] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:53.692315 10114 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.694243 10114 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.694782 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.695427 10263 raft_consensus.cc:3055] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.695727 10263 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:53.696689 10263 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.694737 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.698101 10187 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.698369 10263 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.703809 10263 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.703842 10187 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.704432 10312 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.704932 10312 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.705161 10080 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:53.706331 10328 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:53.706980 10312 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.708091 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e5b019e61434aa9a537d13645535952" is_pre_election: true
I20260709 13:14:53.708184 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fbdbb04fe4949a9b6a4135171748287" is_pre_election: true
I20260709 13:14:53.708541 10328 raft_consensus.cc:697] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:53.709007 10263 raft_consensus.cc:2393] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e6e098bf0524026a28e56596c54498f in current term 1: Already voted for candidate 1fbdbb04fe4949a9b6a4135171748287 in this term.
I20260709 13:14:53.709460 10328 consensus_queue.cc:237] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.710018 10078 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f; no voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952
I20260709 13:14:53.710798 10381 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:53.716813 10011 catalog_manager.cc:5697] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 7e5b019e61434aa9a537d13645535952 (127.9.68.67) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.717777 10381 raft_consensus.cc:2749] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:53.792459 10338 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.803385 10340 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:53.836043 10340 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.845633 10342 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.877398 10338 consensus_queue.cc:1048] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.884073 10342 raft_consensus.cc:993] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: : Instructing follower 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:53.884517 10340 raft_consensus.cc:1081] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Signalling peer 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:53.886127 10262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:34780
I20260709 13:14:53.886710 10262 raft_consensus.cc:493] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.887035 10262 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.888569 10340 consensus_queue.cc:1048] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.893851 10262 raft_consensus.cc:515] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.894650 10263 raft_consensus.cc:1240] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Rejecting Update request from peer 1fbdbb04fe4949a9b6a4135171748287 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:53.895687 10262 leader_election.cc:290] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 2 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:53.896997 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:53.899334 10338 consensus_queue.cc:1059] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.900032 10338 raft_consensus.cc:3055] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.900326 10338 raft_consensus.cc:740] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.900729 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7a31d7b4b4602be303a8e94c2b6a1" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.901203 10338 consensus_queue.cc:260] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
W20260709 13:14:53.902141 10342 consensus_queue.cc:1175] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e6e098bf0524026a28e56596c54498f" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:14:53.902272 10338 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.902848 10342 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.906730 10340 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:53.914510 10187 raft_consensus.cc:2468] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 2.
I20260709 13:14:53.918037 10229 leader_election.cc:304] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:53.922461 10376 raft_consensus.cc:2804] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:53.922942 10376 raft_consensus.cc:697] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:53.923588 10376 consensus_queue.cc:237] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.930575 10340 raft_consensus.cc:993] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.931038 10340 raft_consensus.cc:1081] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:53.933365 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39690
I20260709 13:14:53.933900 10113 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.934257 10113 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.934327 10009 catalog_manager.cc:5697] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 1 to 2, leader changed from 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66) to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.939815 10113 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.942433 10113 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:53.942598 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:53.942672 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:53.943312 10187 raft_consensus.cc:3055] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:53.943382 10263 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.943755 10187 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:53.944655 10187 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.947701 10187 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:53.950078 10263 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.951155 10078 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:53.951733 10381 raft_consensus.cc:2804] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:53.952209 10381 raft_consensus.cc:697] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:53.952992 10381 consensus_queue.cc:237] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:53.953934 10187 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:53.959889 10011 catalog_manager.cc:5697] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.006398 10338 consensus_queue.cc:1048] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:54.016800 10311 consensus_queue.cc:1048] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:54.062188 10187 raft_consensus.cc:1275] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.063514 10381 consensus_queue.cc:1048] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.070557 10263 raft_consensus.cc:1275] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.072108 10312 consensus_queue.cc:1048] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.084906 10307 raft_consensus.cc:993] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:54.085289 10327 raft_consensus.cc:1081] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:54.086849 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39684
I20260709 13:14:54.087352 10113 raft_consensus.cc:493] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:54.087607 10113 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.092427 10113 raft_consensus.cc:515] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:54.094684 10113 leader_election.cc:290] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:54.095235 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:54.095664 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0070e5a8558e465a8d1500532ca9d508" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:54.095785 10263 raft_consensus.cc:3055] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:54.096081 10263 raft_consensus.cc:740] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:54.096122 10187 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.096793 10263 consensus_queue.cc:260] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:54.097667 10263 raft_consensus.cc:3060] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.100608 10187 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:54.101658 10080 leader_election.cc:304] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:54.101933 10263 raft_consensus.cc:2468] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:54.102447 10312 raft_consensus.cc:2804] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:54.102938 10312 raft_consensus.cc:697] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:54.103639 10312 consensus_queue.cc:237] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } }
I20260709 13:14:54.108932 10011 catalog_manager.cc:5697] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 7e5b019e61434aa9a537d13645535952 (127.9.68.67) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.135277 10187 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.136457 10312 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.144402 10263 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.145679 10381 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.316439 10113 raft_consensus.cc:3060] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:54.322948 10113 raft_consensus.cc:1275] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.324163 10327 consensus_queue.cc:1048] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.331931 10187 raft_consensus.cc:1275] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.333578 10376 consensus_queue.cc:1048] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:54.475162 10263 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.476253 10381 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.483574 10187 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.485373 10392 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.626186 10261 raft_consensus.cc:1275] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.627699 10392 consensus_queue.cc:1048] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.637216 10187 raft_consensus.cc:1275] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:54.638824 10328 consensus_queue.cc:1048] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:56.676548  9489 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:14:56.677184  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:56.693974 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:14:56.694572 10113 raft_consensus.cc:606] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Received request to transfer leadership to TS 7e5b019e61434aa9a537d13645535952
I20260709 13:14:56.696722 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:14:56.697101 10113 raft_consensus.cc:606] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Received request to transfer leadership to TS 7e5b019e61434aa9a537d13645535952
I20260709 13:14:56.698333  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:56.698936  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:56.722568 10392 raft_consensus.cc:993] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:56.722966 10397 raft_consensus.cc:1081] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Signalling peer 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:56.724391 10261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:14:56.725056 10261 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:56.725472 10261 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.730697 10261 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:56.732546 10261 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:56.733489 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:56.733749 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:56.734155 10114 raft_consensus.cc:3055] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.734376 10187 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.734598 10114 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:56.735561 10114 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:56.736495 10114 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.739780 10187 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:14:56.741027 10229 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:56.741180 10114 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:14:56.741917 10376 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:56.742908 10376 raft_consensus.cc:697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:56.743562 10376 consensus_queue.cc:237] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:56.750856 10012 catalog_manager.cc:5697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 2 to 3, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.012842 10392 raft_consensus.cc:993] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:57.013340 10397 raft_consensus.cc:1081] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Signalling peer 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:14:57.014607 10261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:14:57.015048 10261 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.015295 10261 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.019641 10261 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.021035 10261 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:14:57.021858 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:14:57.022257 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:57.022449 10114 raft_consensus.cc:3055] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.022780 10187 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.022789 10114 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:57.023677 10114 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.024627 10114 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.027958 10187 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:14:57.029186 10229 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:57.030139 10376 raft_consensus.cc:2804] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:57.030182 10114 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:14:57.030858 10376 raft_consensus.cc:697] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:57.031708 10376 consensus_queue.cc:237] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.039191 10012 catalog_manager.cc:5697] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 2 to 3, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.306466 10187 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:57.307884 10376 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.321472 10114 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:57.322870 10409 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.524267 10113 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:57.525564 10409 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.535791 10187 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:57.537225 10376 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.699756  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:57.717945 10261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:34794
I20260709 13:14:57.718488 10261 raft_consensus.cc:606] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:57.722971 10261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:34794
I20260709 13:14:57.723520 10261 raft_consensus.cc:606] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:57.728719 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:14:57.729275 10187 raft_consensus.cc:606] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:57.734351 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:14:57.734820 10187 raft_consensus.cc:606] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:57.739642 10187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455b0029d139403688436f6403979e4b"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
mode: GRACEFUL
new_leader_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:40850
I20260709 13:14:57.740085 10187 raft_consensus.cc:606] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Received request to transfer leadership to TS 6e6e098bf0524026a28e56596c54498f
I20260709 13:14:57.816376 10404 raft_consensus.cc:993] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.816910 10415 raft_consensus.cc:1081] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.818589 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39690
I20260709 13:14:57.819046 10113 raft_consensus.cc:493] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.819322 10113 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.824595 10113 raft_consensus.cc:515] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.826098 10113 leader_election.cc:290] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:57.827040 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:57.827083 10261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:57.827700 10187 raft_consensus.cc:3055] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.827796 10261 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.828140 10187 raft_consensus.cc:740] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:57.829111 10187 consensus_queue.cc:260] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.830376 10187 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.833237 10261 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:57.834276 10078 leader_election.cc:304] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:57.834901 10397 raft_consensus.cc:2804] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.835703 10187 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:57.835843 10397 raft_consensus.cc:697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:57.836719 10397 consensus_queue.cc:237] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.843089 10011 catalog_manager.cc:5697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.853552 10376 raft_consensus.cc:993] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.854064 10376 raft_consensus.cc:1081] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.855587 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39684
I20260709 13:14:57.856132 10113 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.856467 10113 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.860855 10113 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.862308 10113 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 4 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:57.863134 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:57.863550 10187 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.863560 10261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:57.864279 10261 raft_consensus.cc:3055] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.864586 10261 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:57.865279 10261 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.866250 10261 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.867453 10187 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 4.
I20260709 13:14:57.868400 10080 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:57.869211 10397 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.869741 10397 raft_consensus.cc:697] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:57.870451 10397 consensus_queue.cc:237] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.871934 10261 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 4.
I20260709 13:14:57.876240 10012 catalog_manager.cc:5697] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 3 to 4, leader changed from 7e5b019e61434aa9a537d13645535952 (127.9.68.67) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 4 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.956317 10413 raft_consensus.cc:993] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.956743 10376 raft_consensus.cc:1081] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:57.958194 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39684
I20260709 13:14:57.958643 10113 raft_consensus.cc:493] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.958875 10113 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.963570 10113 raft_consensus.cc:515] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.965482 10113 leader_election.cc:290] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 4 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:57.966367 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:57.966804 10187 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.966904 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d4bbf02be4416980e887a39abc3977" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:57.967376 10263 raft_consensus.cc:3055] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.967685 10263 raft_consensus.cc:740] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:14:57.968405 10263 consensus_queue.cc:260] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.969571 10263 raft_consensus.cc:3060] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.972514 10187 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 4.
I20260709 13:14:57.973553 10080 leader_election.cc:304] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 6e6e098bf0524026a28e56596c54498f; no voters: 
I20260709 13:14:57.974179 10397 raft_consensus.cc:2804] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.974561 10397 raft_consensus.cc:697] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:57.974874 10263 raft_consensus.cc:2468] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 4.
I20260709 13:14:57.975244 10397 consensus_queue.cc:237] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:57.980928 10012 catalog_manager.cc:5697] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 3 to 4, leader changed from 7e5b019e61434aa9a537d13645535952 (127.9.68.67) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 4 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.011521 10404 raft_consensus.cc:993] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:58.012059 10415 raft_consensus.cc:1081] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:58.013743 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39690
I20260709 13:14:58.014189 10113 raft_consensus.cc:493] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.014415 10113 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.018201 10113 raft_consensus.cc:515] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.019771 10113 leader_election.cc:290] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:58.021221 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:58.021890 10187 raft_consensus.cc:3055] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.021940 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:58.022269 10187 raft_consensus.cc:740] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:58.022576 10263 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.023000 10187 consensus_queue.cc:260] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.023825 10187 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.026542 10263 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:58.027514 10078 leader_election.cc:304] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:58.027727 10187 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:58.028302 10397 raft_consensus.cc:2804] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.028724 10397 raft_consensus.cc:697] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:58.029440 10397 consensus_queue.cc:237] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.035912 10012 catalog_manager.cc:5697] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.059900 10404 raft_consensus.cc:993] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: : Instructing follower 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:58.060309 10415 raft_consensus.cc:1081] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Signalling peer 6e6e098bf0524026a28e56596c54498f to start an election
I20260709 13:14:58.061749 10113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455b0029d139403688436f6403979e4b"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
 from {username='slave'} at 127.0.0.1:39690
I20260709 13:14:58.062153 10113 raft_consensus.cc:493] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.062503 10113 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.066401 10113 raft_consensus.cc:515] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.067644 10113 leader_election.cc:290] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Requested vote from peers 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:14:58.068585 10187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:14:58.068861 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "6e6e098bf0524026a28e56596c54498f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:14:58.069051 10187 raft_consensus.cc:3055] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.069438 10187 raft_consensus.cc:740] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:14:58.069483 10263 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.070088 10187 consensus_queue.cc:260] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.070878 10187 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.074147 10263 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:58.074750 10187 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e6e098bf0524026a28e56596c54498f in term 2.
I20260709 13:14:58.075139 10078 leader_election.cc:304] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:14:58.075894 10397 raft_consensus.cc:2804] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.076241 10397 raft_consensus.cc:697] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Leader. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:14:58.076890 10397 consensus_queue.cc:237] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:14:58.083441 10012 catalog_manager.cc:5697] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f reported cstate change: term changed from 1 to 2, leader changed from 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66) to 6e6e098bf0524026a28e56596c54498f (127.9.68.65). New cstate: current_term: 2 leader_uuid: "6e6e098bf0524026a28e56596c54498f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.235224 10263 raft_consensus.cc:1275] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.236321 10397 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.245478 10187 raft_consensus.cc:1275] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.246871 10397 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.354777 10187 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:58.355881 10397 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:58.363780 10263 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:58.364986 10429 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:58.424182 10187 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:58.425627 10429 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:58.433203 10263 raft_consensus.cc:1275] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:58.436093 10429 consensus_queue.cc:1048] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:58.442377 10263 raft_consensus.cc:1275] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.443439 10397 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.452307 10187 raft_consensus.cc:1275] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.453858 10397 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.507701 10263 raft_consensus.cc:1275] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.509197 10397 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.517464 10187 raft_consensus.cc:1275] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Refusing update from remote peer 6e6e098bf0524026a28e56596c54498f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.518828 10397 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.747602  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:00.756776 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455b0029d139403688436f6403979e4b"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "1fbdbb04fe4949a9b6a4135171748287"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:15:00.757457 10113 raft_consensus.cc:606] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Received request to transfer leadership to TS 1fbdbb04fe4949a9b6a4135171748287
I20260709 13:15:00.760126 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:15:00.760543 10113 raft_consensus.cc:606] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Received request to transfer leadership to TS 7e5b019e61434aa9a537d13645535952
I20260709 13:15:00.762816 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:15:00.763386 10113 raft_consensus.cc:606] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Received request to transfer leadership to TS 7e5b019e61434aa9a537d13645535952
I20260709 13:15:00.765944 10113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f"
dest_uuid: "6e6e098bf0524026a28e56596c54498f"
mode: GRACEFUL
new_leader_uuid: "1fbdbb04fe4949a9b6a4135171748287"
 from {username='slave'} at 127.0.0.1:39706
I20260709 13:15:00.766538 10113 raft_consensus.cc:606] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Received request to transfer leadership to TS 1fbdbb04fe4949a9b6a4135171748287
I20260709 13:15:00.767692  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:00.768179  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:00.838629 10437 raft_consensus.cc:993] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 1fbdbb04fe4949a9b6a4135171748287 to start an election
I20260709 13:15:00.839207 10438 raft_consensus.cc:1081] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Signalling peer 1fbdbb04fe4949a9b6a4135171748287 to start an election
I20260709 13:15:00.840816 10189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
 from {username='slave'} at 127.0.0.1:40838
I20260709 13:15:00.841297 10189 raft_consensus.cc:493] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.841697 10189 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.845942 10437 raft_consensus.cc:993] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:15:00.846374 10438 raft_consensus.cc:1081] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Signalling peer 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:15:00.848268 10261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:15:00.848876 10261 raft_consensus.cc:493] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.849175 10261 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.849071 10189 raft_consensus.cc:515] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.852558 10263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:15:00.851862 10189 leader_election.cc:290] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 3 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:15:00.853101 10263 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.852303 10113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc07fd9b44f456cb60c638015761f2f" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:15:00.853744 10113 raft_consensus.cc:3055] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.854041 10113 raft_consensus.cc:740] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:15:00.854894 10113 consensus_queue.cc:260] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.856173 10113 raft_consensus.cc:3060] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.857062 10261 raft_consensus.cc:515] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.859192 10263 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 3.
I20260709 13:15:00.859622 10261 leader_election.cc:290] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 5 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:15:00.860764 10153 leader_election.cc:304] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:15:00.860867 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:15:00.861352 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f2d79582634a89a500cd9e58e134c9" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:15:00.861526 10114 raft_consensus.cc:3055] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.861814 10415 raft_consensus.cc:2804] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.861892 10114 raft_consensus.cc:740] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:15:00.863083 10415 raft_consensus.cc:697] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 3 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:15:00.862818 10114 consensus_queue.cc:260] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.863430 10113 raft_consensus.cc:2468] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 3.
I20260709 13:15:00.861865 10189 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.864197 10114 raft_consensus.cc:3060] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.864153 10415 consensus_queue.cc:237] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.870204 10189 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 5.
I20260709 13:15:00.870548 10114 raft_consensus.cc:2468] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 5.
I20260709 13:15:00.871753 10229 leader_election.cc:304] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e6e098bf0524026a28e56596c54498f, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:15:00.872655 10376 raft_consensus.cc:2804] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:00.872946 10011 catalog_manager.cc:5697] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 2 to 3, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.874424 10376 raft_consensus.cc:697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 5 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:15:00.874581 10437 raft_consensus.cc:993] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 1fbdbb04fe4949a9b6a4135171748287 to start an election
I20260709 13:15:00.875195 10438 raft_consensus.cc:1081] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Signalling peer 1fbdbb04fe4949a9b6a4135171748287 to start an election
I20260709 13:15:00.875497 10376 consensus_queue.cc:237] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.876965 10189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455b0029d139403688436f6403979e4b"
dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
 from {username='slave'} at 127.0.0.1:40838
I20260709 13:15:00.877575 10189 raft_consensus.cc:493] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.878074 10189 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.884476 10012 catalog_manager.cc:5697] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 4 to 5, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 5 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.884922 10189 raft_consensus.cc:515] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.888094 10189 leader_election.cc:290] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 3 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 7e5b019e61434aa9a537d13645535952 (127.9.68.67:41237)
I20260709 13:15:00.889878 10262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e5b019e61434aa9a537d13645535952"
I20260709 13:15:00.890054 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455b0029d139403688436f6403979e4b" candidate_uuid: "1fbdbb04fe4949a9b6a4135171748287" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:15:00.890491 10262 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.890700 10114 raft_consensus.cc:3055] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.891063 10114 raft_consensus.cc:740] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:15:00.891861 10114 consensus_queue.cc:260] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.892838 10114 raft_consensus.cc:3060] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.897639 10262 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 3.
I20260709 13:15:00.898773 10153 leader_election.cc:304] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:15:00.899879 10415 raft_consensus.cc:2804] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.900409 10415 raft_consensus.cc:697] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 3 LEADER]: Becoming Leader. State: Replica: 1fbdbb04fe4949a9b6a4135171748287, State: Running, Role: LEADER
I20260709 13:15:00.901463 10415 consensus_queue.cc:237] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.903543 10114 raft_consensus.cc:2468] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fbdbb04fe4949a9b6a4135171748287 in term 3.
I20260709 13:15:00.909504 10012 catalog_manager.cc:5697] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 reported cstate change: term changed from 2 to 3, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "1fbdbb04fe4949a9b6a4135171748287" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.958885 10437 raft_consensus.cc:993] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: : Instructing follower 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:15:00.959326 10438 raft_consensus.cc:1081] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Signalling peer 7e5b019e61434aa9a537d13645535952 to start an election
I20260709 13:15:00.960634 10262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19"
dest_uuid: "7e5b019e61434aa9a537d13645535952"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:15:00.961082 10262 raft_consensus.cc:493] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.961459 10262 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.965757 10262 raft_consensus.cc:515] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.967511 10262 leader_election.cc:290] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Requested vote from peers 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215), 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583)
I20260709 13:15:00.968611 10114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e6e098bf0524026a28e56596c54498f"
I20260709 13:15:00.968708 10189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e88f6b0f1a44eb8078fcab6e6c8f19" candidate_uuid: "7e5b019e61434aa9a537d13645535952" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1fbdbb04fe4949a9b6a4135171748287"
I20260709 13:15:00.969172 10114 raft_consensus.cc:3055] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.969434 10189 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.969707 10114 raft_consensus.cc:740] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e6e098bf0524026a28e56596c54498f, State: Running, Role: LEADER
I20260709 13:15:00.970646 10114 consensus_queue.cc:260] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.971575 10114 raft_consensus.cc:3060] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.975112 10189 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:15:00.976418 10114 raft_consensus.cc:2468] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e5b019e61434aa9a537d13645535952 in term 3.
I20260709 13:15:00.976382 10229 leader_election.cc:304] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fbdbb04fe4949a9b6a4135171748287, 7e5b019e61434aa9a537d13645535952; no voters: 
I20260709 13:15:00.977408 10376 raft_consensus.cc:2804] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:00.977954 10376 raft_consensus.cc:697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Becoming Leader. State: Replica: 7e5b019e61434aa9a537d13645535952, State: Running, Role: LEADER
I20260709 13:15:00.978758 10376 consensus_queue.cc:237] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } }
I20260709 13:15:00.985728 10012 catalog_manager.cc:5697] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 reported cstate change: term changed from 2 to 3, leader changed from 6e6e098bf0524026a28e56596c54498f (127.9.68.65) to 7e5b019e61434aa9a537d13645535952 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "7e5b019e61434aa9a537d13645535952" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:01.286620 10114 raft_consensus.cc:1275] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Refusing update from remote peer 1fbdbb04fe4949a9b6a4135171748287: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.287777 10415 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.300231 10262 raft_consensus.cc:1275] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Refusing update from remote peer 1fbdbb04fe4949a9b6a4135171748287: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.302484 10451 consensus_queue.cc:1048] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:01.317518 10114 raft_consensus.cc:1275] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Refusing update from remote peer 1fbdbb04fe4949a9b6a4135171748287: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.318570 10415 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.327760 10262 raft_consensus.cc:1275] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Refusing update from remote peer 1fbdbb04fe4949a9b6a4135171748287: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.329357 10439 consensus_queue.cc:1048] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e5b019e61434aa9a537d13645535952" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.465931 10189 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 5 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:01.467264 10376 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:01.477442 10114 raft_consensus.cc:1275] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 5 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:01.479076 10458 consensus_queue.cc:1048] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:01.512418 10114 raft_consensus.cc:1275] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.513964 10441 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e6e098bf0524026a28e56596c54498f" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 43215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:01.522708 10189 raft_consensus.cc:1275] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Refusing update from remote peer 7e5b019e61434aa9a537d13645535952: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:01.524621 10376 consensus_queue.cc:1048] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fbdbb04fe4949a9b6a4135171748287" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:01.769033  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:01.776117  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:15:01.805053  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:01.805877  9489 tablet_replica.cc:333] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.806471  9489 raft_consensus.cc:2243] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.806908  9489 raft_consensus.cc:2272] T 455b0029d139403688436f6403979e4b P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.809850  9489 tablet_replica.cc:333] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.810508  9489 raft_consensus.cc:2243] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.811069  9489 raft_consensus.cc:2272] T 203a87563b6b4c468ea8a7707468fc92 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.812883  9489 tablet_replica.cc:333] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.813413  9489 raft_consensus.cc:2243] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.813798  9489 raft_consensus.cc:2272] T edc07fd9b44f456cb60c638015761f2f P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.816075  9489 tablet_replica.cc:333] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.816622  9489 raft_consensus.cc:2243] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.816982  9489 raft_consensus.cc:2272] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.818694  9489 tablet_replica.cc:333] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.819149  9489 raft_consensus.cc:2243] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.819882  9489 raft_consensus.cc:2272] T 71fbeb3975784839900434533aeaea29 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.822050  9489 tablet_replica.cc:333] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.822525  9489 raft_consensus.cc:2243] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.823220  9489 raft_consensus.cc:2272] T 0070e5a8558e465a8d1500532ca9d508 P 6e6e098bf0524026a28e56596c54498f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.824818  9489 tablet_replica.cc:333] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.825223  9489 raft_consensus.cc:2243] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.825654  9489 raft_consensus.cc:2272] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 6e6e098bf0524026a28e56596c54498f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.827447  9489 tablet_replica.cc:333] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.827919  9489 raft_consensus.cc:2243] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.828241  9489 raft_consensus.cc:2272] T 52f2d79582634a89a500cd9e58e134c9 P 6e6e098bf0524026a28e56596c54498f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.830366  9489 tablet_replica.cc:333] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.830889  9489 raft_consensus.cc:2243] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.831645  9489 raft_consensus.cc:2272] T 78d4bbf02be4416980e887a39abc3977 P 6e6e098bf0524026a28e56596c54498f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.833261  9489 tablet_replica.cc:333] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f: stopping tablet replica
I20260709 13:15:01.833762  9489 raft_consensus.cc:2243] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.834494  9489 raft_consensus.cc:2272] T d1fdac09e93a4487a72f2b0618ae1983 P 6e6e098bf0524026a28e56596c54498f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:01.847018 10229 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:15:01.853124 10229 consensus_peers.cc:597] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 -> Peer 6e6e098bf0524026a28e56596c54498f (127.9.68.65:43215): Couldn't send request to peer 6e6e098bf0524026a28e56596c54498f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:43215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.856909  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
I20260709 13:15:01.875829  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
I20260709 13:15:01.904229  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:01.905121  9489 tablet_replica.cc:333] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.905917  9489 raft_consensus.cc:2243] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.906548  9489 raft_consensus.cc:2272] T 78d4bbf02be4416980e887a39abc3977 P 1fbdbb04fe4949a9b6a4135171748287 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.908620  9489 tablet_replica.cc:333] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.909525  9489 raft_consensus.cc:2243] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.910053  9489 raft_consensus.cc:2272] T d1fdac09e93a4487a72f2b0618ae1983 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.912707  9489 tablet_replica.cc:333] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
W20260709 13:15:01.913365 10229 consensus_peers.cc:597] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 -> Peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Couldn't send request to peer 1fbdbb04fe4949a9b6a4135171748287. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.913496  9489 raft_consensus.cc:2243] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.914526  9489 raft_consensus.cc:2272] T 203a87563b6b4c468ea8a7707468fc92 P 1fbdbb04fe4949a9b6a4135171748287 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.916395  9489 tablet_replica.cc:333] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.916993  9489 raft_consensus.cc:2243] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.917771  9489 raft_consensus.cc:2272] T 455b0029d139403688436f6403979e4b P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.920101  9489 tablet_replica.cc:333] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.920792  9489 raft_consensus.cc:2243] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:01.921501  9489 raft_consensus.cc:2272] T edc07fd9b44f456cb60c638015761f2f P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.923332  9489 tablet_replica.cc:333] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.923758  9489 raft_consensus.cc:2243] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.924315  9489 raft_consensus.cc:2272] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.926626  9489 tablet_replica.cc:333] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.927487  9489 raft_consensus.cc:2243] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.928099  9489 raft_consensus.cc:2272] T 71fbeb3975784839900434533aeaea29 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.930768  9489 tablet_replica.cc:333] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.931509  9489 raft_consensus.cc:2243] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.932049  9489 raft_consensus.cc:2272] T 0070e5a8558e465a8d1500532ca9d508 P 1fbdbb04fe4949a9b6a4135171748287 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.934058  9489 tablet_replica.cc:333] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.934615  9489 raft_consensus.cc:2243] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.935078  9489 raft_consensus.cc:2272] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 1fbdbb04fe4949a9b6a4135171748287 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:01.937492  9489 tablet_replica.cc:333] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287: stopping tablet replica
I20260709 13:15:01.937975  9489 raft_consensus.cc:2243] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:01.938441  9489 raft_consensus.cc:2272] T 52f2d79582634a89a500cd9e58e134c9 P 1fbdbb04fe4949a9b6a4135171748287 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:01.962210 10229 consensus_peers.cc:597] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 -> Peer 1fbdbb04fe4949a9b6a4135171748287 (127.9.68.66:36583): Couldn't send request to peer 1fbdbb04fe4949a9b6a4135171748287. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:36583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.966600  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
I20260709 13:15:01.984001  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:15:02.010890  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:02.011474  9489 tablet_replica.cc:333] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.012398  9489 raft_consensus.cc:2243] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.013154  9489 raft_consensus.cc:2272] T edc07fd9b44f456cb60c638015761f2f P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.015471  9489 tablet_replica.cc:333] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.015942  9489 raft_consensus.cc:2243] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.016331  9489 raft_consensus.cc:2272] T 455b0029d139403688436f6403979e4b P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.018177  9489 tablet_replica.cc:333] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.018603  9489 raft_consensus.cc:2243] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.018944  9489 raft_consensus.cc:2272] T 203a87563b6b4c468ea8a7707468fc92 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.020347  9489 tablet_replica.cc:333] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.021040  9489 raft_consensus.cc:2243] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.021880  9489 raft_consensus.cc:2272] T 89f7a31d7b4b4602be303a8e94c2b6a1 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.023416  9489 tablet_replica.cc:333] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.023838  9489 raft_consensus.cc:2243] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.024194  9489 raft_consensus.cc:2272] T 71fbeb3975784839900434533aeaea29 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.025658  9489 tablet_replica.cc:333] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.026055  9489 raft_consensus.cc:2243] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.026391  9489 raft_consensus.cc:2272] T 0070e5a8558e465a8d1500532ca9d508 P 7e5b019e61434aa9a537d13645535952 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.027870  9489 tablet_replica.cc:333] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.028258  9489 raft_consensus.cc:2243] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.028880  9489 raft_consensus.cc:2272] T 52f2d79582634a89a500cd9e58e134c9 P 7e5b019e61434aa9a537d13645535952 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.030555  9489 tablet_replica.cc:333] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.030946  9489 raft_consensus.cc:2243] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.031515  9489 raft_consensus.cc:2272] T 61e88f6b0f1a44eb8078fcab6e6c8f19 P 7e5b019e61434aa9a537d13645535952 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.033303  9489 tablet_replica.cc:333] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.033771  9489 raft_consensus.cc:2243] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.034111  9489 raft_consensus.cc:2272] T 78d4bbf02be4416980e887a39abc3977 P 7e5b019e61434aa9a537d13645535952 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.035465  9489 tablet_replica.cc:333] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952: stopping tablet replica
I20260709 13:15:02.035830  9489 raft_consensus.cc:2243] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.036136  9489 raft_consensus.cc:2272] T d1fdac09e93a4487a72f2b0618ae1983 P 7e5b019e61434aa9a537d13645535952 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.062774  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:15:02.082496  9489 master.cc:562] Master@127.9.68.126:37711 shutting down...
I20260709 13:15:02.109292  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.109848  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.110158  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P efde2403010d470cbbee35dab66d2613: stopping tablet replica
I20260709 13:15:02.129979  9489 master.cc:584] Master@127.9.68.126:37711 shutdown complete.
1fbdbb04fe4949a9b6a4135171748287  4
6e6e098bf0524026a28e56596c54498f  5
7e5b019e61434aa9a537d13645535952  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10315 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:02.171526  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:35023
I20260709 13:15:02.172595  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.178347 10468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.178251 10467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.178884 10470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.180096  9489 server_base.cc:1061] running on GCE node
I20260709 13:15:02.180737  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.180918  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.181027  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602902181017 us; error 0 us; skew 500 ppm
I20260709 13:15:02.181568  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.184286  9489 webserver.cc:533] Webserver started at http://127.9.68.126:42367/ using document root <none> and password file <none>
I20260709 13:15:02.184808  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.184991  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.185242  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.186643  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "956662ca83ea4bd99d8b7557260d32d7"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.191431  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:15:02.195043 10475 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.195988  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:02.196360  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "956662ca83ea4bd99d8b7557260d32d7"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.196672  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.215161  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.216365  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.258553  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:35023
I20260709 13:15:02.258705 10526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:35023 every 8 connection(s)
I20260709 13:15:02.262388 10527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.271237 10527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Bootstrap starting.
I20260709 13:15:02.275467 10527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.279266 10527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: No bootstrap required, opened a new log
I20260709 13:15:02.281236 10527 raft_consensus.cc:359] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER }
I20260709 13:15:02.281602 10527 raft_consensus.cc:385] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:02.281803 10527 raft_consensus.cc:740] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 956662ca83ea4bd99d8b7557260d32d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:02.282366 10527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER }
I20260709 13:15:02.282780 10527 raft_consensus.cc:399] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:02.282996 10527 raft_consensus.cc:493] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:02.283267 10527 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:02.286963 10527 raft_consensus.cc:515] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER }
I20260709 13:15:02.287441 10527 leader_election.cc:304] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 956662ca83ea4bd99d8b7557260d32d7; no voters: 
I20260709 13:15:02.288488 10527 leader_election.cc:290] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:02.288861 10530 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:02.290199 10530 raft_consensus.cc:697] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 1 LEADER]: Becoming Leader. State: Replica: 956662ca83ea4bd99d8b7557260d32d7, State: Running, Role: LEADER
I20260709 13:15:02.290812 10530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER }
I20260709 13:15:02.291293 10527 sys_catalog.cc:565] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:02.295212 10531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "956662ca83ea4bd99d8b7557260d32d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER } }
I20260709 13:15:02.295884 10531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.295573 10532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 956662ca83ea4bd99d8b7557260d32d7. Latest consensus state: current_term: 1 leader_uuid: "956662ca83ea4bd99d8b7557260d32d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "956662ca83ea4bd99d8b7557260d32d7" member_type: VOTER } }
I20260709 13:15:02.296476 10532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.299376 10537 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:02.309458 10537 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:02.311517  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:02.317852 10537 catalog_manager.cc:1383] Generated new cluster ID: 82dfd316fb114a1bbe188b2367e4e9e5
I20260709 13:15:02.318107 10537 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:02.341435 10537 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:02.342613 10537 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:02.361056 10537 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Generated new TSK 0
I20260709 13:15:02.361620 10537 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:02.377790  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.383641 10548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.385224 10549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.386214  9489 server_base.cc:1061] running on GCE node
W20260709 13:15:02.386710 10551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.388235  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.388437  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.388561  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602902388549 us; error 0 us; skew 500 ppm
I20260709 13:15:02.389024  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.391235  9489 webserver.cc:533] Webserver started at http://127.9.68.65:45661/ using document root <none> and password file <none>
I20260709 13:15:02.391650  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.391803  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.391999  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.393015  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.397312  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:15:02.401463 10556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.402331  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:02.402797  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.403050  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.431493  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.432662  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.434170  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.436267  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.436478  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.436738  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.436933  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.477670  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:41805
I20260709 13:15:02.477772 10618 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:41805 every 8 connection(s)
I20260709 13:15:02.482458  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.488965 10623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.490892 10624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.492043 10626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.495185  9489 server_base.cc:1061] running on GCE node
I20260709 13:15:02.496313  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.496539  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.496737  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602902496719 us; error 0 us; skew 500 ppm
I20260709 13:15:02.497016 10619 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35023
I20260709 13:15:02.497354  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.497385 10619 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:02.498397 10619 heartbeater.cc:507] Master 127.9.68.126:35023 requested a full tablet report, sending...
I20260709 13:15:02.500138  9489 webserver.cc:533] Webserver started at http://127.9.68.66:38443/ using document root <none> and password file <none>
I20260709 13:15:02.500643  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.500653 10492 ts_manager.cc:194] Registered new tserver with Master: 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:02.500967  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.501297  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.502372 10492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54938
I20260709 13:15:02.502432  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "18f1a9f5e66846dba474825fb5b2b784"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.507124  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:15:02.510598 10631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.511518  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:02.511822  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "18f1a9f5e66846dba474825fb5b2b784"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.512097  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.531885  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.532999  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.534965  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.538614  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.538900  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.539191  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.539403  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.580615  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:33499
I20260709 13:15:02.580742 10693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:33499 every 8 connection(s)
I20260709 13:15:02.585103  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.591604 10697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.594070 10698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.595943 10700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.597862 10694 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35023
I20260709 13:15:02.598232 10694 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:02.599555  9489 server_base.cc:1061] running on GCE node
I20260709 13:15:02.599473 10694 heartbeater.cc:507] Master 127.9.68.126:35023 requested a full tablet report, sending...
I20260709 13:15:02.600631  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.600907  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.601119  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602902601100 us; error 0 us; skew 500 ppm
I20260709 13:15:02.601722  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.602609 10492 ts_manager.cc:194] Registered new tserver with Master: 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:02.604228 10492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54942
I20260709 13:15:02.604354  9489 webserver.cc:533] Webserver started at http://127.9.68.67:34643/ using document root <none> and password file <none>
I20260709 13:15:02.604956  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.605188  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.605517  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.606637  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "fac2164a6f874d7dbd29db83a7cf019b"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.610682  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:15:02.614823 10705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.615767  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:02.616196  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "fac2164a6f874d7dbd29db83a7cf019b"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-9s6w"
I20260709 13:15:02.616499  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.635563  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.636950  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.638697  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.641376  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.641623  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.641875  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.642055  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.687502  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:32771
I20260709 13:15:02.687646 10767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:32771 every 8 connection(s)
I20260709 13:15:02.701861 10768 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35023
I20260709 13:15:02.702243 10768 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:02.702867 10768 heartbeater.cc:507] Master 127.9.68.126:35023 requested a full tablet report, sending...
I20260709 13:15:02.705140 10492 ts_manager.cc:194] Registered new tserver with Master: fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:02.705626  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014670493s
I20260709 13:15:02.706895 10492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54944
I20260709 13:15:02.733633 10492 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54948:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:02.739462 10492 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:02.935221 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 94a8b7e07671442dafc4c3dcb271d352 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:02.936645 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a8b7e07671442dafc4c3dcb271d352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.943889 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 2904e05a1d154393bc63b07589fd6537 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:02.944717 10584 tablet_service.cc:1511] Processing CreateTablet for tablet 94a8b7e07671442dafc4c3dcb271d352 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:02.946022 10584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a8b7e07671442dafc4c3dcb271d352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.946360 10659 tablet_service.cc:1511] Processing CreateTablet for tablet 94a8b7e07671442dafc4c3dcb271d352 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:02.947007 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63a40a747147e987c1c81889fd1a0d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:02.947872 10659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a8b7e07671442dafc4c3dcb271d352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.948985 10730 tablet_service.cc:1511] Processing CreateTablet for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:02.950618 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 2904e05a1d154393bc63b07589fd6537 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:02.951972 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904e05a1d154393bc63b07589fd6537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.952998 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 72b98b9d27524f83a9b567dee7f0718f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:02.954864 10728 tablet_service.cc:1511] Processing CreateTablet for tablet e6d3a109d6054b8ba7b3b1ff65909ade (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:02.954895 10657 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63a40a747147e987c1c81889fd1a0d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:02.956487 10657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63a40a747147e987c1c81889fd1a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.956848 10656 tablet_service.cc:1511] Processing CreateTablet for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:02.957281 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 2904e05a1d154393bc63b07589fd6537 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:02.958156 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.958601 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904e05a1d154393bc63b07589fd6537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.962388 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63a40a747147e987c1c81889fd1a0d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:02.963652 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63a40a747147e987c1c81889fd1a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.963667 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2904e05a1d154393bc63b07589fd6537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.965531 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:02.966779 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.966470 10654 tablet_service.cc:1511] Processing CreateTablet for tablet e6d3a109d6054b8ba7b3b1ff65909ade (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:02.967721 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d3a109d6054b8ba7b3b1ff65909ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.966457 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63a40a747147e987c1c81889fd1a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.964841 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 72b98b9d27524f83a9b567dee7f0718f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:02.968621 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 72b98b9d27524f83a9b567dee7f0718f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:02.969246 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.969444 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b98b9d27524f83a9b567dee7f0718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.969872 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b98b9d27524f83a9b567dee7f0718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.970659 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d3a109d6054b8ba7b3b1ff65909ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.972028 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b98b9d27524f83a9b567dee7f0718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.974579 10727 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3acb5ddc84e7e91b896e4a278cec7 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:02.976233 10727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3acb5ddc84e7e91b896e4a278cec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.979038 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed347880eeb491baa0d6d22c5964d18 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:02.980406 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed347880eeb491baa0d6d22c5964d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.994478 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3acb5ddc84e7e91b896e4a278cec7 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:02.995875 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3acb5ddc84e7e91b896e4a278cec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.004161 10579 tablet_service.cc:1511] Processing CreateTablet for tablet e6d3a109d6054b8ba7b3b1ff65909ade (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:03.005913 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6d3a109d6054b8ba7b3b1ff65909ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.013231 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed347880eeb491baa0d6d22c5964d18 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:03.014971 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed347880eeb491baa0d6d22c5964d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.025547 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 63a3acb5ddc84e7e91b896e4a278cec7 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:03.027503 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a3acb5ddc84e7e91b896e4a278cec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.029417 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 75bb31da8c4c4ef8a1530905a2369172 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:03.030696 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bb31da8c4c4ef8a1530905a2369172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.031038 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed347880eeb491baa0d6d22c5964d18 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:03.033968 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed347880eeb491baa0d6d22c5964d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.034698 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 75bb31da8c4c4ef8a1530905a2369172 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:03.036616 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bb31da8c4c4ef8a1530905a2369172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.086056 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 75bb31da8c4c4ef8a1530905a2369172 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:03.087353 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bb31da8c4c4ef8a1530905a2369172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.102317 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 46f08f529e274f3799aa41f54ca844f9 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:03.104804 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f08f529e274f3799aa41f54ca844f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.111457 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 46f08f529e274f3799aa41f54ca844f9 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:03.112831 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f08f529e274f3799aa41f54ca844f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.112856 10785 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.118552 10783 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.123448 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 46f08f529e274f3799aa41f54ca844f9 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:03.124675 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f08f529e274f3799aa41f54ca844f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.132221 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:03.133483 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.144284 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:03.145390 10784 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.145730 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.147377 10783 tablet_bootstrap.cc:654] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.156167 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:03.157394 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.164094 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 81565cb1f2054410aae97284b914f79c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:03.165966 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81565cb1f2054410aae97284b914f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.168308 10785 tablet_bootstrap.cc:654] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.168859 10578 tablet_service.cc:1511] Processing CreateTablet for tablet f325308e46064da6807ac7edc8a20717 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:03.170642 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325308e46064da6807ac7edc8a20717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.182353 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 81565cb1f2054410aae97284b914f79c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:03.187693 10784 tablet_bootstrap.cc:654] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.168859 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 81565cb1f2054410aae97284b914f79c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:03.190981 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81565cb1f2054410aae97284b914f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.193954 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81565cb1f2054410aae97284b914f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.197708 10785 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.198215 10785 ts_tablet_manager.cc:1403] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.002s
I20260709 13:15:03.205930 10652 tablet_service.cc:1511] Processing CreateTablet for tablet f325308e46064da6807ac7edc8a20717 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:03.207542 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325308e46064da6807ac7edc8a20717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.212061 10785 raft_consensus.cc:359] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.223160 10785 raft_consensus.cc:385] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.223578 10785 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.224471 10785 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.247371 10784 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.247956 10784 ts_tablet_manager.cc:1403] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.022s
I20260709 13:15:03.249789 10783 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:03.250273 10783 ts_tablet_manager.cc:1403] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.132s	user 0.026s	sys 0.057s
I20260709 13:15:03.250752 10784 raft_consensus.cc:359] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.251446 10784 raft_consensus.cc:385] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.251744 10784 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.252569 10784 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.253571 10785 ts_tablet_manager.cc:1434] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:15:03.253144 10783 raft_consensus.cc:359] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.254035 10783 raft_consensus.cc:385] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.254374 10783 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.254976 10768 heartbeater.cc:499] Master 127.9.68.126:35023 was elected leader, sending a full tablet report...
I20260709 13:15:03.255311 10783 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.257871 10619 heartbeater.cc:499] Master 127.9.68.126:35023 was elected leader, sending a full tablet report...
I20260709 13:15:03.258186 10783 ts_tablet_manager.cc:1434] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:15:03.259181 10783 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.254554 10785 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.265306 10783 tablet_bootstrap.cc:654] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.273213 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 2298132784d24fb2b78c3a21c68a9d40 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:03.274881 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2298132784d24fb2b78c3a21c68a9d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.285274 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 2298132784d24fb2b78c3a21c68a9d40 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:03.289232 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2298132784d24fb2b78c3a21c68a9d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.290603 10726 tablet_service.cc:1511] Processing CreateTablet for tablet f325308e46064da6807ac7edc8a20717 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:03.292166 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325308e46064da6807ac7edc8a20717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.300343 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16782ce53741e19df4f216701c641a (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:03.301967 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16782ce53741e19df4f216701c641a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:03.308568 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:03.287606 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16782ce53741e19df4f216701c641a (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:03.311815 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16782ce53741e19df4f216701c641a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.313136 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 2298132784d24fb2b78c3a21c68a9d40 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:03.316365 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16782ce53741e19df4f216701c641a (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:03.318035 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16782ce53741e19df4f216701c641a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.287209 10785 tablet_bootstrap.cc:654] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.326704 10694 heartbeater.cc:499] Master 127.9.68.126:35023 was elected leader, sending a full tablet report...
I20260709 13:15:03.327673 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2298132784d24fb2b78c3a21c68a9d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.341037 10784 ts_tablet_manager.cc:1434] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.093s	user 0.030s	sys 0.040s
I20260709 13:15:03.342103 10784 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.346452 10576 tablet_service.cc:1511] Processing CreateTablet for tablet eaf67a9a92d14fbeaf459c21b6c42278 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:03.347692 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf67a9a92d14fbeaf459c21b6c42278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.349236 10784 tablet_bootstrap.cc:654] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.358901 10654 tablet_service.cc:1511] Processing CreateTablet for tablet eaf67a9a92d14fbeaf459c21b6c42278 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:03.360483 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf67a9a92d14fbeaf459c21b6c42278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.362707 10783 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:03.363152 10783 ts_tablet_manager.cc:1403] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.104s	user 0.040s	sys 0.028s
I20260709 13:15:03.366031 10783 raft_consensus.cc:359] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.366753 10783 raft_consensus.cc:385] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.367030 10783 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.367697 10783 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.369241 10732 tablet_service.cc:1511] Processing CreateTablet for tablet eaf67a9a92d14fbeaf459c21b6c42278 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:03.370850 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf67a9a92d14fbeaf459c21b6c42278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.372546 10791 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.372959 10791 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.374778 10785 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.375211 10785 ts_tablet_manager.cc:1403] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.000s
I20260709 13:15:03.377681 10791 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.381171 10785 raft_consensus.cc:359] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.382138 10785 raft_consensus.cc:385] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.382508 10785 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.383437 10785 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.388844 10785 ts_tablet_manager.cc:1434] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:15:03.389703 10785 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.396040 10785 tablet_bootstrap.cc:654] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.408222 10783 ts_tablet_manager.cc:1434] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.006s
I20260709 13:15:03.409600 10783 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.417531 10783 tablet_bootstrap.cc:654] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.420284 10784 tablet_bootstrap.cc:492] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.420761 10784 ts_tablet_manager.cc:1403] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.022s
I20260709 13:15:03.422037 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 1b930877bb3e45ff96d2babd2b0f8bc8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:03.424876 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b930877bb3e45ff96d2babd2b0f8bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.423543 10784 raft_consensus.cc:359] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.427294 10784 raft_consensus.cc:385] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.427650 10784 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.430253 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 1b930877bb3e45ff96d2babd2b0f8bc8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:03.431504 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b930877bb3e45ff96d2babd2b0f8bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.431191 10784 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.434926 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:03.436810 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 7247478c2fbc418f85cf61569e673a75 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:03.437408 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 7247478c2fbc418f85cf61569e673a75 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:03.438031 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7247478c2fbc418f85cf61569e673a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.438125 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 7247478c2fbc418f85cf61569e673a75 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:03.438591 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7247478c2fbc418f85cf61569e673a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.439307 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7247478c2fbc418f85cf61569e673a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.439486 10785 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.439957 10785 ts_tablet_manager.cc:1403] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
W20260709 13:15:03.442152 10559 leader_election.cc:343] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.444553 10785 raft_consensus.cc:359] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.434633 10784 ts_tablet_manager.cc:1434] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:03.446298 10784 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.448351 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 6aab7d76cb3149698a925aad05e45589 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:03.449625 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aab7d76cb3149698a925aad05e45589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.450294 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 6aab7d76cb3149698a925aad05e45589 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:03.451429 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aab7d76cb3149698a925aad05e45589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.452102 10784 tablet_bootstrap.cc:654] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.445238 10785 raft_consensus.cc:385] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.453620 10785 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.454063 10790 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.454342 10785 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.454524 10790 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.456736 10785 ts_tablet_manager.cc:1434] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:03.457031 10790 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:03.458158 10785 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.468302 10789 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.468827 10789 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.469082 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 6aab7d76cb3149698a925aad05e45589 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:03.469771 10790 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.470482 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aab7d76cb3149698a925aad05e45589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.470218 10790 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.472035 10785 tablet_bootstrap.cc:654] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.472146 10790 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:03.473668 10789 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.434608 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 1b930877bb3e45ff96d2babd2b0f8bc8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:03.477799 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b930877bb3e45ff96d2babd2b0f8bc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.495545 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:03.496229 10743 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:03.498346 10560 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:03.498602 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 86f93e93739544bc8c7af65e566a65d6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:03.499717 10791 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.499770 10783 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:03.499931 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f93e93739544bc8c7af65e566a65d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.500144 10791 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.500483 10783 ts_tablet_manager.cc:1403] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.004s
I20260709 13:15:03.500617 10791 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.502231 10789 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.502665 10789 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.504827 10789 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.507506 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 86f93e93739544bc8c7af65e566a65d6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:03.507870 10791 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.508813 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f93e93739544bc8c7af65e566a65d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.510198 10791 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.510816 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:03.511351 10743 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.514779 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf3c0497064f47ad08a6d5a7a28853 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:03.516018 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf3c0497064f47ad08a6d5a7a28853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.515017 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:03.518676 10559 leader_election.cc:343] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.519946 10743 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:03.521067 10560 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:03.522151 10791 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.528596 10783 raft_consensus.cc:359] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.542577 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf3c0497064f47ad08a6d5a7a28853 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:03.543860 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf3c0497064f47ad08a6d5a7a28853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.548708 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1a927fea2843f890fde9160ee8b796 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:03.549392 10791 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:03.549986 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1a927fea2843f890fde9160ee8b796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.529304 10783 raft_consensus.cc:385] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.550500 10783 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.550578 10791 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.551383 10783 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.552558 10784 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.553066 10784 ts_tablet_manager.cc:1403] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.013s
I20260709 13:15:03.553473 10783 ts_tablet_manager.cc:1434] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.004s
I20260709 13:15:03.554390 10783 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.555325 10785 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.555787 10785 ts_tablet_manager.cc:1403] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.016s
I20260709 13:15:03.556247 10784 raft_consensus.cc:359] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.557003 10784 raft_consensus.cc:385] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.557370 10784 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.558053 10784 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.559338 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 86f93e93739544bc8c7af65e566a65d6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:03.559633 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1a927fea2843f890fde9160ee8b796 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:03.560575 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f93e93739544bc8c7af65e566a65d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.560724 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1a927fea2843f890fde9160ee8b796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.562960 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1a927fea2843f890fde9160ee8b796 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:03.563146 10785 raft_consensus.cc:359] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.563732 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.564031 10785 raft_consensus.cc:385] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.564206 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1a927fea2843f890fde9160ee8b796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.564366 10785 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.564445 10594 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:03.565269 10785 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.565855 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.566509 10593 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:03.573496 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 62cf3c0497064f47ad08a6d5a7a28853 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:03.576000 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cf3c0497064f47ad08a6d5a7a28853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.579018 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 5c293ace9b264b57b21dd6b308e25a1f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:03.576978 10632 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:03.580435 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c293ace9b264b57b21dd6b308e25a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.580613 10790 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.581260 10790 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.582449 10790 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.580435 10632 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:03.586277 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:03.587473 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.590819 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 5c293ace9b264b57b21dd6b308e25a1f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:03.592010 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c293ace9b264b57b21dd6b308e25a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.594818 10784 ts_tablet_manager.cc:1434] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.005s
I20260709 13:15:03.601900 10783 tablet_bootstrap.cc:654] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.601745 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:03.610165 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.603345 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 5c293ace9b264b57b21dd6b308e25a1f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:03.604856 10785 ts_tablet_manager.cc:1434] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:15:03.606647 10790 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.614161 10789 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.615371 10789 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.621367 10789 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.618728 10784 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.631306 10785 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.635182 10582 tablet_service.cc:1511] Processing CreateTablet for tablet e922c08ea15b4851815093b0021df81c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:03.651846 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c293ace9b264b57b21dd6b308e25a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.660887 10785 tablet_bootstrap.cc:654] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.662290 10790 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:03.662853 10790 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.663196 10790 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.663539 10790 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.671128 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.678956 10594 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:03.676036 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.676014 10810 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.678045 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922c08ea15b4851815093b0021df81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.680279 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:03.680330 10810 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.675537 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.685020 10789 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.686067 10789 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.686410 10789 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:03.689602 10706 leader_election.cc:343] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:03.690250 10706 leader_election.cc:343] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.702636 10810 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:03.702587 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:03.697749 10790 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.705381 10733 tablet_service.cc:1511] Processing CreateTablet for tablet e922c08ea15b4851815093b0021df81c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:03.705907 10790 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:03.706697 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922c08ea15b4851815093b0021df81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.708726 10789 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.709985 10783 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:03.710431 10783 ts_tablet_manager.cc:1403] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.156s	user 0.036s	sys 0.027s
I20260709 13:15:03.713785 10491 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.711360 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:03.729713 10592 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.730340 10653 tablet_service.cc:1511] Processing CreateTablet for tablet e922c08ea15b4851815093b0021df81c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:03.731628 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922c08ea15b4851815093b0021df81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.732614 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 20723d90fba84eedaeb069a608e6a40f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:03.733803 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20723d90fba84eedaeb069a608e6a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.734252 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 20723d90fba84eedaeb069a608e6a40f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:03.735431 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20723d90fba84eedaeb069a608e6a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.738019 10592 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:03.721457 10784 tablet_bootstrap.cc:654] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.722196 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:03.741684 10669 raft_consensus.cc:2393] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:03.723340 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:03.724418 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:03.743199 10667 raft_consensus.cc:2393] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:03.743974 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:03.725751 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:03.727304 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 5b107ac4e22944b388450acfe815a08e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 13:15:03.747097 10708 leader_election.cc:343] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.747645 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3bc7fc30ef40e79df7e6a1bfdcb227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.747539 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:03.747965 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b107ac4e22944b388450acfe815a08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.728783 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 5b107ac4e22944b388450acfe815a08e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:03.751932 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b107ac4e22944b388450acfe815a08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.711198 10789 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:03.684437 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 91052.8us
I20260709 13:15:03.720492 10783 raft_consensus.cc:359] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.755489 10783 raft_consensus.cc:385] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.755540 10789 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.755890 10783 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.756057 10789 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:03.756671 10783 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.756866 10789 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.758842 10783 ts_tablet_manager.cc:1434] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.006s
I20260709 13:15:03.759925 10783 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.761715 10785 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.762153 10785 ts_tablet_manager.cc:1403] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.001s
I20260709 13:15:03.763774 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:03.764557 10592 raft_consensus.cc:2393] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:03.764400 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.766120 10816 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.766153 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:03.755684 10784 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.766790 10592 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:03.766888 10632 leader_election.cc:343] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.767269 10784 ts_tablet_manager.cc:1403] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.149s	user 0.007s	sys 0.007s
I20260709 13:15:03.770180 10784 raft_consensus.cc:359] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.770870 10784 raft_consensus.cc:385] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.771152 10784 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.772555 10783 tablet_bootstrap.cc:654] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.773918 10592 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:03.774765 10784 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.775154 10632 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:03.776171 10790 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:03.775175 10708 leader_election.cc:343] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.776721 10790 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:03.776749 10708 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:03.776876 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 5b107ac4e22944b388450acfe815a08e (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:03.778215 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b107ac4e22944b388450acfe815a08e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.780611 10790 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.786759 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:03.786677 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 20723d90fba84eedaeb069a608e6a40f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:03.787992 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20723d90fba84eedaeb069a608e6a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.788110 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:03.789402 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:03.790732 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:03.791846 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:03.788142 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 0db5b0c3da3b45289300a692b98fa1c1 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:03.793959 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db5b0c3da3b45289300a692b98fa1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.802381 10583 tablet_service.cc:1511] Processing CreateTablet for tablet d6db1ee475344550afb0eaebc5046df6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:03.803597 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db1ee475344550afb0eaebc5046df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.805133 10817 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.806535 10784 ts_tablet_manager.cc:1434] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
W20260709 13:15:03.810680 10635 leader_election.cc:343] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.810745 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 0db5b0c3da3b45289300a692b98fa1c1 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:03.812000 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db5b0c3da3b45289300a692b98fa1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.811882 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:03.812808 10809 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:03.813911 10635 leader_election.cc:343] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.814330 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:03.764986 10785 raft_consensus.cc:359] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.815428 10785 raft_consensus.cc:385] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.815742 10785 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.816567 10785 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.817023 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 0db5b0c3da3b45289300a692b98fa1c1 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:03.818356 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db5b0c3da3b45289300a692b98fa1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.826942 10726 tablet_service.cc:1511] Processing CreateTablet for tablet d6db1ee475344550afb0eaebc5046df6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:03.828181 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db1ee475344550afb0eaebc5046df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.833045 10490 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.836221 10784 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.837407 10785 ts_tablet_manager.cc:1434] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:15:03.838308 10785 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.848013 10809 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.848693 10783 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:03.849145 10783 ts_tablet_manager.cc:1403] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.000s
W20260709 13:15:03.849205 10635 leader_election.cc:343] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.847438 10489 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.854077 10783 raft_consensus.cc:359] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.854171 10658 tablet_service.cc:1511] Processing CreateTablet for tablet d6db1ee475344550afb0eaebc5046df6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:03.855523 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db1ee475344550afb0eaebc5046df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.851320 10784 tablet_bootstrap.cc:654] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.861876 10785 tablet_bootstrap.cc:654] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.865449 10783 raft_consensus.cc:385] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.865900 10783 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.866798 10783 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.870744 10582 tablet_service.cc:1511] Processing CreateTablet for tablet d13f2688a0464257b5162c27e06aeaad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:03.872031 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13f2688a0464257b5162c27e06aeaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.885723 10785 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.887246 10785 ts_tablet_manager.cc:1403] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.011s
I20260709 13:15:03.889919 10785 raft_consensus.cc:359] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.890599 10785 raft_consensus.cc:385] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.890882 10785 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.891582 10785 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.893129 10784 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.893664 10784 ts_tablet_manager.cc:1403] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.008s
I20260709 13:15:03.897249 10784 raft_consensus.cc:359] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.898049 10784 raft_consensus.cc:385] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.898411 10784 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.899279 10784 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.900676 10785 ts_tablet_manager.cc:1434] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:03.902191 10731 tablet_service.cc:1511] Processing CreateTablet for tablet d13f2688a0464257b5162c27e06aeaad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:03.903462 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13f2688a0464257b5162c27e06aeaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.904364 10784 ts_tablet_manager.cc:1434] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:03.905666 10784 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.907191 10789 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.907680 10789 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.909749 10789 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.910171 10785 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.911239 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:03.911895 10592 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:03.913103 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:03.913465 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3e32279b914c319fcf8afa158efa9c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:03.914719 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3e32279b914c319fcf8afa158efa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.916464 10789 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.916824 10789 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.917152 10789 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.917882 10785 tablet_bootstrap.cc:654] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.917711 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:03.918941 10708 leader_election.cc:343] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.922348 10784 tablet_bootstrap.cc:654] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.922330 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3e32279b914c319fcf8afa158efa9c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:03.923698 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3e32279b914c319fcf8afa158efa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.926275 10652 tablet_service.cc:1511] Processing CreateTablet for tablet d13f2688a0464257b5162c27e06aeaad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:03.932242 10785 tablet_bootstrap.cc:492] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.932922 10785 ts_tablet_manager.cc:1403] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:15:03.937250 10785 raft_consensus.cc:359] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.939355 10785 raft_consensus.cc:385] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.939705 10785 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.940601 10784 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:03.941143 10784 ts_tablet_manager.cc:1403] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.009s
I20260709 13:15:03.943187 10789 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.943892 10784 raft_consensus.cc:359] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.940547 10785 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.944577 10784 raft_consensus.cc:385] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.944896 10784 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.945636 10784 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.946164 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3e32279b914c319fcf8afa158efa9c (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:03.946997 10785 ts_tablet_manager.cc:1434] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:15:03.947525 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3e32279b914c319fcf8afa158efa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.948042 10785 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.949910 10790 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.950340 10790 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:03.951933 10789 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:03.952346 10790 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:03.954602 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:03.954856 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 0958810fe1d74c67af02bd74dc0488bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:03.955502 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:03.955893 10708 leader_election.cc:343] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.956950 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:03.957235 10785 tablet_bootstrap.cc:654] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.957692 10743 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:03.957767 10784 ts_tablet_manager.cc:1434] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:03.951879 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:03.959491 10592 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.958882 10635 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:03.956064 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0958810fe1d74c67af02bd74dc0488bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.965924 10784 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:03.968050 10592 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:03.968786 10785 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:03.968840 10790 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.969291 10785 ts_tablet_manager.cc:1403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:15:03.969249 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:03.970389 10789 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.970816 10789 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:03.971563 10789 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.971906 10785 raft_consensus.cc:359] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.972502 10785 raft_consensus.cc:385] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.972769 10785 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.973456 10785 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:03.975325 10785 ts_tablet_manager.cc:1434] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:15:03.976043 10790 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.976172 10785 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:03.927615 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13f2688a0464257b5162c27e06aeaad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.987910 10784 tablet_bootstrap.cc:654] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.992074 10785 tablet_bootstrap.cc:654] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.937352 10783 ts_tablet_manager.cc:1434] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:15:03.993497 10783 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:03.992728 10489 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.000288 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 0958810fe1d74c67af02bd74dc0488bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:04.001516 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0958810fe1d74c67af02bd74dc0488bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.003907 10791 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.007038 10785 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:04.007504 10785 ts_tablet_manager.cc:1403] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:15:04.010221 10785 raft_consensus.cc:359] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.010895 10785 raft_consensus.cc:385] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.011207 10785 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.011862 10785 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.013820 10785 ts_tablet_manager.cc:1434] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:04.014562 10784 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:04.014689 10785 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:04.015019 10784 ts_tablet_manager.cc:1403] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.049s	user 0.004s	sys 0.010s
I20260709 13:15:04.016393 10790 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.016851 10790 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.017797 10583 tablet_service.cc:1511] Processing CreateTablet for tablet e1e246154849412a97842c9d673bd0a8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:04.019079 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e246154849412a97842c9d673bd0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.019336 10790 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.019462 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.020866 10785 tablet_bootstrap.cc:654] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.021332 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:04.021948 10740 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:04.022421 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 0958810fe1d74c67af02bd74dc0488bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:04.023578 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0958810fe1d74c67af02bd74dc0488bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:04.024550 10632 leader_election.cc:343] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.025302 10789 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.025648 10635 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:04.025844 10789 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.027143 10784 raft_consensus.cc:359] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.027829 10784 raft_consensus.cc:385] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.027894 10789 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.028196 10784 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.032660 10809 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.033049 10809 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.032887 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.033516 10809 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.035185 10784 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.034534 10790 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.041798 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.045590 10658 tablet_service.cc:1511] Processing CreateTablet for tablet e1e246154849412a97842c9d673bd0a8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:04.047207 10582 tablet_service.cc:1511] Processing CreateTablet for tablet b8e29890b8e04ddca3426014b2514656 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:15:04.040387 10708 leader_election.cc:343] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:04.053089 10706 leader_election.cc:343] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.053454 10654 tablet_service.cc:1511] Processing CreateTablet for tablet b8e29890b8e04ddca3426014b2514656 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:04.025301 10733 tablet_service.cc:1511] Processing CreateTablet for tablet e1e246154849412a97842c9d673bd0a8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:04.058058 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:04.058444 10732 tablet_service.cc:1511] Processing CreateTablet for tablet b8e29890b8e04ddca3426014b2514656 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:04.058961 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:04.051398 10790 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.070225 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e29890b8e04ddca3426014b2514656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.067909 10789 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.071836 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e29890b8e04ddca3426014b2514656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.071872 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 9d22506ba0474e93940b67cdd5d59af6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:04.072288 10790 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.073213 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d22506ba0474e93940b67cdd5d59af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.073625 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:04.072531 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:04.078299 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.078722 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.078876 10592 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:04.079468 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 9d22506ba0474e93940b67cdd5d59af6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:04.081418 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e246154849412a97842c9d673bd0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.080112 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:04.086391 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:04.086779 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.097922 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.097960 10740 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:04.098917 10790 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.099268 10790 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.099574 10790 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.102423 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d22506ba0474e93940b67cdd5d59af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.087924 10783 tablet_bootstrap.cc:654] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.087910 10727 tablet_service.cc:1511] Processing CreateTablet for tablet 9d22506ba0474e93940b67cdd5d59af6 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:04.088510 10791 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.089915 10785 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:04.107373 10785 ts_tablet_manager.cc:1403] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.026s
I20260709 13:15:04.090951 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e246154849412a97842c9d673bd0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.110364 10727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d22506ba0474e93940b67cdd5d59af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.113170 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e29890b8e04ddca3426014b2514656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.109827 10785 raft_consensus.cc:359] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.119264 10785 raft_consensus.cc:385] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.119719 10785 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.118063 10809 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.129559 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:04.129839 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 27b7b057c54346c0b47758f08031d007 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:15:04.130860 10632 leader_election.cc:343] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.130875 10784 ts_tablet_manager.cc:1434] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.003s
I20260709 13:15:04.132261 10784 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:04.132776 10785 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.134008 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:04.138897 10785 ts_tablet_manager.cc:1434] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:15:04.138681 10656 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1c58f717d74f2fba0ed73c78de0673 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:04.141543 10743 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.142177 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1c58f717d74f2fba0ed73c78de0673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.138701 10790 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.129839 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 27b7b057c54346c0b47758f08031d007 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:04.154232 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b7b057c54346c0b47758f08031d007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.146347 10785 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:04.159317 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:04.159989 10592 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.160075 10790 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.144495 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b7b057c54346c0b47758f08031d007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.159991 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:04.163483 10809 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:04.165038 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62740us
I20260709 13:15:04.179095 10577 tablet_service.cc:1511] Processing CreateTablet for tablet 27b7b057c54346c0b47758f08031d007 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:04.180356 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27b7b057c54346c0b47758f08031d007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.175314 10740 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.186208 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1c58f717d74f2fba0ed73c78de0673 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:04.189903 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 939b0eadbf7c4b4e842fc542cbaae675 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:04.199752 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd88b6bef8141f2a7c75714e0233dfd (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:04.200876 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939b0eadbf7c4b4e842fc542cbaae675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.203528 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 7485460ddbcb4574882c669f7bdbbf47 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:04.204874 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485460ddbcb4574882c669f7bdbbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.191691 10789 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:04.205794 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 7485460ddbcb4574882c669f7bdbbf47 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:04.206969 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485460ddbcb4574882c669f7bdbbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.191897 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1c58f717d74f2fba0ed73c78de0673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.211755 10576 tablet_service.cc:1511] Processing CreateTablet for tablet 939b0eadbf7c4b4e842fc542cbaae675 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:04.196106 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd88b6bef8141f2a7c75714e0233dfd (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:04.190348 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1c58f717d74f2fba0ed73c78de0673 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:04.219215 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd88b6bef8141f2a7c75714e0233dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.219762 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1c58f717d74f2fba0ed73c78de0673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.199540 10740 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:04.221585 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd88b6bef8141f2a7c75714e0233dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.189306 10592 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:04.222323 10635 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:04.223121 10809 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.223644 10784 tablet_bootstrap.cc:654] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.223594 10809 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:04.224647 10809 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.227883 10790 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.228338 10790 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.229382 10743 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:04.196779 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd88b6bef8141f2a7c75714e0233dfd (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:04.230491 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd88b6bef8141f2a7c75714e0233dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.231549 10635 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:04.232278 10810 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.194453 10727 tablet_service.cc:1511] Processing CreateTablet for tablet 939b0eadbf7c4b4e842fc542cbaae675 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:04.218179 10783 tablet_bootstrap.cc:492] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:04.242231 10789 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.247148 10789 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.247431 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 7485460ddbcb4574882c669f7bdbbf47 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:04.248664 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7485460ddbcb4574882c669f7bdbbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.250576 10789 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.237720 10790 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.253688 10783 ts_tablet_manager.cc:1403] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.260s	user 0.017s	sys 0.005s
I20260709 13:15:04.264719 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.269742 10727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939b0eadbf7c4b4e842fc542cbaae675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.272222 10785 tablet_bootstrap.cc:654] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.273167 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 602f135686c6438ea75a7b4f28a2625d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:04.273821 10783 raft_consensus.cc:359] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.274542 10783 raft_consensus.cc:385] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.274827 10783 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.275552 10783 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.282559 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.282446 10728 tablet_service.cc:1511] Processing CreateTablet for tablet 602f135686c6438ea75a7b4f28a2625d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:04.283142 10667 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:04.283701 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602f135686c6438ea75a7b4f28a2625d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.283172 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 602f135686c6438ea75a7b4f28a2625d (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:04.284621 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602f135686c6438ea75a7b4f28a2625d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.285503 10594 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:04.286110 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 099b1366ff5e4753be5bd192a535a9fe (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:04.287149 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099b1366ff5e4753be5bd192a535a9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.278327 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939b0eadbf7c4b4e842fc542cbaae675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.290481 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:04.291407 10817 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.291741 10817 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.291703 10583 tablet_service.cc:1511] Processing CreateTablet for tablet 099b1366ff5e4753be5bd192a535a9fe (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:04.292222 10817 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.264410 10810 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:04.292985 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:04.293615 10810 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.267730 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.277925 10783 ts_tablet_manager.cc:1434] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:15:04.298708 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 099b1366ff5e4753be5bd192a535a9fe (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:04.299512 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099b1366ff5e4753be5bd192a535a9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.307479 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602f135686c6438ea75a7b4f28a2625d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:04.312896 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:04.316291 10810 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.321779 10789 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.321496 10491 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.330021 10592 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:04.335186 10632 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:04.335835 10580 tablet_service.cc:1511] Processing CreateTablet for tablet edb4252c2cb946b2833f090b57f26ad4 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:04.336351 10810 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.336694 10789 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.337281 10789 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.339210 10784 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:04.339634 10784 ts_tablet_manager.cc:1403] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.208s	user 0.005s	sys 0.011s
I20260709 13:15:04.341235 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.342576 10789 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.351537 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.354619 10652 tablet_service.cc:1511] Processing CreateTablet for tablet edb4252c2cb946b2833f090b57f26ad4 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:04.355729 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4252c2cb946b2833f090b57f26ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.355804 10810 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.374624 10706 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:04.375371 10789 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.375907 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099b1366ff5e4753be5bd192a535a9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.376577 10783 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:04.376979 10730 tablet_service.cc:1511] Processing CreateTablet for tablet edb4252c2cb946b2833f090b57f26ad4 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:04.378545 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4252c2cb946b2833f090b57f26ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.379000 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb4252c2cb946b2833f090b57f26ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.381742 10817 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.402030 10784 raft_consensus.cc:359] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.402740 10784 raft_consensus.cc:385] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.395114 10817 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.403004 10784 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.404189 10784 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.400193 10789 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.413380 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:04.413962 10592 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.417737 10741 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.419991 10784 ts_tablet_manager.cc:1434] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:15:04.408840 10789 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.421032 10784 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:04.424091 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 2c98bbebd7a849a6b0596781b7853ce3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:04.425491 10789 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.425423 10577 tablet_service.cc:1511] Processing CreateTablet for tablet d9ac19ea4edd4e26890c806619f5b551 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:04.427239 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 2c98bbebd7a849a6b0596781b7853ce3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:04.427239 10584 tablet_service.cc:1511] Processing CreateTablet for tablet f7624b04076142a0bbf29cbbf066c4bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:04.428902 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.428979 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:04.429648 10669 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.429559 10668 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:04.431027 10785 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:04.431474 10785 ts_tablet_manager.cc:1403] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.040s
I20260709 13:15:04.431543 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:04.430403 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c98bbebd7a849a6b0596781b7853ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.432363 10789 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.432716 10789 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.433017 10789 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.438712 10785 raft_consensus.cc:359] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.439217 10785 raft_consensus.cc:385] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.439478 10785 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.443770 10733 tablet_service.cc:1511] Processing CreateTablet for tablet d9ac19ea4edd4e26890c806619f5b551 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:04.444779 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ac19ea4edd4e26890c806619f5b551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.450359 10785 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.460907 10784 tablet_bootstrap.cc:654] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.462450 10592 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:04.463600 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:04.464752 10843 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:15:04.464973 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.482956 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 2c98bbebd7a849a6b0596781b7853ce3 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:04.487661 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c98bbebd7a849a6b0596781b7853ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.490976 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c98bbebd7a849a6b0596781b7853ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.492359 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 55846c170448461696e53d2649ed09d8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:04.500671 10726 tablet_service.cc:1511] Processing CreateTablet for tablet feaf88905a8f4cc8bf8e751c1f163180 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:04.502115 10733 tablet_service.cc:1511] Processing CreateTablet for tablet f7624b04076142a0bbf29cbbf066c4bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:04.503667 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7624b04076142a0bbf29cbbf066c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.504246 10584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7624b04076142a0bbf29cbbf066c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.504451 10785 ts_tablet_manager.cc:1434] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.073s	user 0.016s	sys 0.018s
I20260709 13:15:04.504860 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ac19ea4edd4e26890c806619f5b551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.505927 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55846c170448461696e53d2649ed09d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.506206 10817 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.506649 10817 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:04.507441 10817 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.505301 10785 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
W20260709 13:15:04.504017 10706 leader_election.cc:343] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.519340 10783 tablet_bootstrap.cc:654] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.519057 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 456c58bcf67c4357b892184c57ce7e09 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:04.519150 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 55846c170448461696e53d2649ed09d8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:04.520367 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456c58bcf67c4357b892184c57ce7e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.520442 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55846c170448461696e53d2649ed09d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.526069 10785 tablet_bootstrap.cc:654] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.527160 10669 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:04.528394 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf88905a8f4cc8bf8e751c1f163180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.528797 10656 tablet_service.cc:1511] Processing CreateTablet for tablet d9ac19ea4edd4e26890c806619f5b551 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:04.533385 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ac19ea4edd4e26890c806619f5b551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.530977 10658 tablet_service.cc:1511] Processing CreateTablet for tablet f7624b04076142a0bbf29cbbf066c4bb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:04.535880 10489 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.536932 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7624b04076142a0bbf29cbbf066c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.531824 10653 tablet_service.cc:1511] Processing CreateTablet for tablet feaf88905a8f4cc8bf8e751c1f163180 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:04.538486 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 55846c170448461696e53d2649ed09d8 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:04.543936 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf88905a8f4cc8bf8e751c1f163180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.572052 10784 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:04.572599 10784 ts_tablet_manager.cc:1403] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.152s	user 0.006s	sys 0.024s
I20260709 13:15:04.575023 10789 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.578383 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:04.579849 10706 leader_election.cc:343] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.602197 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55846c170448461696e53d2649ed09d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.558759 10576 tablet_service.cc:1511] Processing CreateTablet for tablet feaf88905a8f4cc8bf8e751c1f163180 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:04.619314 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 251650397d264ac1a42a2fde5932424f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:04.620393 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251650397d264ac1a42a2fde5932424f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.621353 10784 raft_consensus.cc:359] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.621980 10784 raft_consensus.cc:385] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.622241 10784 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.622815 10784 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.625116 10784 ts_tablet_manager.cc:1434] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.002s
I20260709 13:15:04.599980 10790 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:04.625936 10784 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:04.628413 10848 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.606891 10789 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.634814 10784 tablet_bootstrap.cc:654] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.635377 10783 tablet_bootstrap.cc:492] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:04.630537 10731 tablet_service.cc:1511] Processing CreateTablet for tablet 456c58bcf67c4357b892184c57ce7e09 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:04.637658 10731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456c58bcf67c4357b892184c57ce7e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.641867 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf88905a8f4cc8bf8e751c1f163180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.642400 10732 tablet_service.cc:1511] Processing CreateTablet for tablet 251650397d264ac1a42a2fde5932424f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:04.643451 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251650397d264ac1a42a2fde5932424f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.635869 10783 ts_tablet_manager.cc:1403] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.259s	user 0.043s	sys 0.030s
I20260709 13:15:04.648099 10733 tablet_service.cc:1511] Processing CreateTablet for tablet 8e245cc261b6415fac3d372489a49ceb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:04.649143 10733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e245cc261b6415fac3d372489a49ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.658290 10727 tablet_service.cc:1511] Processing CreateTablet for tablet b691cd466c7645fbba119f2344854ddb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:04.659485 10727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b691cd466c7645fbba119f2344854ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.660151 10783 raft_consensus.cc:359] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.660856 10783 raft_consensus.cc:385] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.661224 10783 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.662122 10783 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.663255 10583 tablet_service.cc:1511] Processing CreateTablet for tablet b691cd466c7645fbba119f2344854ddb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:04.663980 10783 ts_tablet_manager.cc:1434] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:04.664330 10583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b691cd466c7645fbba119f2344854ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.664898 10783 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:04.671696 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 456c58bcf67c4357b892184c57ce7e09 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:04.672748 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456c58bcf67c4357b892184c57ce7e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.673252 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 8e245cc261b6415fac3d372489a49ceb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:04.674274 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e245cc261b6415fac3d372489a49ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.673978 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 8e245cc261b6415fac3d372489a49ceb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:04.674062 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 251650397d264ac1a42a2fde5932424f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:04.675091 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251650397d264ac1a42a2fde5932424f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.675841 10582 tablet_service.cc:1511] Processing CreateTablet for tablet fa932526573f47178aa5a402a17388ad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:04.676973 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa932526573f47178aa5a402a17388ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.679639 10784 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:04.675841 10651 tablet_service.cc:1511] Processing CreateTablet for tablet b691cd466c7645fbba119f2344854ddb (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:04.680177 10784 ts_tablet_manager.cc:1403] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.000s
I20260709 13:15:04.680086 10848 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.680985 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b691cd466c7645fbba119f2344854ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.682457 10790 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.683532 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e245cc261b6415fac3d372489a49ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.683990 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:04.692937 10669 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.685848 10783 tablet_bootstrap.cc:654] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.704411 10809 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.707350 10669 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:04.709245 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:04.710384 10848 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.710891 10848 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:04.711697 10848 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.687284 10491 catalog_manager.cc:5697] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.752755 10785 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:04.753841 10785 ts_tablet_manager.cc:1403] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.249s	user 0.026s	sys 0.014s
I20260709 13:15:04.755443 10784 raft_consensus.cc:359] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.762578 10784 raft_consensus.cc:385] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.762944 10784 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.765625 10783 tablet_bootstrap.cc:492] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:04.765723 10658 tablet_service.cc:1511] Processing CreateTablet for tablet fa932526573f47178aa5a402a17388ad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:04.766219 10783 ts_tablet_manager.cc:1403] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.018s
I20260709 13:15:04.766901 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa932526573f47178aa5a402a17388ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:04.780902 10632 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:04.793355 10784 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.794104 10789 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.794546 10789 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.795321 10784 ts_tablet_manager.cc:1434] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.000s
I20260709 13:15:04.796142 10784 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:04.796411 10789 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:04.798920 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:04.799520 10783 raft_consensus.cc:359] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.800134 10783 raft_consensus.cc:385] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:04.800221 10706 leader_election.cc:343] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.800405 10783 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.801414 10784 tablet_bootstrap.cc:654] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.801033 10783 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.809163 10783 ts_tablet_manager.cc:1434] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:15:04.815955 10732 tablet_service.cc:1511] Processing CreateTablet for tablet fa932526573f47178aa5a402a17388ad (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:04.815955 10726 tablet_service.cc:1511] Processing CreateTablet for tablet ee360fe4b438464d8580245f06181d8f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:04.817052 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa932526573f47178aa5a402a17388ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.821583 10783 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:04.825668 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee360fe4b438464d8580245f06181d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.847698 10791 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.848311 10791 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.850059 10658 tablet_service.cc:1511] Processing CreateTablet for tablet ee360fe4b438464d8580245f06181d8f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:04.852108 10726 tablet_service.cc:1511] Processing CreateTablet for tablet a78c470d1bf042369166e3a795c3e963 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:04.852902 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c470d1bf042369166e3a795c3e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.854256 10656 tablet_service.cc:1511] Processing CreateTablet for tablet a78c470d1bf042369166e3a795c3e963 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:04.854887 10791 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.856069 10581 tablet_service.cc:1511] Processing CreateTablet for tablet ee360fe4b438464d8580245f06181d8f (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:04.857218 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee360fe4b438464d8580245f06181d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.857805 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:04.860148 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee360fe4b438464d8580245f06181d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.860148 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.861491 10669 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:04.863314 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c470d1bf042369166e3a795c3e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.862982 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:04.869765 10791 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.842469 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:04.874471 10578 tablet_service.cc:1511] Processing CreateTablet for tablet a78c470d1bf042369166e3a795c3e963 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:15:04.875556 10708 leader_election.cc:343] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:04.876045 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c470d1bf042369166e3a795c3e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.876001 10708 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:04.877288 10789 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.874572 10785 raft_consensus.cc:359] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.886896 10785 raft_consensus.cc:385] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.887157 10785 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.887882 10785 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.890854 10785 ts_tablet_manager.cc:1434] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.136s	user 0.005s	sys 0.001s
I20260709 13:15:04.887844 10791 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:04.893182 10785 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:04.900724 10785 tablet_bootstrap.cc:654] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.900508 10584 tablet_service.cc:1511] Processing CreateTablet for tablet 00e9824bb588413ab262854eb713a965 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:04.902418 10584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e9824bb588413ab262854eb713a965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.920153 10809 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.924005 10817 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.929100 10582 tablet_service.cc:1511] Processing CreateTablet for tablet b40fb00bae3d4baa92d6e9276011a816 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:04.930197 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40fb00bae3d4baa92d6e9276011a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.937741 10841 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.938313 10841 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:04.940652 10841 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:04.942991 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:04.943940 10743 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:04.944515 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 00e9824bb588413ab262854eb713a965 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:04.946008 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e9824bb588413ab262854eb713a965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.950737 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:04.951812 10809 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:04.952250 10809 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.952649 10809 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.953344 10784 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:04.953882 10784 ts_tablet_manager.cc:1403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.158s	user 0.039s	sys 0.064s
I20260709 13:15:04.965842 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 00e9824bb588413ab262854eb713a965 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:04.967470 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e9824bb588413ab262854eb713a965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.008718 10791 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.009361 10791 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.013257 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.015211 10791 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.015969 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.018194 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.018787 10592 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.018482 10741 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.019956 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.020754 10791 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.021201 10791 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.021601 10791 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.022794 10656 tablet_service.cc:1511] Processing CreateTablet for tablet b40fb00bae3d4baa92d6e9276011a816 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:05.023759 10584 tablet_service.cc:1511] Processing CreateTablet for tablet 5351bf3c5fe147f7b60882433345dd0b (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:05.024935 10584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5351bf3c5fe147f7b60882433345dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.027582 10785 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.028013 10785 ts_tablet_manager.cc:1403] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.018s
I20260709 13:15:05.027972 10817 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.029986 10732 tablet_service.cc:1511] Processing CreateTablet for tablet b40fb00bae3d4baa92d6e9276011a816 (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:05.031020 10732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40fb00bae3d4baa92d6e9276011a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.030719 10785 raft_consensus.cc:359] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.031337 10785 raft_consensus.cc:385] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.031656 10785 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.034051 10658 tablet_service.cc:1511] Processing CreateTablet for tablet 5351bf3c5fe147f7b60882433345dd0b (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:05.034866 10783 tablet_bootstrap.cc:654] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.015208 10784 raft_consensus.cc:359] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.036417 10784 raft_consensus.cc:385] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.036754 10784 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.024144 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40fb00bae3d4baa92d6e9276011a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.037772 10658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5351bf3c5fe147f7b60882433345dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.042194 10784 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.044118 10784 ts_tablet_manager.cc:1434] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.090s	user 0.000s	sys 0.017s
I20260709 13:15:05.020673 10489 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.052560 10809 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.053696 10667 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:05.060814 10791 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.063309 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 5351bf3c5fe147f7b60882433345dd0b (DEFAULT_TABLE table=test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:05.069706 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.070052 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5351bf3c5fe147f7b60882433345dd0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.070613 10592 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:05.074664 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.075222 10741 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.075744 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.077411 10791 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.077059 10785 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.079324 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.092052 10667 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:05.093375 10559 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:05.094342 10833 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.093801 10783 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.095297 10783 ts_tablet_manager.cc:1403] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.274s	user 0.018s	sys 0.002s
I20260709 13:15:05.096266 10785 ts_tablet_manager.cc:1434] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 13:15:05.097147 10785 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.098177 10783 raft_consensus.cc:359] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.098941 10783 raft_consensus.cc:385] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.084419 10784 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.099232 10783 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.099562 10789 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.099987 10783 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.086364 10809 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.103964 10784 tablet_bootstrap.cc:654] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.114915 10783 ts_tablet_manager.cc:1434] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:15:05.114825 10741 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.115859 10783 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.116178 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.117084 10809 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.117563 10809 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.118435 10809 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.119346 10785 tablet_bootstrap.cc:654] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.123243 10783 tablet_bootstrap.cc:654] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.137037 10784 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.137476 10784 ts_tablet_manager.cc:1403] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.009s
I20260709 13:15:05.139969 10784 raft_consensus.cc:359] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.140610 10784 raft_consensus.cc:385] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.140899 10784 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.140784 10817 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.141646 10784 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.143900 10784 ts_tablet_manager.cc:1434] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:05.144824 10784 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.150873 10784 tablet_bootstrap.cc:654] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.153795 10491 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.156663 10783 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.157241 10783 ts_tablet_manager.cc:1403] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 13:15:05.160912 10783 raft_consensus.cc:359] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.161800 10783 raft_consensus.cc:385] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.162146 10783 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.163161 10783 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.172226 10783 ts_tablet_manager.cc:1434] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:05.173094 10783 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.174772 10784 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.176645 10784 ts_tablet_manager.cc:1403] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.009s
I20260709 13:15:05.178558 10783 tablet_bootstrap.cc:654] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.175854 10785 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.179211 10785 ts_tablet_manager.cc:1403] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.014s
I20260709 13:15:05.181460 10785 raft_consensus.cc:359] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.182183 10785 raft_consensus.cc:385] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.182490 10785 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.183111 10785 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.185247 10785 ts_tablet_manager.cc:1434] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:15:05.185490 10783 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.185987 10783 ts_tablet_manager.cc:1403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:15:05.186604 10785 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.186535 10784 raft_consensus.cc:359] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.187302 10784 raft_consensus.cc:385] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.187580 10784 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.188237 10784 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.188820 10783 raft_consensus.cc:359] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.189812 10783 raft_consensus.cc:385] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.190083 10783 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.190440 10784 ts_tablet_manager.cc:1434] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:05.190847 10783 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.191488 10784 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.193589 10785 tablet_bootstrap.cc:654] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.197034 10783 ts_tablet_manager.cc:1434] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:05.198045 10783 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.198302 10784 tablet_bootstrap.cc:654] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.204077 10783 tablet_bootstrap.cc:654] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.207217 10785 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.207964 10785 ts_tablet_manager.cc:1403] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:15:05.211625 10785 raft_consensus.cc:359] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.212584 10785 raft_consensus.cc:385] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.212990 10785 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.215204 10785 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.216207 10784 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.216775 10784 ts_tablet_manager.cc:1403] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.003s
I20260709 13:15:05.217145 10817 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.217597 10817 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.219738 10817 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.219776 10784 raft_consensus.cc:359] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.220486 10784 raft_consensus.cc:385] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.220753 10784 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.221688 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.221915 10784 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.223404 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.223863 10784 ts_tablet_manager.cc:1434] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:15:05.224715 10784 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
W20260709 13:15:05.224895 10706 leader_election.cc:343] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.225530 10667 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:05.227262 10708 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.228331 10848 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.228773 10848 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.230325 10784 tablet_bootstrap.cc:654] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.230747 10848 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.231287 10848 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.231602 10848 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.231923 10848 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.234788 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.235592 10594 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:05.238090 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.239056 10789 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.239409 10789 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.239723 10789 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.242868 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.243502 10667 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:05.246910 10785 ts_tablet_manager.cc:1434] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:15:05.248088 10785 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.253072 10833 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.253949 10833 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.258613 10785 tablet_bootstrap.cc:654] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.258742 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.259553 10667 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.260447 10833 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.264285 10594 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.265686 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.266451 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.267580 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.273846 10833 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.274302 10833 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.274716 10833 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.288676 10783 tablet_bootstrap.cc:492] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.289506 10783 ts_tablet_manager.cc:1403] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.092s	user 0.036s	sys 0.041s
I20260709 13:15:05.291886 10789 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.292366 10783 raft_consensus.cc:359] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.292987 10783 raft_consensus.cc:385] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.293246 10783 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.293854 10783 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.294677 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.295480 10592 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.295671 10783 ts_tablet_manager.cc:1434] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:05.296526 10783 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.303938 10783 tablet_bootstrap.cc:654] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.289206 10848 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.311596 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:05.313287 10706 leader_election.cc:343] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.313596 10592 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:05.315451 10848 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.319523 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.318841 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.315809 10789 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.321450 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.321532 10848 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.322072 10669 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.322227 10848 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:05.323401 10848 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.320433 10667 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.329780 10833 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.331841 10667 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:05.332665 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.334028 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.334553 10741 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.337019 10669 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:05.338773 10668 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.331672 10833 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.340734 10708 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.341737 10789 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.342248 10789 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:05.343134 10789 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.350248 10668 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:05.351441 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.351560 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:05.352662 10833 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.355124 10833 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:15:05.356714 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:05.360531 10785 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.360864 10785 ts_tablet_manager.cc:1403] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.002s
I20260709 13:15:05.361521 10833 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.364730 10785 raft_consensus.cc:359] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.366858 10785 raft_consensus.cc:385] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.367125 10785 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.367233 10784 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.367759 10784 ts_tablet_manager.cc:1403] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.143s	user 0.047s	sys 0.052s
I20260709 13:15:05.367800 10785 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.369984 10785 ts_tablet_manager.cc:1434] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:15:05.370916 10785 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.370719 10784 raft_consensus.cc:359] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.371366 10784 raft_consensus.cc:385] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.371690 10784 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.371426 10490 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.372339 10784 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.372962 10490 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.374555 10784 ts_tablet_manager.cc:1434] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:05.374747 10783 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.375173 10783 ts_tablet_manager.cc:1403] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.005s
I20260709 13:15:05.375625 10784 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.377805 10783 raft_consensus.cc:359] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.378509 10783 raft_consensus.cc:385] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.378790 10783 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.379508 10783 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.381577 10784 tablet_bootstrap.cc:654] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.385030 10783 ts_tablet_manager.cc:1434] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:05.385986 10783 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.389014 10785 tablet_bootstrap.cc:654] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.393190 10783 tablet_bootstrap.cc:654] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.392009 10492 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.397158 10784 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.397759 10784 ts_tablet_manager.cc:1403] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:15:05.398588 10809 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.399025 10809 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.401340 10809 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.401026 10784 raft_consensus.cc:359] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.402132 10784 raft_consensus.cc:385] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.402487 10784 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.403311 10784 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.404035 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.406771 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:05.408687 10632 leader_election.cc:343] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.405160 10741 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.410773 10784 ts_tablet_manager.cc:1434] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 13:15:05.411729 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.412091 10784 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.413285 10809 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.413797 10809 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.414417 10809 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.415138 10783 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.415602 10783 ts_tablet_manager.cc:1403] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 13:15:05.418679 10783 raft_consensus.cc:359] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.419325 10783 raft_consensus.cc:385] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.419591 10783 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.419787 10784 tablet_bootstrap.cc:654] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.420264 10783 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.427824 10783 ts_tablet_manager.cc:1434] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:05.428905 10783 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.436039 10783 tablet_bootstrap.cc:654] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.438092 10784 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.438552 10784 ts_tablet_manager.cc:1403] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:15:05.439227 10833 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.439685 10833 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.441718 10833 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.441561 10784 raft_consensus.cc:359] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.443913 10784 raft_consensus.cc:385] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.444273 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.444523 10784 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.444962 10668 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.445752 10784 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.446998 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.448136 10741 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.446143 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.450162 10833 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.450212 10784 ts_tablet_manager.cc:1434] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:05.450640 10833 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.451297 10833 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.452503 10784 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.452339 10809 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.455454 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:05.456887 10632 leader_election.cc:343] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.458804 10833 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.461599 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.462132 10668 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.463881 10784 tablet_bootstrap.cc:654] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.464346 10809 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.467809 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.468478 10741 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.469888 10783 tablet_bootstrap.cc:492] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.470325 10783 ts_tablet_manager.cc:1403] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.017s
I20260709 13:15:05.470518 10785 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.471135 10785 ts_tablet_manager.cc:1403] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.100s	user 0.039s	sys 0.019s
I20260709 13:15:05.472873 10783 raft_consensus.cc:359] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.473526 10783 raft_consensus.cc:385] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.473824 10783 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.473786 10785 raft_consensus.cc:359] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.474498 10785 raft_consensus.cc:385] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.474764 10785 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.474699 10783 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.475508 10785 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.476825 10783 ts_tablet_manager.cc:1434] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:15:05.477376 10785 ts_tablet_manager.cc:1434] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:05.477663 10783 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.478113 10668 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:05.479233 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.480015 10791 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.483453 10785 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.485715 10783 tablet_bootstrap.cc:654] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.500417 10791 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:05.509486 10741 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.510409 10785 tablet_bootstrap.cc:654] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.510641 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.511459 10809 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.509021 10791 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.512063 10809 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.513151 10809 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.518169 10833 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.519423 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.520135 10741 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.522747 10790 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.523566 10785 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.523998 10785 ts_tablet_manager.cc:1403] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.007s
I20260709 13:15:05.526512 10785 raft_consensus.cc:359] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.527173 10785 raft_consensus.cc:385] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.527444 10785 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.528256 10785 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.530308 10783 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.530756 10783 ts_tablet_manager.cc:1403] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.027s
I20260709 13:15:05.534273 10789 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.534730 10789 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.536674 10789 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.536809 10783 raft_consensus.cc:359] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.537580 10783 raft_consensus.cc:385] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.537904 10783 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.538625 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.538667 10783 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:05.540174 10706 leader_election.cc:343] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.539624 10490 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.541158 10783 ts_tablet_manager.cc:1434] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:05.542179 10783 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.544656 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:05.546058 10708 leader_election.cc:343] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.546463 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:05.547492 10789 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.549805 10489 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.551614 10809 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.553236 10783 tablet_bootstrap.cc:654] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.559590 10784 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.560125 10784 ts_tablet_manager.cc:1403] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.020s
I20260709 13:15:05.563318 10741 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:05.563539 10784 raft_consensus.cc:359] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.564410 10784 raft_consensus.cc:385] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.564808 10784 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.570261 10783 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.570683 10783 ts_tablet_manager.cc:1403] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 13:15:05.570876 10809 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.571326 10809 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.573035 10783 raft_consensus.cc:359] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.573299 10809 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.573709 10783 raft_consensus.cc:385] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.574012 10783 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.574359 10809 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.574357 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.575542 10741 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.575438 10809 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.574631 10783 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.576610 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.577171 10594 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.577330 10809 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.577600 10783 ts_tablet_manager.cc:1434] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:05.577884 10635 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.578598 10809 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.578840 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.578922 10809 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.579452 10809 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.581075 10783 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.564518 10785 ts_tablet_manager.cc:1434] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:15:05.582515 10785 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.579494 10594 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.584160 10791 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.584599 10791 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.584698 10632 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.586104 10790 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.586457 10790 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.586781 10790 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.587345 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.587949 10785 tablet_bootstrap.cc:654] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.588061 10668 raft_consensus.cc:2393] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:05.580112 10784 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.590873 10784 ts_tablet_manager.cc:1434] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:05.596747 10783 tablet_bootstrap.cc:654] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.597062 10791 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.598803 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.600395 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:05.596925 10790 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.603533 10833 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.603634 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.604285 10594 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.614334 10809 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.616837 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.617369 10592 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.622480 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.623083 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.625180 10592 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.626295 10632 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.627076 10865 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.627498 10865 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.628273 10785 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.628511 10784 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.628194 10865 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.628821 10785 ts_tablet_manager.cc:1403] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.018s
I20260709 13:15:05.629431 10841 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.629906 10841 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.630594 10833 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.631644 10785 raft_consensus.cc:359] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.632316 10785 raft_consensus.cc:385] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.632578 10785 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.633252 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.634006 10741 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.635196 10635 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.633343 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.631892 10841 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:05.637133 10632 leader_election.cc:343] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.637406 10841 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.637308 10785 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.637885 10841 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.638372 10790 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.638252 10841 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.638177 10784 tablet_bootstrap.cc:654] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.641525 10785 ts_tablet_manager.cc:1434] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:15:05.648505 10594 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.649876 10632 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.650938 10865 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.651472 10865 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.651574 10833 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.652246 10833 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.652469 10865 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.654117 10492 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.658267 10841 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.660830 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.661415 10741 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.662048 10809 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.664419 10783 tablet_bootstrap.cc:492] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.664844 10783 ts_tablet_manager.cc:1403] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.013s
I20260709 13:15:05.664781 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.665684 10743 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.667533 10783 raft_consensus.cc:359] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.667812 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.668216 10783 raft_consensus.cc:385] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.668494 10783 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.669668 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.670557 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:05.670807 10632 leader_election.cc:343] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.671171 10741 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.672062 10785 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.672293 10841 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.677105 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.669103 10783 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.681586 10783 ts_tablet_manager.cc:1434] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:05.682204 10783 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.704108 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.704888 10833 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.706079 10740 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:05.708530 10560 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:05.710351 10833 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.714125 10783 tablet_bootstrap.cc:654] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.715566 10789 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.719372 10784 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.719830 10784 ts_tablet_manager.cc:1403] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.036s
I20260709 13:15:05.716981 10743 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.724882 10784 raft_consensus.cc:359] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.725419 10784 raft_consensus.cc:385] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.725641 10784 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.726123 10741 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.728014 10784 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.728530 10635 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.729090 10490 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.729812 10865 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.730104 10833 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.730284 10784 ts_tablet_manager.cc:1434] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:15:05.730404 10865 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.731184 10784 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.731309 10865 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.727383 10785 tablet_bootstrap.cc:654] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.738920 10783 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.739392 10783 ts_tablet_manager.cc:1403] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 13:15:05.750003 10784 tablet_bootstrap.cc:654] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.751048 10783 raft_consensus.cc:359] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.751770 10783 raft_consensus.cc:385] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.752283 10783 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.753126 10783 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.754568 10785 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.755009 10785 ts_tablet_manager.cc:1403] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.002s
I20260709 13:15:05.755239 10783 ts_tablet_manager.cc:1434] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.002s
I20260709 13:15:05.756083 10783 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.759729 10785 raft_consensus.cc:359] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.760425 10785 raft_consensus.cc:385] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.760726 10785 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.761723 10783 tablet_bootstrap.cc:654] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.761376 10785 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.764089 10785 ts_tablet_manager.cc:1434] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:05.766542 10785 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.770108 10784 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.770535 10784 ts_tablet_manager.cc:1403] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.013s
I20260709 13:15:05.772869 10784 raft_consensus.cc:359] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.773492 10784 raft_consensus.cc:385] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.773761 10784 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.774456 10784 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.775300 10785 tablet_bootstrap.cc:654] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.777057 10784 ts_tablet_manager.cc:1434] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:05.777932 10784 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.782611 10848 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.782404 10492 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.784945 10784 tablet_bootstrap.cc:654] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.787837 10809 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.788370 10809 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.790452 10809 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.791967 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:05.793597 10632 leader_election.cc:343] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.794425 10833 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:05.797283 10785 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.797833 10785 ts_tablet_manager.cc:1403] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.014s
I20260709 13:15:05.801259 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.801941 10741 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.802246 10785 raft_consensus.cc:359] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.803057 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.804535 10809 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.804929 10809 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.805289 10809 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.809525 10784 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.809945 10784 ts_tablet_manager.cc:1403] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 13:15:05.812384 10784 raft_consensus.cc:359] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.812996 10784 raft_consensus.cc:385] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.813251 10784 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.813644 10809 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.814071 10784 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.816349 10784 ts_tablet_manager.cc:1434] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:05.816789 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:05.818145 10632 leader_election.cc:343] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.820307 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.820809 10741 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.821570 10784 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.823768 10809 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.803246 10785 raft_consensus.cc:385] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.824420 10785 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.825250 10785 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.827162 10785 ts_tablet_manager.cc:1434] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:15:05.828019 10785 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.828538 10791 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.833859 10741 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.834924 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:05.836375 10809 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.836831 10809 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.837548 10809 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.842312 10783 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.842734 10783 ts_tablet_manager.cc:1403] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.002s
I20260709 13:15:05.845466 10785 tablet_bootstrap.cc:654] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.845813 10784 tablet_bootstrap.cc:654] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.845122 10783 raft_consensus.cc:359] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.852941 10783 raft_consensus.cc:385] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.853356 10783 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.856608 10785 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.857033 10785 ts_tablet_manager.cc:1403] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:15:05.857869 10784 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.858261 10784 ts_tablet_manager.cc:1403] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.007s
I20260709 13:15:05.859503 10785 raft_consensus.cc:359] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.860153 10785 raft_consensus.cc:385] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.860402 10785 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.861168 10784 raft_consensus.cc:359] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.861888 10784 raft_consensus.cc:385] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.861522 10817 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:05.862198 10784 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.863082 10784 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.865486 10784 ts_tablet_manager.cc:1434] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:05.865425 10783 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.866394 10784 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:05.867226 10893 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.867735 10893 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.869494 10833 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.869347 10785 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.870149 10789 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.870584 10789 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.869910 10833 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.872790 10833 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.873219 10784 tablet_bootstrap.cc:654] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.873258 10789 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.874265 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.876196 10743 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.876858 10893 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.877094 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.877754 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.877904 10669 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:05.880647 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:05.881449 10923 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.881837 10923 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.881716 10789 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.882313 10923 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.882382 10789 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.882903 10789 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.887132 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.887756 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:05.888497 10559 leader_election.cc:343] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.890578 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.892606 10489 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.890592 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:05.897907 10706 leader_election.cc:343] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.906906 10741 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:05.907831 10783 ts_tablet_manager.cc:1434] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.015s
I20260709 13:15:05.908730 10783 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.910709 10809 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.911521 10809 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.912292 10560 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:05.914408 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.915012 10591 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.916198 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.916504 10784 tablet_bootstrap.cc:492] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:05.916625 10848 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:05.917150 10904 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.917591 10904 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.917711 10817 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.918243 10904 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.918802 10783 tablet_bootstrap.cc:654] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.917707 10784 ts_tablet_manager.cc:1403] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.007s
I20260709 13:15:05.918612 10817 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.920910 10817 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.921761 10922 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.922312 10789 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.928964 10785 ts_tablet_manager.cc:1434] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:15:05.936043 10784 raft_consensus.cc:359] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.948215 10841 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:05.936161 10904 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.938539 10809 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.940369 10785 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:05.949020 10865 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:05.948567 10784 raft_consensus.cc:385] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.949759 10784 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.952039 10784 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.952720 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:05.953245 10593 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.954897 10784 ts_tablet_manager.cc:1434] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:15:05.943646 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:05.946378 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.956586 10669 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:05.956724 10785 tablet_bootstrap.cc:654] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.925262 10789 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:05.946995 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.957439 10791 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.957753 10741 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:05.957890 10791 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.946772 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:05.958938 10668 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.960227 10791 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.961539 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:05.962131 10669 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.963356 10559 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.965090 10791 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.965487 10791 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.966070 10791 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.967522 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:05.968071 10741 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:05.968269 10668 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:05.951340 10904 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:05.946713 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:05.971400 10706 leader_election.cc:343] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.974725 10783 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:05.975143 10783 ts_tablet_manager.cc:1403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.026s
I20260709 13:15:05.975557 10593 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:05.976516 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:05.977268 10865 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.977769 10865 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:05.977607 10783 raft_consensus.cc:359] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.978255 10783 raft_consensus.cc:385] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.978503 10783 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.978566 10865 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.979275 10783 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.981194 10783 ts_tablet_manager.cc:1434] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:05.982205 10783 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:05.988932 10783 tablet_bootstrap.cc:654] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.992673 10785 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:05.993232 10785 ts_tablet_manager.cc:1403] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:15:05.993983 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:05.994614 10741 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.997157 10785 raft_consensus.cc:359] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:05.997903 10785 raft_consensus.cc:385] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.998232 10785 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.999014 10785 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.001142 10785 ts_tablet_manager.cc:1434] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:06.002110 10785 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.002353 10489 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.939853 10922 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.953367 10923 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.006449 10784 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.011837 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:06.015868 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.020931 10848 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.021469 10848 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:06.022318 10848 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.013695 10865 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.024649 10741 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:06.024443 10865 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.030464 10791 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.029466 10789 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.042363 10865 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.042464 10922 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.050920 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.051239 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.050910 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:06.051738 10593 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:06.051890 10740 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.052337 10741 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.052774 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:06.053205 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:06.053895 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.054827 10791 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.055496 10669 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.056932 10667 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.061626 10783 tablet_bootstrap.cc:492] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.062074 10783 ts_tablet_manager.cc:1403] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.014s
I20260709 13:15:06.063316 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:06.064052 10740 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.068602 10923 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.071142 10783 raft_consensus.cc:359] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.071736 10783 raft_consensus.cc:385] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.072002 10783 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.072693 10783 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.073766 10669 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:06.074863 10865 raft_consensus.cc:2764] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:06.075104 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:06.075500 10790 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.076225 10923 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.076664 10923 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:06.077474 10923 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.074750 10783 ts_tablet_manager.cc:1434] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:06.080029 10783 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.088567 10667 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:06.093050 10785 tablet_bootstrap.cc:654] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.099632 10559 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:06.100726 10791 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.101200 10791 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:06.101998 10791 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.106758 10784 tablet_bootstrap.cc:654] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.105822 10489 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.123445 10740 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:06.129978 10791 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:06.135319 10783 tablet_bootstrap.cc:654] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.135463 10741 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:06.145655 10785 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.146210 10790 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.147524 10785 ts_tablet_manager.cc:1403] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.011s
I20260709 13:15:06.146601 10491 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.170686 10785 raft_consensus.cc:359] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.172096 10785 raft_consensus.cc:385] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.172447 10785 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.173166 10785 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.180936 10785 ts_tablet_manager.cc:1434] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:15:06.187666 10865 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.189054 10841 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.193981 10925 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.194550 10925 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.197430 10925 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:06.201642 10904 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.202980 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.204056 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:06.206306 10706 leader_election.cc:343] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.206723 10783 tablet_bootstrap.cc:492] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.207144 10783 ts_tablet_manager.cc:1403] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.016s
W20260709 13:15:06.207553 10708 leader_election.cc:343] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.208878 10904 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:06.209791 10783 raft_consensus.cc:359] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.211146 10490 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.221295 10783 raft_consensus.cc:385] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.221731 10783 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.212747 10785 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.213778 10784 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.222798 10784 ts_tablet_manager.cc:1403] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.217s	user 0.010s	sys 0.016s
I20260709 13:15:06.223037 10904 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.222993 10783 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.223737 10904 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.225071 10783 ts_tablet_manager.cc:1434] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:15:06.225921 10783 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.225461 10784 raft_consensus.cc:359] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.226753 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.226768 10784 raft_consensus.cc:385] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.227588 10593 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.228574 10632 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:06.228034 10784 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.229305 10790 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.229710 10790 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.229486 10784 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.230173 10790 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.231480 10784 ts_tablet_manager.cc:1434] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:06.231348 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.229756 10904 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.232932 10784 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.231937 10740 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.234311 10783 tablet_bootstrap.cc:654] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.237885 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:06.250407 10925 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.272606 10785 tablet_bootstrap.cc:654] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:06.264186 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57720.7us
W20260709 13:15:06.292030 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.303665 10841 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.306499 10841 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.306919 10841 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.313160 10784 tablet_bootstrap.cc:654] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.316279 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:06.318177 10632 leader_election.cc:343] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.317591 10790 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.319396 10841 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.321875 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.322288 10740 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.323048 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.323632 10841 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.323982 10841 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.329660 10841 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.330583 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:06.330893 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:06.331141 10592 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.332444 10790 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.334447 10740 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.336014 10785 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.336432 10785 ts_tablet_manager.cc:1403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.124s	user 0.027s	sys 0.029s
I20260709 13:15:06.337574 10841 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.340101 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:06.340914 10740 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
W20260709 13:15:06.341346 10632 leader_election.cc:343] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.343722 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:06.344189 10841 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.345588 10785 raft_consensus.cc:359] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.344748 10841 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.346205 10785 raft_consensus.cc:385] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.346524 10785 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.346446 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:06.347198 10785 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.348285 10841 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:06.341346 10592 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:06.349464 10785 ts_tablet_manager.cc:1434] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:15:06.350310 10785 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.347119 10743 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.351259 10783 tablet_bootstrap.cc:492] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.351676 10783 ts_tablet_manager.cc:1403] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.010s
I20260709 13:15:06.355046 10841 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.378363 10791 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.378829 10791 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.380990 10791 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.382380 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.382478 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.386652 10668 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:06.388105 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:06.389420 10791 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.390820 10743 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:06.391891 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.392788 10865 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.393380 10865 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:06.393919 10783 raft_consensus.cc:359] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.394552 10783 raft_consensus.cc:385] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.394817 10783 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.395279 10923 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.395421 10783 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.395714 10923 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.397392 10785 tablet_bootstrap.cc:654] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.397859 10923 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.399845 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.400636 10741 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:06.402787 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:06.403851 10893 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.404286 10893 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.404680 10893 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.406005 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:06.408429 10559 leader_election.cc:343] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.394133 10865 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.409776 10785 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.410197 10785 ts_tablet_manager.cc:1403] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:15:06.411301 10791 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.412683 10785 raft_consensus.cc:359] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.415365 10785 raft_consensus.cc:385] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.415634 10785 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.415768 10925 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.416406 10785 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.418403 10893 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.420428 10785 ts_tablet_manager.cc:1434] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:06.421084 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:06.421377 10785 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.422345 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:06.422464 10559 leader_election.cc:343] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.420315 10841 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.422901 10743 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.427891 10784 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.428292 10784 ts_tablet_manager.cc:1403] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.196s	user 0.021s	sys 0.002s
I20260709 13:15:06.430850 10743 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:06.439646 10783 ts_tablet_manager.cc:1434] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.088s	user 0.023s	sys 0.041s
I20260709 13:15:06.439762 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:06.440739 10791 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.420332 10893 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.429252 10785 tablet_bootstrap.cc:654] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.436671 10491 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.437649 10925 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.441378 10791 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:06.460862 10791 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.430814 10784 raft_consensus.cc:359] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.442138 10783 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.464617 10784 raft_consensus.cc:385] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:06.459985 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:06.464932 10784 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.469671 10784 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.475206 10784 ts_tablet_manager.cc:1434] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:15:06.476383 10784 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.476379 10783 tablet_bootstrap.cc:654] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.481470 10809 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:06.484144 10785 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.484694 10785 ts_tablet_manager.cc:1403] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 13:15:06.488006 10785 raft_consensus.cc:359] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.488848 10785 raft_consensus.cc:385] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.489173 10785 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.489986 10785 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.506649 10491 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.509711 10922 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:06.511729 10785 ts_tablet_manager.cc:1434] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:15:06.525645 10922 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.526428 10922 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.531006 10925 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.531344 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.531528 10925 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.535771 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.537036 10785 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.541419 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:06.542522 10953 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.542793 10922 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.545051 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:06.546912 10706 leader_election.cc:343] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.548704 10785 tablet_bootstrap.cc:654] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.548633 10925 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:06.501612 10893 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:15:06.562150 10893 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.574568 10953 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.583410 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.584161 10666 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:06.585908 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.587486 10925 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.588032 10925 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.588384 10925 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.602344 10784 tablet_bootstrap.cc:654] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.604346 10925 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.609874 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:06.610648 10665 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.610838 10785 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.611558 10785 ts_tablet_manager.cc:1403] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.075s	user 0.030s	sys 0.024s
I20260709 13:15:06.614607 10785 raft_consensus.cc:359] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.615763 10785 raft_consensus.cc:385] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.617039 10785 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.618973 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:06.621106 10706 leader_election.cc:343] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.618955 10785 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.624739 10925 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:06.627269 10785 ts_tablet_manager.cc:1434] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:15:06.633791 10785 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.626164 10665 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:06.638018 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.639510 10925 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.640250 10925 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:06.641304 10925 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.654711 10594 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.657073 10785 tablet_bootstrap.cc:654] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.670307 10490 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.683444 10926 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.684067 10926 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.688410 10926 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:06.689086 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.689471 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:06.690713 10708 leader_election.cc:343] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:06.691205 10706 leader_election.cc:343] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.691769 10706 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:06.693176 10926 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.712579 10785 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.714708 10783 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.715159 10783 ts_tablet_manager.cc:1403] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.273s	user 0.044s	sys 0.072s
I20260709 13:15:06.716786 10784 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.717237 10784 ts_tablet_manager.cc:1403] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.004s
I20260709 13:15:06.717694 10783 raft_consensus.cc:359] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.718377 10783 raft_consensus.cc:385] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.718642 10783 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.719288 10783 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.720211 10784 raft_consensus.cc:359] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.713044 10785 ts_tablet_manager.cc:1403] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.013s
I20260709 13:15:06.721643 10784 raft_consensus.cc:385] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.721990 10784 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.721284 10783 ts_tablet_manager.cc:1434] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:06.722664 10784 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.723775 10785 raft_consensus.cc:359] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.724400 10785 raft_consensus.cc:385] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.723506 10783 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.724649 10785 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.725179 10784 ts_tablet_manager.cc:1434] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:06.725560 10785 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.726074 10784 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.727473 10785 ts_tablet_manager.cc:1434] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:15:06.728283 10785 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.730793 10783 tablet_bootstrap.cc:654] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.730527 10489 catalog_manager.cc:5697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.731567 10784 tablet_bootstrap.cc:654] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.731921 10809 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.732372 10809 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.734009 10785 tablet_bootstrap.cc:654] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.734704 10809 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.736665 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.737514 10740 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.739500 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.740943 10783 tablet_bootstrap.cc:492] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.741359 10783 ts_tablet_manager.cc:1403] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:15:06.742277 10784 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.742219 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:06.742758 10784 ts_tablet_manager.cc:1403] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:15:06.743153 10865 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.743534 10865 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:06.743782 10632 leader_election.cc:343] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.743865 10865 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.744247 10783 raft_consensus.cc:359] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.744856 10783 raft_consensus.cc:385] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.745096 10783 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.748575 10783 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.750141 10784 raft_consensus.cc:359] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.750782 10784 raft_consensus.cc:385] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.751312 10785 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.751708 10785 ts_tablet_manager.cc:1403] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.008s
I20260709 13:15:06.754078 10785 raft_consensus.cc:359] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.754702 10785 raft_consensus.cc:385] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.754987 10785 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.751024 10784 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.755658 10785 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.755956 10784 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.758016 10784 ts_tablet_manager.cc:1434] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:15:06.758847 10784 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.759615 10783 ts_tablet_manager.cc:1434] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:15:06.760416 10783 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.764137 10784 tablet_bootstrap.cc:654] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.765118 10865 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.765759 10783 tablet_bootstrap.cc:654] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.767565 10865 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.769910 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:06.770550 10740 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.770612 10785 ts_tablet_manager.cc:1434] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:06.771842 10785 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.778439 10785 tablet_bootstrap.cc:654] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.781693 10740 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:06.783645 10783 tablet_bootstrap.cc:492] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.785058 10783 ts_tablet_manager.cc:1403] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:15:06.785421 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:06.788753 10632 leader_election.cc:343] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.789546 10783 raft_consensus.cc:359] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.790418 10783 raft_consensus.cc:385] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.790706 10783 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.792141 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.792169 10783 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.793648 10865 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:06.793802 10785 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:06.794167 10865 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:06.794330 10785 ts_tablet_manager.cc:1403] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:15:06.794890 10783 ts_tablet_manager.cc:1434] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:06.795835 10783 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.796167 10865 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.796836 10785 raft_consensus.cc:359] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.797376 10785 raft_consensus.cc:385] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.797623 10785 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.801846 10784 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.798247 10785 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.802304 10784 ts_tablet_manager.cc:1403] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
I20260709 13:15:06.804975 10783 tablet_bootstrap.cc:654] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.805080 10784 raft_consensus.cc:359] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.808494 10784 raft_consensus.cc:385] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.808753 10784 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.809479 10785 ts_tablet_manager.cc:1434] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:06.809346 10784 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.810236 10785 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:06.811228 10784 ts_tablet_manager.cc:1434] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:06.811569 10594 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.812057 10784 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.824775 10492 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.833616 10841 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.836874 10865 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.838312 10785 tablet_bootstrap.cc:654] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.841657 10893 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.842294 10893 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.847205 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.847962 10665 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:06.848187 10893 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.849553 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.852054 10925 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.852244 10841 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:06.852612 10925 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.855273 10925 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:06.856208 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:06.857254 10791 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.863507 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.864221 10893 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.864707 10893 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:06.865406 10706 leader_election.cc:343] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.866407 10783 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.866726 10893 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.866904 10783 ts_tablet_manager.cc:1403] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.027s
I20260709 13:15:06.866950 10865 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.867560 10865 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.867671 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.870095 10783 raft_consensus.cc:359] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.870764 10783 raft_consensus.cc:385] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.870906 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:06.871094 10783 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.872355 10865 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.872215 10783 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:06.872977 10708 leader_election.cc:343] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.873643 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:06.874636 10783 ts_tablet_manager.cc:1434] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:06.875202 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.875602 10783 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:06.875605 10926 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.878485 10923 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.882329 10783 tablet_bootstrap.cc:654] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:06.875946 10740 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:06.883426 10784 tablet_bootstrap.cc:654] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:06.884771 10559 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.884668 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.885524 10739 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.886937 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:06.887616 10591 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.889117 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:06.890512 10865 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.886965 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:06.891096 10865 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.891705 10865 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.893600 10923 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.900476 10784 tablet_bootstrap.cc:492] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:06.900969 10784 ts_tablet_manager.cc:1403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.001s
I20260709 13:15:06.903096 10841 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.906029 10784 raft_consensus.cc:359] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.906729 10784 raft_consensus.cc:385] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:06.907006 10784 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:06.907652 10784 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.908633 10809 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.909091 10809 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.912050 10809 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:06.913944 10784 ts_tablet_manager.cc:1434] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:06.915184 10784 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:06.922360 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:06.923893 10632 leader_election.cc:343] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:06.926863 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:06.927485 10740 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:06.928606 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:06.929356 10809 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:06.929713 10809 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.930058 10809 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.931326 10791 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.933184 10923 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:06.948690 10865 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:06.954161 10783 tablet_bootstrap.cc:492] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:06.954648 10783 ts_tablet_manager.cc:1403] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.018s
I20260709 13:15:07.031482 10783 raft_consensus.cc:359] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:07.032193 10783 raft_consensus.cc:385] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.032475 10783 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.033152 10783 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:07.036849 10785 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:07.039187 10785 ts_tablet_manager.cc:1403] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.008s
I20260709 13:15:07.044512 10783 ts_tablet_manager.cc:1434] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.002s
I20260709 13:15:07.045698 10783 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:07.050141 10785 raft_consensus.cc:359] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:07.051232 10785 raft_consensus.cc:385] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.051555 10785 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.054728 10809 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:07.071149 10809 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:07.073904 10784 tablet_bootstrap.cc:654] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.082832 10865 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:08.348874  9494 debug-util.cc:398] Leaking SignalData structure 0x7b080000fa60 after lost signal to thread 10635
W20260709 13:15:08.349539  9494 kernel_stack_watchdog.cc:198] Thread 10635 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 141ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:15:08.451538 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000369a0 after lost signal to thread 9492
I20260709 13:15:09.141739 10784 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.142340 10784 ts_tablet_manager.cc:1403] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 2.227s	user 0.026s	sys 0.010s
I20260709 13:15:09.145536 10784 raft_consensus.cc:359] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.146166 10784 raft_consensus.cc:385] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.146450 10784 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.147184 10784 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.149829 10784 ts_tablet_manager.cc:1434] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:09.150796 10784 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.156962 10784 tablet_bootstrap.cc:654] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.168478 10784 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.169024 10784 ts_tablet_manager.cc:1403] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:15:09.172303 10784 raft_consensus.cc:359] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.173089 10784 raft_consensus.cc:385] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.173408 10784 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.174113 10784 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.176256 10784 ts_tablet_manager.cc:1434] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:09.177112 10784 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.184036 10784 tablet_bootstrap.cc:654] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.195111 10784 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.195618 10784 ts_tablet_manager.cc:1403] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 13:15:09.208050 10784 raft_consensus.cc:359] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.208837 10784 raft_consensus.cc:385] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.209141 10784 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.209884 10784 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.212360 10784 ts_tablet_manager.cc:1434] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:09.220326 10784 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.227682 10784 tablet_bootstrap.cc:654] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.248045 10784 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.248540 10784 ts_tablet_manager.cc:1403] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:15:09.253866 10784 raft_consensus.cc:359] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.254642 10784 raft_consensus.cc:385] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.254951 10784 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.255647 10784 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.320968 10784 ts_tablet_manager.cc:1434] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.002s
I20260709 13:15:09.322301 10784 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
W20260709 13:15:09.327849 10926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.087s	user 0.090s	sys 0.079s
W20260709 13:15:09.328316 10926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.088s	user 0.090s	sys 0.079s
I20260709 13:15:09.328364 10784 tablet_bootstrap.cc:654] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.338044 10926 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.338511 11002 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.338526 10926 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.339103 11002 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.340720 10926 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.341954 11002 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.345875 11003 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.346436 11003 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.348928 11003 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:09.377738  9494 debug-util.cc:398] Leaking SignalData structure 0x7b080000fac0 after lost signal to thread 10635
W20260709 13:15:09.378925  9494 kernel_stack_watchdog.cc:198] Thread 10635 stuck at /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:249 for 141ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:15:09.385281 11002 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.386886 11002 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.388701 10784 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.389716 10784 ts_tablet_manager.cc:1403] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.068s	user 0.003s	sys 0.018s
I20260709 13:15:09.393795 11002 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.395061 10784 raft_consensus.cc:359] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.395987 10784 raft_consensus.cc:385] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.396281 10784 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.397089 10784 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.402248 10784 ts_tablet_manager.cc:1434] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.002s
I20260709 13:15:09.404148 10784 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.411995 10784 tablet_bootstrap.cc:654] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.418694 10784 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.419235 10784 ts_tablet_manager.cc:1403] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:15:09.422327 10784 raft_consensus.cc:359] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.423035 10784 raft_consensus.cc:385] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.423388 10784 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.424144 10922 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.424113 10784 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.424917 10922 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.426792 10784 ts_tablet_manager.cc:1434] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:09.427969 10922 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.428337 10784 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.428566 10922 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.429369 10922 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.431583 10922 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.431727 10953 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.432139 10922 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.432483 10953 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.432871 10922 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.434268 10953 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.434681 10953 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.434866 10922 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.435571 10784 tablet_bootstrap.cc:654] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.435238 10953 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.437058 10953 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.441159 10784 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.441752 10784 ts_tablet_manager.cc:1403] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:15:09.444766 10784 raft_consensus.cc:359] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.445719 10784 raft_consensus.cc:385] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.446110 10784 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.446789 10784 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.450196 10784 ts_tablet_manager.cc:1434] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:15:09.451738 10784 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.459324 10784 tablet_bootstrap.cc:654] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.460178 10926 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.460978 10926 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.463747 10926 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.465389 11003 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.466118 11003 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.466637 11002 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.467435 11002 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.468698 11003 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.469661 11002 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.470170 11002 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.469193 11003 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.470745 11002 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.471457 11003 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.474875 11002 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.474576 10926 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.477469 10926 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:09.479689 10926 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:09.473480 11003 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.481158 11003 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.483285 11003 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.485144 11003 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.488951 10784 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.489440 10784 ts_tablet_manager.cc:1403] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.019s
I20260709 13:15:09.492276 10784 raft_consensus.cc:359] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.492959 10784 raft_consensus.cc:385] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.493248 10784 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.494000 10784 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.497037 10784 ts_tablet_manager.cc:1434] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:09.498420 10784 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.503927 10784 tablet_bootstrap.cc:654] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.509845 10784 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.510267 10784 ts_tablet_manager.cc:1403] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:15:09.513398 10784 raft_consensus.cc:359] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.514323 10784 raft_consensus.cc:385] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.514669 10784 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.515468 10784 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.518417 10784 ts_tablet_manager.cc:1434] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:15:09.519691 10784 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
W20260709 13:15:09.522400 10635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.453s	user 0.018s	sys 0.016s
W20260709 13:15:09.522921 10635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.455s	user 0.018s	sys 0.016s
W20260709 13:15:09.523380 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 2.46089e+06us
I20260709 13:15:09.526578 10784 tablet_bootstrap.cc:654] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.530969 10922 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.533604 10922 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.541450 11010 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.545614 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:09.546722 10739 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.528947 10953 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.548498 10953 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.553900 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.554736 10592 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:09.555969 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.556574 10592 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:09.542712 10922 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.553331 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.562355 10922 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.562875 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 77) took 2723 ms. Trace:
I20260709 13:15:09.563069 11009 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.565598 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:09.568369 10585 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:09.542260 11010 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.569204 11009 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.601116 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.580200 10926 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.576627 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.597731 11003 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.580474 10740 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.607667 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.608561 10585 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:09.603266 10926 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.600062 10953 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.613456 11003 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.614974 10926 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.615067 11002 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.615310 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 79) took 2530 ms. Trace:
W20260709 13:15:09.616084 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080013b6c0 after lost signal to thread 10526
I20260709 13:15:09.606551 10922 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.616592 11010 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.620052 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.568826 10594 rpcz_store.cc:276] 0709 13:15:06.839281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.840961 (+  1680us) service_pool.cc:224] Handling call
0709 13:15:06.841277 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.869182 (+ 27905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.869215 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.869673 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.964303 (+ 94630us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:15:07.029889 (+ 65586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.032568 (+  2679us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.562472 (+2529904us) raft_consensus.cc:1685] finished
0709 13:15:09.562509 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.562680 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6401,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":91896,"threads_started":1,"wal-append.queue_time_us":167697,"wal-append.run_cpu_time_us":2392,"wal-append.run_wall_time_us":1052111}
I20260709 13:15:09.621210 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.575594 11012 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.615187 11011 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.628908 10791 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.629279 10790 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.617268 10926 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.632099 10790 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.618309 10741 rpcz_store.cc:276] 0709 13:15:07.087345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.088142 (+   797us) service_pool.cc:224] Handling call
0709 13:15:07.088466 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.088640 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:07.088673 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.089941 (+  1268us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:07.090728 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.096265 (+  5537us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.615043 (+2518778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:09.632136 10791 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.635829 10922 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.635917 10998 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:09.637410 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59895.9us
I20260709 13:15:09.627643 10953 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.637362 10926 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.638518 11002 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.644177 10926 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.636708 10998 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } }
I20260709 13:15:09.643914 10790 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.652578 10784 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:09.655257 10784 ts_tablet_manager.cc:1403] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.136s	user 0.027s	sys 0.036s
I20260709 13:15:09.652576 11015 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.637212 11012 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.648697 10791 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.649720 11003 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.646423 11011 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.650375 10953 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.661216 10790 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.667577 11017 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.667856 11002 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.668068 11012 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.668434 11017 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.671140 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.672117 10587 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:09.666540 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.681412 10739 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:09.676045 10790 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.679064 11003 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.685573 10594 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:09.691329 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.693473 10738 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.680487 11002 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.698927 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.703683 10953 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.704509 11002 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.705760 10490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 64) took 2781 ms. Trace:
I20260709 13:15:09.706130 10490 rpcz_store.cc:276] 0709 13:15:06.924492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.935426 (+ 10934us) service_pool.cc:224] Handling call
0709 13:15:09.705530 (+2770104us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:15:09.706717 10790 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.707811 11002 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.694680 11009 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.698376 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.713816 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.714586 10735 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:09.698418 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.711741 10740 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:09.714269 11011 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.708930 11003 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.720328 10784 raft_consensus.cc:359] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.720677 10706 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.721032 10784 raft_consensus.cc:385] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.721439 10784 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.721720 11018 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.717680 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.722062 10784 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.723868 10734 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.718607 11017 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.686861 11015 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.727988 10784 ts_tablet_manager.cc:1434] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:15:09.728840 10998 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:09.729350 11020 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.729955 10784 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:09.722738 11002 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.730015 11020 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.742663 11003 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.734647 10783 tablet_bootstrap.cc:654] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.743188 11003 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.743764 11003 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.735868 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.736116 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.736843 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.737793 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.738210 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.738539 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.748600 10893 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.748991 10893 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.749310 10893 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.746909 10740 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.749297 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.750399 10926 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.762616 10734 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.763388 11015 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.763947 11002 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.766958 11002 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.767740 11002 raft_consensus.cc:2764] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:09.751008 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.771027 11020 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.757526 11011 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.724126 11018 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.776467 10998 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.777340 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.777734 10998 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.778738 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.779631 10560 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.780224 10998 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.780490 11009 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.780916 11009 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.773552 10735 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.781212 11015 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.773715 11011 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.781674 11015 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.781935 11011 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.782051 11015 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.782193 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.782706 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.783439 10953 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.783754 10953 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.784072 10953 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.781292 11009 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.787683 10998 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.788156 10998 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.790136 10998 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.792194 11015 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.794235 11015 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.795346 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:09.795931 10739 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:09.770035 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 48073.4us
I20260709 13:15:09.799919 10809 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.800475 10790 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.809617 11003 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.800524 10809 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.811488 10706 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.800405 10735 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.811559 10790 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.817307 11019 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.800137 11018 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.820938 11018 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.821350 11018 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.821743 11018 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.821841 10809 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.822005 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.822330 10809 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.826973 10809 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.817925 11019 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.829252 10706 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.839684 10785 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.841629 11001 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.832187 10926 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.844848 11017 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.844978 11016 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.845412 11017 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.842810 11001 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.830078 10953 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.849879 10809 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.851387 10809 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.853631 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.853681 10809 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.844506 10893 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.856266 11024 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:09.845433 11016 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.851840 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.863174 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.867079 10589 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:09.859762 11016 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.872248 10809 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.864959 10738 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:09.867084 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.787s	user 0.014s	sys 0.014s
I20260709 13:15:09.874348 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:09.876412 10634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.815s	user 0.035s	sys 0.036s
I20260709 13:15:09.870420 10893 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.867604 10736 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:09.881819 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:09.882386 10743 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.885988 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:09.882007 10634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.821s	user 0.035s	sys 0.037s
I20260709 13:15:09.865480 10706 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.878795 11015 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.888978 11012 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.895287 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.896711 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:09.893600 11012 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.897667 10865 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.898214 10865 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.899427 10785 ts_tablet_manager.cc:1434] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 2.860s	user 0.017s	sys 0.010s
W20260709 13:15:09.899808 10785 ts_tablet_manager.cc:1467] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Tablet startup took 2860ms
I20260709 13:15:09.900631 10865 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.897681 11012 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.902383 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:09.881263 11009 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.890472 10739 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:09.890992 11027 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.892267 11015 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.901681 10953 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:09.925407 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800242820 after lost signal to thread 10618
I20260709 13:15:09.925287 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.926016 10669 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
W20260709 13:15:09.926481 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08002469c0 after lost signal to thread 10693
W20260709 13:15:09.926752 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800246980 after lost signal to thread 10694
W20260709 13:15:09.927636 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080004eec0 after lost signal to thread 10767
W20260709 13:15:09.928308 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000cce40 after lost signal to thread 10936
W20260709 13:15:09.928781 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800179920 after lost signal to thread 10964
I20260709 13:15:09.920097 11024 raft_consensus.cc:2764] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:09.919912 11015 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.917016 11016 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:09.910095 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 55051.2us
I20260709 13:15:09.938215 10560 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.933750 10743 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:09.950834 10706 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.937852 11014 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.952085 10998 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.955340 11007 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.955835 11007 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.956224 11007 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:09.900207 10785 ts_tablet_manager.cc:1469] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Trace:
0709 13:15:04.071576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.071683 (+   107us) service_pool.cc:224] Handling call
0709 13:15:04.078321 (+  6638us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:04.078403 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:04.097387 (+ 18984us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:04.150402 (+ 53015us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:04.150786 (+   384us) inbound_call.cc:177] Queueing success response
0709 13:15:06.809961 (+2659175us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:07.039476 (+229515us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:07.039893 (+   417us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:07.040668 (+   775us) tablet_replica.cc:280] Starting consensus
0709 13:15:09.839222 (+2798554us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4c001ffe00. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255585a20 00007f4255596a29 00007f425555c644 00007f4255583f2d 00007f4255583b93 00007f42572b418b 00007f42572b4cb5 00007f42572aff30 00007f42572aec40 00007f425acabb2e 00007f425c2cdd8a
0709 13:15:09.890343 (+ 51121us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b54001cd254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b012e 00007f42572aec8d 00007f425acabb2e 00007f425c2cdd8a 00007f425c2e1d01 00007f425c2e1ca9 00007f425c2e1c39 00007f425c2e1c01 00007f425c2e0edd 000000000038f354
Metrics: {"mutex_wait_us":4300,"raft.queue_time_us":11164,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1566,"spinlock_wait_cycles":22308096,"tablet-open.queue_time_us":2659246}
I20260709 13:15:09.957998 10791 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.958570 10923 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.958846 10791 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.959169 10923 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:09.958971 10785 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:09.946247 10865 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:09.961648 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.967103 10783 tablet_bootstrap.cc:492] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:09.967568 10783 ts_tablet_manager.cc:1403] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 2.922s	user 0.027s	sys 0.025s
I20260709 13:15:09.963943 11019 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.961066 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.967517 10893 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.968786 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:09.968971 10953 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:09.952041 11014 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.969156 10893 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:09.965061 11016 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:09.964908 10923 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.954160 10998 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.965611 10791 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.975580 10998 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.930696 11027 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.977496 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:09.978567 11017 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.978982 10791 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:09.979341 10791 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:09.979704 10791 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.982002 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.982820 10669 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:09.983263 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:09.965967 10706 leader_election.cc:343] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.970793 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:09.970687 10893 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.969516 10953 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.950018 11018 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:09.983923 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.996331 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.988691 10589 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.997548 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:09.999526 10664 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:09.999577 11018 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.000476 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.001075 10666 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:10.003288 10790 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:09.972067 10865 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.006539 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.014673 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.009868 11001 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.014823 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.007987 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.018117 10590 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.018342 10953 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.015499 10666 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:10.011595 10790 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.025756 11009 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.025972 10665 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.027179 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.030196 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.030452 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.030874 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.031457 10664 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:10.033074 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.019455 10783 raft_consensus.cc:359] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.036981 10783 raft_consensus.cc:385] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.038334 10593 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.039427 10783 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.039429 10790 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.033776 11011 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.042459 10784 tablet_bootstrap.cc:654] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.044185 10593 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.044381 10790 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.044284 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.045193 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.045428 11030 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:10.026292 10865 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.046016 11030 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.049829 10783 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.052138 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.052616 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.047458 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.056908 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.058230 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.058519 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.059051 10667 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:10.059940 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.061398 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.061772 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.062502 10865 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.060760 11014 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.059837 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.062544 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.063148 10865 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.065605 11011 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.066831 10865 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.067584 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.068825 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.070416 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.050164 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.076329 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.077549 10791 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.079413 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.082283 10663 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:10.071532 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.083498 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.084249 10743 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.083534 11030 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.085820 10592 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.089143 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.089640 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.089823 10591 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:10.090926 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.092552 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.094167 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.094384 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.089946 11015 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.095237 10587 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:10.095263 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.096122 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.096195 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.096374 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.096678 10587 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.097002 11015 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.049263 11012 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.099517 10588 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.094414 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.103648 10783 ts_tablet_manager.cc:1434] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.136s	user 0.002s	sys 0.006s
I20260709 13:15:10.103744 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.103904 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.104758 10738 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:10.104880 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.105473 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.105469 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.106806 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.103960 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.071020 11007 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.107023 10865 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.190505 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.190821 10865 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.190853 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.191280 10593 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:10.132440 10783 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:10.108748 10635 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.133219 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.191596 10791 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.193420 10865 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.193948 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.078265 11027 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.182859 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:10.199885 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 91215us
I20260709 13:15:10.110366 10587 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:10.111199 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.182463 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.133785 10592 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.140769 10586 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.192641 11012 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.194628 10742 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.194294 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.209159 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.210645 10743 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:10.210923 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.211375 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.211933 10785 tablet_bootstrap.cc:654] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.212087 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:10.127015 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:10.207638 10663 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:10.212863 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.213780 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.217113 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.118652 10790 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.140407 10590 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:10.195549 10589 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:10.202494 11030 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.222043 11007 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.227705 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.226343 10736 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.221942 10667 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:10.373209 10784 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:10.320036 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.402729 11017 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:10.289983 11027 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.364475 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.408414 10588 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.408632 10740 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.235795 10594 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.411738 10784 ts_tablet_manager.cc:1403] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.682s	user 0.015s	sys 0.016s
I20260709 13:15:10.226068 10735 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.425244 11030 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.425405 11027 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.425962 11019 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.429672 11019 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.426257 11030 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.430531 11019 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.431589 11019 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.432618 11028 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.433071 11028 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.434156 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:10.434465 10632 leader_election.cc:343] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.435017 11028 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.432639 11017 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.435817 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.435873 11017 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:10.436311 10632 leader_election.cc:343] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.437908 11017 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.438170 11027 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.409893 10590 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.234994 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.269395 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.441443 10662 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:10.445413 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.448253 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.409555 10998 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.449468 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.265479 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.449954 10809 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.450583 10809 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.253244 11012 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.293468 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.254089 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.230337 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.451449 10809 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.236052 11016 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.218s
I20260709 13:15:10.234901 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.253098 10790 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.461591 10809 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.462689 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.462828 10737 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.390868 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:10.463595 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.464733 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.458202 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:10.458999 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 193603us
I20260709 13:15:10.469437 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.471994 10742 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:10.234681 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:10.460423 10632 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.514210 10635 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.496292 10784 raft_consensus.cc:359] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.531143 10784 raft_consensus.cc:385] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.531553 10784 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.527297 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.532071 10635 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.532908 10809 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:10.533859 10635 leader_election.cc:343] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:10.488410 11035 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:15:10.528118 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.485687 10594 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:10.563424 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.474730 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.498690 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.495373 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.574036 10790 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.563989 10784 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.527586 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.575917 10738 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.562633 11030 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:10.576754 10784 ts_tablet_manager.cc:1434] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.152s	user 0.005s	sys 0.007s
I20260709 13:15:10.564065 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:10.486270 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 220023us
I20260709 13:15:10.538789 10662 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
W20260709 13:15:10.565791 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 331162us
I20260709 13:15:10.579327 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.580425 10741 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.581101 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.582330 11014 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.582676 11014 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:10.583425 11014 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.502478 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.585671 10785 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:10.586158 10785 ts_tablet_manager.cc:1403] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.627s	user 0.023s	sys 0.027s
W20260709 13:15:10.587178 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.587378 10735 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:10.587626 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 112994us
I20260709 13:15:10.588027 11016 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.588431 11016 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:10.588618 10735 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.585837 10664 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:10.586526 10742 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.500975 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.532159 11012 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.591197 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 90344.4us
W20260709 13:15:10.591270 10706 leader_election.cc:343] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.480535 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.571336 10783 tablet_bootstrap.cc:654] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.571331 10809 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.475495 10736 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:10.572188 10635 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.564640 10953 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:10.532462 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 74374.3us
I20260709 13:15:10.496654 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.577833 10790 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.608651 10790 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:15:10.609265 10706 leader_election.cc:343] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.609525 10790 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.610654 10790 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.580559 10784 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:10.591750 11011 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.591580 11012 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.616549 11012 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.592619 10559 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.619752 10559 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.488756 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.480053 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.595081 10785 raft_consensus.cc:359] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.595534 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.596535 10742 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.597237 10738 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.540077 11019 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.494129 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.503500 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.486485 11024 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.481432 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.487797 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:10.480736 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.637253 10590 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:10.637817 10737 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:10.577709 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:10.604738 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.603940 10791 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:10.639312 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 61684.5us
I20260709 13:15:10.608273 10734 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.608042 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.610589 10706 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.607966 10953 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:10.588806 11016 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.641767 11018 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.642381 11018 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:10.641719 10953 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.642746 11018 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.645519 11007 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.621802 10785 raft_consensus.cc:385] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.625187 11009 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.629784 10783 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:10.624352 11011 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.625437 11014 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.628038 10490 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.632575 10784 tablet_bootstrap.cc:654] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.635664 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.636667 10735 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:10.639336 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 67155.4us
I20260709 13:15:10.629685 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.647037 10783 ts_tablet_manager.cc:1403] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.515s	user 0.030s	sys 0.046s
I20260709 13:15:10.647810 11009 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:10.646379 10785 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.658291 10785 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.649994 10490 catalog_manager.cc:5697] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.659284 10783 raft_consensus.cc:359] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.660890 10783 raft_consensus.cc:385] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.661216 10783 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.653800 11016 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.655401 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.655812 11019 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.664959 11019 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.656190 11014 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.663853 10783 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.653584 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:10.660486 10791 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.662572 11009 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.662998 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.661788 11007 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:10.672703 10735 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:10.656214 11011 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:10.673744 11016 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.673494 11007 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.671988 10791 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:10.663751 10893 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:10.655333 10790 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.664237 10559 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:10.666713 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58755.7us
I20260709 13:15:10.669389 10783 ts_tablet_manager.cc:1434] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:15:10.666965 11014 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:10.678054 10632 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.678184 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:10.675293 10791 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.679477 10632 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.680224 11030 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.678073 11014 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.681262 11030 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.689872 11044 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.689618 10791 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.690267 11044 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:10.690362 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.690659 11044 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.691179 10893 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.691699 10893 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.692109 10893 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.694352 10791 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.682156 11011 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:10.697710 10632 leader_election.cc:343] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.698287 10809 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.679780 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:10.700160 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.717669 10783 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:10.718144 10790 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.718078 11018 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.718432 11045 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.687032 11016 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.721650 10790 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.743238 11030 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:10.747896 11030 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.748203 11030 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.748936 11030 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.742681 11045 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:10.735642 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55936.6us
I20260709 13:15:10.750378 11045 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.750017 11030 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.752614 10809 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.754114 10784 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:10.754487 10784 ts_tablet_manager.cc:1403] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.174s	user 0.007s	sys 0.011s
I20260709 13:15:10.742837 11016 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:10.755162 10785 ts_tablet_manager.cc:1434] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.165s	user 0.022s	sys 0.012s
W20260709 13:15:10.762353 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79703.5us
I20260709 13:15:10.762887 10809 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:10.763824 10809 consensus_queue.cc:1243] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:15:10.764472 10809 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.764873 10809 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.765803 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.767576 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.769563 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.769822 10590 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.770782 10737 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.770831 10998 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.771561 10998 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:10.772336 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.772415 11052 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.772986 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.773478 11052 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.773561 10742 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:10.773859 11052 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:10.774587 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.774718 11052 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.775218 10738 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:10.775815 11052 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.776249 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.771739 11017 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.781759 10809 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.768923 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.783178 10809 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.783448 11017 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.784924 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.785893 11017 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:10.787483 10635 leader_election.cc:343] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.788040 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:10.789937 10635 leader_election.cc:343] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.757529 11016 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.760234 11019 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.790956 11044 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.793545 11018 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.797468 10785 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:10.798593 10809 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.791249 11017 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.794369 11019 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.761860 10790 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:10.803261 10635 leader_election.cc:343] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.804744 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.805621 10809 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.806973 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.807812 10809 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.808130 10809 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.808461 10809 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.810292 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.817751 10790 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.819010 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.820569 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.821653 10893 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.822348 11044 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.811947 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.802500 10998 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:15:10.802817 10736 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.803946 11027 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.826445 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.826658 11014 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.811761 11017 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:10.824532 10953 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.825400 11009 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.838327 10841 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.803079 10708 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:10.825465 11027 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.869089 10785 tablet_bootstrap.cc:654] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.869220 11028 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:10.853125 10893 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.872344 10784 raft_consensus.cc:359] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.873580 10784 raft_consensus.cc:385] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.873904 10784 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.875813 10784 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.881253 11027 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.892330 10809 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.896569 10783 tablet_bootstrap.cc:654] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.897176 10841 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.891237 11044 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.906198 10841 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.906373 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.881443 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.906976 10736 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.907040 10841 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.911105 11019 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.911839 10809 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.878173 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:10.884876 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80131.1us
I20260709 13:15:10.913391 10893 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.913861 10893 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:10.914304 10809 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.916085 10893 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.919266 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.923202 10998 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.923573 10998 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:10.924307 10998 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.929035 11010 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:10.929499 11010 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:10.929837 11010 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.930025 10668 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.929880 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.934592 10784 ts_tablet_manager.cc:1434] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.180s	user 0.005s	sys 0.003s
I20260709 13:15:10.914772 11019 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.937275 10998 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:10.950089 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 138890us
I20260709 13:15:10.936370 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:10.961678 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:10.962932 10662 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:15:10.950709 10635 leader_election.cc:343] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.953101 10841 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.925185 10893 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.966887 10588 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:10.953424 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 153166us
I20260709 13:15:10.947157 11012 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.887696 11045 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.967661 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.972137 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:10.933477 10736 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:10.972939 10635 leader_election.cc:343] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.975057 11061 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.976053 10784 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:10.973578 11028 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.977459 11028 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.977810 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.979332 10791 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:10.971697 11012 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.972744 11045 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:10.981918 11012 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:10.983093 10664 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.974404 11009 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:10.986083 11052 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.986472 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:10.987079 11062 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.987432 11062 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:10.988113 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:10.988185 11062 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.989341 11052 raft_consensus.cc:2764] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:10.989509 11062 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.939050 10632 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:10.977465 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:10.992138 11009 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.992816 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:10.993010 11009 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:10.993465 10735 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:10.993883 11009 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.994395 11016 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:10.995186 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:10.995900 10734 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:10.996047 11027 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.975464 11061 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.001616 10738 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.001454 10560 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:11.002561 11012 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.003018 11012 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.003441 11012 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.977839 11028 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.004312 10893 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.004578 11065 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.004621 11061 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.016258 10736 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.988119 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.021100 11052 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.021353 11016 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.021505 11014 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:11.006948 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 73281.4us
I20260709 13:15:11.024626 10739 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.025241 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.025586 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.022822 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.030471 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.032626 11065 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.032469 10893 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.033700 11011 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.035678 11011 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.037245 11011 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.026542 11014 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.041918 11011 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.041401 11014 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.041466 11009 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:15:11.034111 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.064322 11045 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.064795 11045 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.065188 11045 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.042932 11012 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:11.076663 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52913.5us
W20260709 13:15:11.100742 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.126950 10734 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.127492 10784 tablet_bootstrap.cc:654] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.129297 10785 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:11.129772 10785 ts_tablet_manager.cc:1403] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.334s	user 0.016s	sys 0.021s
W20260709 13:15:11.129596 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 81761.3us
I20260709 13:15:11.131920 11027 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:11.131877 11065 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:11.129586 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.135366 11027 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.135672 10662 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.135720 11027 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:11.135812 10665 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.136759 10791 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:11.128683 10632 leader_election.cc:343] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.146346 11015 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.151021 11015 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.151777 11015 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.153019 11015 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.154268 10735 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.156109 10953 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.153584 11027 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.157815 11027 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.162701 10791 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:11.162859 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.164274 11065 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.164814 11065 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.167430 11065 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.168685 10739 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:10.812155 10865 consensus_queue.cc:1175] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fac2164a6f874d7dbd29db83a7cf019b" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:11.169818 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:11.172060 10635 leader_election.cc:343] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.177145 10665 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.177181 11014 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:11.172848 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.186522 11067 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.007s
I20260709 13:15:11.130095 11061 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.131865 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.133340 10998 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:15:11.136634 11045 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.186695 11014 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.176975 11012 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:11.182114 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 133003us
I20260709 13:15:11.194772 11016 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:11.196187 11045 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.197536 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:11.186896 10893 consensus_queue.cc:1175] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "18f1a9f5e66846dba474825fb5b2b784" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:15:11.198146 10664 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:11.201349 10783 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:11.187804 11009 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:11.202558 10783 ts_tablet_manager.cc:1403] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.504s	user 0.023s	sys 0.021s
I20260709 13:15:11.203109 11009 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.204557 11009 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:15:11.205487 10632 leader_election.cc:343] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.205279 11009 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.206528 11009 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.206314 10783 raft_consensus.cc:359] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:11.206645 10632 leader_election.cc:343] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.206956 10783 raft_consensus.cc:385] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.207227 10783 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.207055 10632 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.199463 11016 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:11.210235 11016 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.212451 10783 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.218564 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.219168 10666 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.211920 10998 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:11.199244 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70753.4us
I20260709 13:15:11.215257 10742 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.224200 10589 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:11.224258 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.216657 11028 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.225092 10739 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:15:11.220803 10632 leader_election.cc:343] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.235056 10783 ts_tablet_manager.cc:1434] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:15:11.244844 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.245863 10742 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:11.249344 10783 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:11.226470 11061 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.222592 10662 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:11.227932 11010 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.255767 11010 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.257493 11016 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.258172 11028 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.259373 11016 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.260234 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.260406 10667 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:15:11.260792 10667 pending_rounds.cc:85] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 0
I20260709 13:15:11.261053 10667 pending_rounds.cc:107] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:15:11.261359 10667 raft_consensus.cc:2889] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:11.261623 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.262331 10742 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.265908 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.266743 11045 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.251858 10785 raft_consensus.cc:359] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.273694 10785 raft_consensus.cc:385] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.273943 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.274240 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.274080 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.273973 10785 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.276296 10785 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.285498 10785 ts_tablet_manager.cc:1434] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 13:15:11.244495 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.279031 10667 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:11.293562 10785 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:11.296018 10784 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:11.296572 10784 ts_tablet_manager.cc:1403] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.325s	user 0.013s	sys 0.024s
I20260709 13:15:11.280153 11014 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:11.301069 10784 raft_consensus.cc:359] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.302325 10784 raft_consensus.cc:385] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.302615 10784 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.301486 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.290594 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.285171 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.312243 10661 raft_consensus.cc:2393] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:11.312976 10736 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:11.314232 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.313017 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.309981 11010 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:15:11.319229 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:11.304531 11027 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.394625 10785 tablet_bootstrap.cc:654] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.349092 11028 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:11.409441 10666 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:11.418109 11016 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.422857 11028 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.423185 11016 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.415233 10662 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:11.424078 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.424681 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.425050 11028 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.425426 10662 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:11.327455 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.426020 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.309023 10560 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.426254 11016 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.423496 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:11.427162 10706 leader_election.cc:343] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.427485 11011 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.412220 10784 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.406332 10589 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.348336 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.349630 11045 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.429682 11045 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.430876 10998 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.431303 10998 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.331310 11015 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.432282 11045 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.432531 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.432696 11015 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.327584 11074 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
W20260709 13:15:11.433876 10706 leader_election.cc:343] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.433805 11015 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.434650 10998 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.435391 10784 ts_tablet_manager.cc:1434] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.138s	user 0.030s	sys 0.042s
I20260709 13:15:11.436406 10784 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:11.430125 11016 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.403771 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.437258 11016 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.437654 11016 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:11.438428 11016 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:11.428269 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 126173us
I20260709 13:15:11.450008 10738 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.399745 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.426131 10661 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.441968 10708 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.358477 10742 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:11.428820 10666 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.372287 10669 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:11.445876 10784 tablet_bootstrap.cc:654] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:11.396135 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 175357us
I20260709 13:15:11.411907 10660 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:11.332420 11009 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.115s
I20260709 13:15:11.447475 11016 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.456513 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.471477 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:11.464375 10738 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:11.472929 11027 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.419697 10783 tablet_bootstrap.cc:654] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.456770 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:11.468580 11062 raft_consensus.cc:2764] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:11.470793 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:11.474074 11014 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:15:11.475482 10665 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:11.480619 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:11.490196 10635 leader_election.cc:343] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.482201 11027 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:11.488003 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.493203 11062 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.493618 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.494190 10589 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:11.499830 11027 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.501850 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.513545 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.501020 10893 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:11.515743 10663 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:11.506969 10708 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.518761 10785 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:11.520778 10785 ts_tablet_manager.cc:1403] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.227s	user 0.004s	sys 0.015s
I20260709 13:15:11.521618 11062 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.507994 11010 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:15:11.539422 11028 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.539960 11028 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.542088 11028 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.543133 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:11.544546 10635 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.546191 10785 raft_consensus.cc:359] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.547135 10785 raft_consensus.cc:385] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.547469 10785 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.551848 10784 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:11.552302 10784 ts_tablet_manager.cc:1403] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.007s
I20260709 13:15:11.549947 10785 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.556748 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.557415 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.558837 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.559445 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.563192 10743 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:11.559723 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.560209 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.560789 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.565045 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.565438 10590 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:11.565567 10998 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.565968 10998 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.566371 10998 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.566424 10841 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.567808 11062 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.567691 11014 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.568698 11014 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.569121 11014 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.570297 11014 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.566218 11061 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.573594 10893 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:11.576144 11083 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:11.578014 10785 ts_tablet_manager.cc:1434] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 13:15:11.597854 10785 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:11.609123 10784 raft_consensus.cc:359] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.611696 10784 raft_consensus.cc:385] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.611932 10784 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.595666 11014 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.619709 10784 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.621450 10491 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.623034 10491 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.624567 10491 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.625214 10841 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.627688 10784 ts_tablet_manager.cc:1434] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.075s	user 0.001s	sys 0.005s
I20260709 13:15:11.628631 10784 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
W20260709 13:15:11.629709 10632 leader_election.cc:343] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.630184 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:11.631474 10632 leader_election.cc:343] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.632922 10491 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.637035 10491 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.634404 11027 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.642637 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.643038 10998 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.645051 10491 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.619270 10708 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:15:11.656579 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.660298 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:11.661636 10998 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.662570 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.665578 10735 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.660986 10736 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:11.637192 10632 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.673241 11011 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.671324 11062 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.674585 11062 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:11.674156 11011 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.675454 11062 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.679457 10998 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:11.681782 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49373.4us
I20260709 13:15:11.677786 11011 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:11.678905 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62829.6us
I20260709 13:15:11.692648 10783 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:11.693099 10783 ts_tablet_manager.cc:1403] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.444s	user 0.007s	sys 0.016s
I20260709 13:15:11.682756 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:11.702378 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:11.702991 10665 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:11.704555 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.705714 11012 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:11.689936 10632 leader_election.cc:343] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.706079 11012 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.711748 11012 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.689764 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.714428 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.716492 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.721479 11018 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.721154 11012 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.711237 10632 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.730121 11016 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.739743 10998 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:11.740518 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51201.3us
I20260709 13:15:11.741261 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.742029 10998 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:11.743314 10632 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.743757 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.731813 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.744642 11018 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.734067 10785 tablet_bootstrap.cc:654] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.734526 10784 tablet_bootstrap.cc:654] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.736619 10735 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:11.729605 11062 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.747380 10998 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.746694 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.750629 11062 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:11.751916 11062 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.756057 10635 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:11.756338 11012 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.756982 10998 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.762475 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:11.761698 11018 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.763051 10666 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.763165 10998 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:11.764585 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:11.778896 10783 raft_consensus.cc:359] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.784696 10783 raft_consensus.cc:385] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.785166 10783 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.768287 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.792415 10593 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.778715 10560 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.795717 11015 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.796164 11015 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.797079 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:11.796963 11015 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.797834 11018 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.798904 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.765280 10998 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.799995 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.800441 11018 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.800722 11045 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.800941 11018 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:11.771946 10666 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:11.766044 10492 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.786090 10783 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.809084 10783 ts_tablet_manager.cc:1434] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.003s
I20260709 13:15:11.812505 11016 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.819698 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.820917 10841 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.821379 10841 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.823774 11015 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.823930 10841 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:11.824717 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:11.830677 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:11.831138 10632 leader_election.cc:343] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:11.831943 10635 leader_election.cc:343] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.832324 10635 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:11.832964 10841 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.837289 10783 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:11.825165 11015 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:11.838542 11015 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.844576 11045 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:11.847642 10785 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:11.848055 10785 ts_tablet_manager.cc:1403] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.254s	user 0.012s	sys 0.023s
I20260709 13:15:11.847141 11045 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.851598 10784 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:11.852020 10784 ts_tablet_manager.cc:1403] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.224s	user 0.006s	sys 0.013s
I20260709 13:15:11.854074 10785 raft_consensus.cc:359] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.854810 10785 raft_consensus.cc:385] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.855160 10785 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.855904 10785 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.858880 10490 catalog_manager.cc:5697] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:15:11.861506 10490 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.862748 10785 ts_tablet_manager.cc:1434] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:15:11.863749 10785 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:11.864125 10593 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:11.850786 11018 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.869199 10784 raft_consensus.cc:359] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.871524 10784 raft_consensus.cc:385] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.871855 10784 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.872565 10784 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:11.859445 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.885905 11104 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.886412 11104 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.886850 11104 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.899911 10492 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.902185 10492 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.904099 11104 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:11.905646 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52124.2us
I20260709 13:15:11.909668 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:11.910678 11016 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.911161 11016 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.911583 11016 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.917946 10667 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:11.918713 10783 tablet_bootstrap.cc:654] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.920320 10784 ts_tablet_manager.cc:1434] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 13:15:11.931058 10784 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:11.944032 11104 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:11.944727 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:11.954489 10490 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 3, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.945709 10667 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.945746 10593 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.963275 11110 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.965906 11015 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.969138 11016 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.006574 11045 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:12.006970 11045 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:12.007311 11012 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:12.007711 11045 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.007926 11012 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.010341 11012 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.024138 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.026510 10590 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:12.027472 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:12.029086 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.029842 10665 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:15:12.036888 10706 leader_election.cc:343] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.037539 11018 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.037804 10841 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.038302 10783 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:12.039465 10783 ts_tablet_manager.cc:1403] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.206s	user 0.014s	sys 0.003s
I20260709 13:15:12.060269 10784 tablet_bootstrap.cc:654] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.070261 10492 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.038149 11018 consensus_queue.cc:1243] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:12.052594 10735 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:12.063594 10695 tablet.cc:2406] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:12.038496 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:12.035925 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 82122.7us
I20260709 13:15:12.045902 11016 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.081995 11015 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.083485 10785 tablet_bootstrap.cc:654] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.086218 11045 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.086113 10783 raft_consensus.cc:359] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.086793 10783 raft_consensus.cc:385] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.087081 10783 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.087651 10783 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.088228 10593 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:12.089898 10783 ts_tablet_manager.cc:1434] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 13:15:12.089993 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:12.090762 10783 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:12.046031 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:12.091764 11016 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.094794 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:12.095486 10665 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.096655 11016 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:12.097597 11016 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.080371 10666 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.111227 10587 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.117646 11015 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:12.117713 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 78390.8us
I20260709 13:15:12.133632 10666 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:12.133695 10665 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:12.134868 10998 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.135409 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:12.136310 11045 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.136772 11045 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:12.137568 11045 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.151479 11015 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:12.180121 10784 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:12.180562 10784 ts_tablet_manager.cc:1403] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.258s	user 0.028s	sys 0.013s
I20260709 13:15:12.181489 10587 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.176227 10491 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.183756 10785 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:12.184194 10785 ts_tablet_manager.cc:1403] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.321s	user 0.020s	sys 0.027s
I20260709 13:15:12.187496 10784 raft_consensus.cc:359] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.188128 10784 raft_consensus.cc:385] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.188407 10784 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.189080 10784 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.191301 10784 ts_tablet_manager.cc:1434] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:15:12.194970 10783 tablet_bootstrap.cc:654] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.195778 11045 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.195679 10491 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.196686 10785 raft_consensus.cc:359] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.197341 10785 raft_consensus.cc:385] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.197595 10785 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.198802 10784 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:12.200779 10491 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.202062 10785 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.204486 10785 ts_tablet_manager.cc:1434] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:15:12.205456 10785 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:12.208086 10491 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.221603 10784 tablet_bootstrap.cc:654] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.224347 10785 tablet_bootstrap.cc:654] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.226681 11027 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.227152 11027 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.233721 11009 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:12.238101 11009 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.240031 11009 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.242266 10666 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:12.242374 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.243311 11027 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.243311 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.245447 10665 raft_consensus.cc:2393] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.245287 11014 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:12.246874 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.286094 10666 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.288156 11016 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:12.321967 11114 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.322885 11027 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.325167 10998 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.322582 11114 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.345711 10783 tablet_bootstrap.cc:492] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:12.348137 10783 ts_tablet_manager.cc:1403] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.258s	user 0.014s	sys 0.009s
I20260709 13:15:12.352867 10593 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.349407 10998 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.354063 10783 raft_consensus.cc:359] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.354699 10783 raft_consensus.cc:385] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.354995 10783 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.354779 11016 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.355423 10998 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.355593 10783 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.358218 10590 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.358795 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.359418 10783 ts_tablet_manager.cc:1434] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:12.357117 11114 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:12.359858 10632 leader_election.cc:343] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.360307 10783 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:12.360308 11105 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:12.362421 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.362707 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:12.363471 10706 leader_election.cc:343] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:12.364579 10632 leader_election.cc:343] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.368302 10998 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.369899 10664 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.370157 11105 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.348634 11027 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.370638 11105 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:12.382437 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58817.4us
I20260709 13:15:12.387883 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:12.391866 10635 leader_election.cc:343] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.392372 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:12.396071 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.396639 10743 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:12.396983 10667 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.404186 11126 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.403970 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.409870 10735 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:12.410336 10735 pending_rounds.cc:85] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 1
I20260709 13:15:12.410629 10735 pending_rounds.cc:107] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:12.410943 10735 raft_consensus.cc:2889] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.412562 10664 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.398550 11045 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.413697 11045 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.416184 11045 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.397799 10841 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.417760 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.418346 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:12.397668 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.420336 10668 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:12.419710 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:12.424247 10784 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:12.424832 10784 ts_tablet_manager.cc:1403] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.226s	user 0.013s	sys 0.005s
I20260709 13:15:12.427789 11105 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.428579 11105 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:12.428908 11105 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.429380 11105 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.428856 10491 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.429661 11015 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.430166 10998 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:12.430634 10998 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:12.431995 10706 leader_election.cc:343] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.432163 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:12.432565 10998 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.434587 11110 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.435894 11110 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.436241 11110 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.436551 11110 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.443542 11126 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:12.443938 10998 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.446684 10668 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.446918 10998 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.447259 11015 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.446710 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.448170 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.448695 10667 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:12.450555 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:12.431160 10491 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.448796 10661 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:12.454588 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.459039 10590 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.461079 11127 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.464280 11027 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.483386 10588 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:12.485966 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.470506 10664 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.502609 10841 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:12.503093 10841 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.503306 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:12.504087 11112 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.504455 11112 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.504747 11112 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.505017 10841 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.507963 11110 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.509878 10743 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.511312 11011 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.512238 10998 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.512184 11112 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.517868 11104 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:12.520570 10785 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:12.520994 10785 ts_tablet_manager.cc:1403] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.316s	user 0.009s	sys 0.012s
I20260709 13:15:12.499812 11016 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:15:12.534799 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.525293 10998 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:12.539243 10785 raft_consensus.cc:359] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.540180 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.532807 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.541878 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.551229 10742 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.543042 10784 raft_consensus.cc:359] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.552248 10784 raft_consensus.cc:385] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.545288 10785 raft_consensus.cc:385] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:12.546559 10635 leader_election.cc:343] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.553454 10785 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.552567 10784 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.555023 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:12.554786 10785 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:12.558946 10706 leader_election.cc:343] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.560017 10784 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.562906 10785 ts_tablet_manager.cc:1434] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.006s
I20260709 13:15:12.565444 11104 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.565934 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:12.548434 11110 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:12.548573 10632 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.572119 10785 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:12.553268 10998 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.647758 10784 ts_tablet_manager.cc:1434] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.223s	user 0.008s	sys 0.000s
I20260709 13:15:12.662487 11105 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.663628 10737 raft_consensus.cc:2368] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
W20260709 13:15:12.582738 10635 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:12.582732 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 45830us
I20260709 13:15:12.669831 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:12.671651 11134 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:12.673076 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.673393 10998 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.573747 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:12.655139 11015 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:12.589735 11133 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:12.666621 11105 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.586807 11112 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.686368 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:12.697460 10586 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.659171 10667 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.614810 11011 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.709810 11011 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.711918 10783 tablet_bootstrap.cc:654] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.712205 11011 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.686762 10784 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:12.693697 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:12.694480 10706 leader_election.cc:343] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.589968 11127 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:12.713397 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 159981us
I20260709 13:15:12.738389 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:12.738158 11127 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.744362 10635 leader_election.cc:400] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:12.744731 10635 leader_election.cc:403] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:12.740353 11130 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:15:12.745134 10632 leader_election.cc:343] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.747403 10632 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:12.742691 10841 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:12.749084 10841 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.737429 10998 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.741505 10591 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.701989 11015 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.759246 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.760022 10736 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.749508 11027 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.758731 10998 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:12.772712 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:12.766786 11012 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.786096 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.786842 10669 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.766357 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:12.787175 11018 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:12.791154 11018 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:12.774158 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.768842 10587 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
W20260709 13:15:12.797664 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 52544us
I20260709 13:15:12.787796 10998 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.805938 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.806540 10593 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:12.806949 10998 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:12.807996 11143 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:15:12.789330 11012 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.810201 10785 tablet_bootstrap.cc:654] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.799460 11135 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:12.817963 11012 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.818812 11110 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.821935 11112 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.810492 11018 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.821930 11015 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.823940 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:12.824537 10588 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:12.825712 11135 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.828364 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:12.855105 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:12.856981 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.856786 11127 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.857635 10736 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:12.858326 10662 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:12.864283 11027 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
W20260709 13:15:12.880990 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 60566.8us
I20260709 13:15:12.881256 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:12.885839 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.887288 10665 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:12.894147 10667 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:12.935405 10666 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:12.931234 11027 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:12.961704 11027 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:12.962159 11027 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.972010 10783 tablet_bootstrap.cc:492] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:12.972477 10783 ts_tablet_manager.cc:1403] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.612s	user 0.029s	sys 0.007s
W20260709 13:15:12.979208 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 144122us
I20260709 13:15:12.977131 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:12.981747 10665 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:12.982462 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 125558us
I20260709 13:15:12.937129 11127 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.983510 11114 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.984508 11104 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.984982 11104 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.986915 11104 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:12.987977 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:12.989787 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:12.990526 10736 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.988598 11135 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:12.990797 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.991542 10737 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:12.992944 11145 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.994040 10784 tablet_bootstrap.cc:654] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.994405 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:12.993546 11145 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:12.996071 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:12.997009 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:12.997643 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.998713 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:12.999408 10738 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:13.000363 11104 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.001641 11015 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.001925 11126 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:13.002328 11126 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.002697 11126 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.003299 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.005424 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:12.998700 10735 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.017514 11112 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.997721 11145 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.022857 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.004963 11016 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.020680 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.002032 11027 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.030402 10785 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:13.040310 10785 ts_tablet_manager.cc:1403] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.468s	user 0.022s	sys 0.015s
I20260709 13:15:13.036916 10841 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.021421 11011 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:13.026127 11146 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:13.043314 11139 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.042814 10841 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:13.053346 11139 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:13.053633 10841 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.053752 11139 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.044100 11011 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.050983 11146 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.067559 10841 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.045845 11127 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.044811 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.057888 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.076380 10593 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.059206 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.078747 10783 raft_consensus.cc:359] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.069161 11011 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.079454 10783 raft_consensus.cc:385] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.079793 10783 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.080541 11146 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.080348 10783 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.079455 10743 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:13.085606 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.086289 10662 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:13.086031 11127 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.087971 11127 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.088723 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.089359 10593 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.089133 10785 raft_consensus.cc:359] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.089841 10785 raft_consensus.cc:385] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.090099 10785 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.090745 10632 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.090909 10785 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.092469 11136 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.092808 11136 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:13.093037 10785 ts_tablet_manager.cc:1434] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:15:13.093132 11136 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.093755 10667 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.088667 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.095163 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.095286 10591 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.096091 10783 ts_tablet_manager.cc:1434] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.123s	user 0.003s	sys 0.002s
I20260709 13:15:13.096988 11126 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.097522 10785 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:13.097627 11027 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.099040 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.099550 11126 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.101394 10491 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.097013 10783 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
W20260709 13:15:13.104992 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46482.9us
I20260709 13:15:13.107368 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:13.109894 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.111613 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.112408 10737 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.114142 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:13.115636 10632 leader_election.cc:343] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:13.131371 10635 leader_election.cc:343] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.125422 10841 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.127446 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.134619 10738 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.136397 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.137269 11027 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.110484 11127 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.144865 11127 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:13.144970 10706 leader_election.cc:343] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.145279 11127 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.124392 11154 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.147130 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.147475 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.147486 11154 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.147729 10735 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.148120 10664 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.117853 11126 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:13.149684 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.153098 11154 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.160768 11136 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.158468 10735 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.114620 11139 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.167290 11139 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.168605 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.114635 11016 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.170404 10785 tablet_bootstrap.cc:654] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.125916 11011 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.163517 11126 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.178494 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.179103 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.182615 11136 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.182838 10591 raft_consensus.cc:2368] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.183086 11126 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.179764 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.186642 10632 leader_election.cc:400] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.187347 10632 leader_election.cc:403] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:13.188486 10585 raft_consensus.cc:2368] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.187541 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.190311 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.191082 10743 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.191098 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.193497 11012 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.194010 10735 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.194089 11012 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:13.195211 11012 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.195955 11154 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.199107 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.199649 10661 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.199872 11126 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.201859 10632 leader_election.cc:400] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.202333 10632 leader_election.cc:403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:13.203958 11139 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.185112 10664 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.206285 10589 raft_consensus.cc:2368] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.206195 11136 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.210812 10588 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.212478 10661 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.212949 11011 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.213733 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.213775 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.214740 11110 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.215209 11110 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.216037 11110 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.217788 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.218516 10735 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.201897 11154 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.220629 10784 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:13.221051 10784 ts_tablet_manager.cc:1403] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.544s	user 0.024s	sys 0.011s
I20260709 13:15:13.221446 10783 tablet_bootstrap.cc:654] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.222443 11127 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.223685 10593 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:13.225154 10632 leader_election.cc:400] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.225416 10632 leader_election.cc:403] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:13.225520 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.225901 11136 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.226249 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.226269 10743 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.226377 11154 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.226962 11027 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.227442 11027 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.227698 11154 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.228459 11027 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.232282 10785 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:13.232712 10785 ts_tablet_manager.cc:1403] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.002s
I20260709 13:15:13.233011 11136 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.234516 10632 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.235332 11136 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.236012 11136 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.236907 11136 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.238584 10785 raft_consensus.cc:359] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.239185 10785 raft_consensus.cc:385] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.239442 10785 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.245007 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.248232 11127 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.252274 10735 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.254859 11139 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:13.255699 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.256932 10785 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.258052 11009 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.258599 11009 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:13.259359 10785 ts_tablet_manager.cc:1434] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:15:13.260730 10785 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:13.261399 10784 raft_consensus.cc:359] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.262053 10784 raft_consensus.cc:385] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.262359 10784 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.259359 11009 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.263010 10784 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.264577 10667 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.265509 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.265686 11126 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.267767 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.268230 10593 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.268347 10735 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.254317 11016 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.275130 10664 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.276553 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:13.281951 10784 ts_tablet_manager.cc:1434] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:15:13.283496 11157 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.283954 11157 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:13.287322 11154 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.288564 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.289158 10664 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.290120 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.293211 10784 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:13.299508 10785 tablet_bootstrap.cc:654] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.303580 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.304299 11127 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.304744 11127 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.305626 11127 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.306711 11104 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.307159 11104 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.292460 11154 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.313992 11104 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.291630 11157 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.315382 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.315963 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.322606 10783 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.312637 11154 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.323307 10735 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:13.323489 11154 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.323724 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.324338 10591 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:13.323213 10783 ts_tablet_manager.cc:1403] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.033s
I20260709 13:15:13.330155 10784 tablet_bootstrap.cc:654] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.335939 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.337044 10783 raft_consensus.cc:359] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.337833 10783 raft_consensus.cc:385] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.338490 10783 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.339252 10783 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.345292 10783 ts_tablet_manager.cc:1434] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
W20260709 13:15:13.345781 10706 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.346604 10783 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.346671 10706 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:13.348770 10706 leader_election.cc:343] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.348384 11105 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:13.349547 11105 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.349870 11105 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.356949 11105 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.363085 10785 tablet_bootstrap.cc:492] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:13.363559 10785 ts_tablet_manager.cc:1403] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.006s
I20260709 13:15:13.366480 10593 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.368917 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.368997 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.369510 10593 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.371467 11016 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.372203 11154 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.374763 11154 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.366591 11105 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.379577 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.383911 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.384920 10667 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:13.386271 10706 leader_election.cc:343] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.387377 10593 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:13.388072 11146 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.388797 10783 tablet_bootstrap.cc:654] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.388522 11146 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.392277 10706 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:13.395792 10785 raft_consensus.cc:359] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.396443 10785 raft_consensus.cc:385] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.396665 10784 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:13.396730 10785 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.397482 10784 ts_tablet_manager.cc:1403] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.004s
I20260709 13:15:13.397660 10785 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.399255 11146 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.401717 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.402292 10735 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:13.403174 10785 ts_tablet_manager.cc:1434] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:15:13.404134 10785 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:13.404348 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.404918 10593 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:13.404155 10667 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.405993 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:13.407609 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:13.408866 11154 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.409358 11154 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.410131 11154 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.411774 11146 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.412161 11146 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.412475 11146 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.400696 11105 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.415244 11105 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.416211 11105 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.430154 11146 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.427954 10784 raft_consensus.cc:359] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.431545 10784 raft_consensus.cc:385] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.431838 10784 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.436681 10784 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.440397 10784 ts_tablet_manager.cc:1434] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:15:13.441442 10664 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.442123 10784 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:13.443025 11154 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.448510 10492 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.456431 11146 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.457058 10492 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.457729 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:13.458218 10785 tablet_bootstrap.cc:654] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.458225 10735 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.458874 10492 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.472028 10735 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.461119 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.474252 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.474948 10588 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.475103 11146 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.477478 11146 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.478487 11146 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.482540 10783 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.482963 10783 ts_tablet_manager.cc:1403] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.014s
I20260709 13:15:13.485849 10784 tablet_bootstrap.cc:654] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.491235 10783 raft_consensus.cc:359] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.491796 10783 raft_consensus.cc:385] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.491775 10490 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.492341 10783 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.492887 10490 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.494581 10783 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.496474 10783 ts_tablet_manager.cc:1434] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:15:13.497447 10783 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.494599 10490 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.507598 10588 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:13.509903 10785 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:13.514200 10491 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.517683 10785 ts_tablet_manager.cc:1403] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.001s
I20260709 13:15:13.518724 10491 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.520874 10785 raft_consensus.cc:359] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.521733 10783 tablet_bootstrap.cc:654] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.521961 10785 raft_consensus.cc:385] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.522231 10785 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.522799 10785 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.524717 10785 ts_tablet_manager.cc:1434] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:13.530925 10785 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:13.533275 10783 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.533708 10783 ts_tablet_manager.cc:1403] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.001s
I20260709 13:15:13.535627 10783 raft_consensus.cc:359] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.535876 10785 tablet_bootstrap.cc:654] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.536098 10783 raft_consensus.cc:385] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.536366 10783 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.515532 10784 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:13.536918 10783 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.537449 10784 ts_tablet_manager.cc:1403] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.011s
I20260709 13:15:13.538895 10783 ts_tablet_manager.cc:1434] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:15:13.539772 10783 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.544963 10783 tablet_bootstrap.cc:654] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.547087 10492 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 2, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.550444 10784 raft_consensus.cc:359] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.550864 10784 raft_consensus.cc:385] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.551016 10784 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.551487 10784 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.552579 10784 ts_tablet_manager.cc:1434] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.000s
I20260709 13:15:13.553191 10784 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:13.559056 10784 tablet_bootstrap.cc:654] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.560766 10783 tablet_bootstrap.cc:492] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.561159 10783 ts_tablet_manager.cc:1403] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:15:13.563474 10783 raft_consensus.cc:359] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.564046 10783 raft_consensus.cc:385] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.564285 10783 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.564857 10783 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.566792 10783 ts_tablet_manager.cc:1434] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:13.567600 10783 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.572703 10783 tablet_bootstrap.cc:654] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.583775 10783 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.584132 10783 ts_tablet_manager.cc:1403] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:15:13.586377 10783 raft_consensus.cc:359] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.586972 10783 raft_consensus.cc:385] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.587204 10783 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.587894 10783 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.588969 11012 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.589385 11012 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.589797 10783 ts_tablet_manager.cc:1434] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:13.591089 11012 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.592155 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.592891 10666 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:13.594781 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.598853 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.599772 11009 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.604724 10666 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.607595 11157 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.609272 11009 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.611984 10783 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.618738 10783 tablet_bootstrap.cc:654] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.624125 10738 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.625866 11009 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.626550 11146 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.627146 11146 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.630244 11127 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.630784 11127 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.631772 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.633545 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.635046 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:13.635205 10635 leader_election.cc:343] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.635867 11146 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:13.636626 10632 leader_election.cc:343] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.637101 10632 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.638471 11105 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.638949 10635 leader_election.cc:343] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.638904 11105 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.639977 11146 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.640172 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.633186 11127 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.640879 11105 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:13.642539 10632 leader_election.cc:343] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.642901 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.643814 11146 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.645308 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.648571 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.654421 11154 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.654872 11154 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.656704 11154 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.657929 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.658501 10666 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.660975 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.661552 10593 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.663081 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.664033 11105 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.664456 11105 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.664781 11105 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.649153 10588 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:13.671063 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:13.664083 10492 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.671706 11156 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.676836 10743 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.672667 11154 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:13.680426 11154 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.680824 11154 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.685778 11156 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.685483 11012 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.686249 11156 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.688300 11156 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.689594 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.690181 10667 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.691221 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.694973 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.695523 10588 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:13.696964 11156 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.697336 11156 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.697654 11156 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.702639 10593 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.704085 11146 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.707883 11156 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.676800 11105 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.715051 11127 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.726132 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.726634 10593 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:13.729627 10706 consensus_peers.cc:597] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:13.734475 11127 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.724191 10492 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 3, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.758100 11154 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.762535 10593 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.765233 11105 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.766127 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.808521 10667 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.807928 10785 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:13.811482 10785 ts_tablet_manager.cc:1403] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.281s	user 0.044s	sys 0.031s
I20260709 13:15:13.776731 11139 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.812539 11139 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.814561 11139 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.815263 10667 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.816262 10738 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:13.817168 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.818034 11105 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.818485 11105 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.819321 11154 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.819233 11105 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.821290 10667 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.818756 10785 raft_consensus.cc:359] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.822435 10785 raft_consensus.cc:385] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.822724 10785 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.778640 11009 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.786142 10735 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.787988 11156 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:13.791477 10666 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.791745 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.794910 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.800369 10783 tablet_bootstrap.cc:492] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:13.828980 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:13.824622 10589 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.830546 10784 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:13.830957 10784 ts_tablet_manager.cc:1403] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.278s	user 0.088s	sys 0.155s
I20260709 13:15:13.823294 10785 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.823915 10783 ts_tablet_manager.cc:1403] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.212s	user 0.007s	sys 0.010s
I20260709 13:15:13.824692 10664 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.825301 11157 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:13.833873 11157 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.834424 10593 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.834806 10785 ts_tablet_manager.cc:1434] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:15:13.865823 11127 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.835250 10841 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:15:13.847476 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.894577 11146 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.894764 10738 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
W20260709 13:15:13.896042 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58154.7us
I20260709 13:15:13.895004 11146 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.895099 10841 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.889004 10743 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:13.892760 10785 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:13.855406 11139 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.825336 11009 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.904352 11139 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.824887 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:13.893579 10783 raft_consensus.cc:359] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.905844 10783 raft_consensus.cc:385] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.906199 10783 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.844821 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.864104 10589 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.906713 11139 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.897372 10841 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.901226 11136 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.908021 11136 consensus_queue.cc:1243] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:13.908481 11136 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.908771 11136 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:13.909399 10841 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.910230 11136 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.911341 11136 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.913200 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.893782 11127 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.902732 11146 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.874373 10664 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:13.911553 10783 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.912655 10706 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:13.825778 11011 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:15:13.915052 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.915293 11156 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.911051 11009 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.918202 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.919512 11146 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.920725 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.921578 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.923102 11012 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.923346 10666 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:13.923617 11012 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.925221 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:13.925542 10589 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:13.926136 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.927059 11104 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.927882 11012 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.928512 11012 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.928951 11012 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.929378 10588 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:13.929548 11012 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.932116 11127 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:13.920301 11139 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.933130 11139 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.933182 11104 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:13.933557 11139 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.934130 11104 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.938879 10661 raft_consensus.cc:2410] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:13.939064 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:13.938089 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:13.939967 10632 leader_election.cc:343] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.938814 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:13.940519 10666 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:13.940948 10632 leader_election.cc:343] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.940531 11146 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.942765 10784 raft_consensus.cc:359] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.943418 10784 raft_consensus.cc:385] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.941411 11146 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.944639 10635 leader_election.cc:343] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.944527 10559 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:13.945050 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:13.943673 10784 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.944104 11146 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.946349 10841 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:13.947702 10635 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:13.949960 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 118417us
I20260709 13:15:13.954427 10783 ts_tablet_manager.cc:1434] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.002s
I20260709 13:15:13.950081 10784 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.953801 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.948935 11009 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:13.950593 11114 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.975416 11114 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.976964 10783 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:13.973089 10841 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.979146 10841 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:13.980017 10593 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:13.973280 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.973985 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:13.974340 10784 ts_tablet_manager.cc:1434] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.143s	user 0.004s	sys 0.003s
I20260709 13:15:13.982576 10784 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:13.984470 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:13.986159 10632 leader_election.cc:343] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.986045 11110 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:13.991407 10735 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:13.993048 11114 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:13.995342 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:15:14.002023 10560 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.005551 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:14.009930 10706 leader_election.cc:343] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.014038 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:14.017570 10635 leader_election.cc:343] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.018195 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.003237 10841 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.027544 10785 tablet_bootstrap.cc:654] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.008221 11114 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:14.032748 10492 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:14.023667 11127 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.025584 11105 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:14.024859 11027 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:15:14.029613 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.031195 11012 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.051405 11139 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:14.068619 10635 leader_election.cc:343] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.069178 10635 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.074431 11012 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.075242 10784 tablet_bootstrap.cc:654] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.034932 11156 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:15:14.061477 11009 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:14.095620 11009 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.095261 11136 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.097910 11127 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.149951 11139 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.144594 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:14.150987 10591 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:14.152565 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 79481.7us
I20260709 13:15:14.156728 10783 tablet_bootstrap.cc:654] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.103065 10661 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:14.158373 10661 pending_rounds.cc:85] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 1
I20260709 13:15:14.163290 10661 pending_rounds.cc:107] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:14.163554 10661 raft_consensus.cc:2889] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:14.152653 11127 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.165848 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.166318 11127 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:14.167528 10708 leader_election.cc:343] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.167904 10708 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:14.168628 11016 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.196324 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:14.196964 11205 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:14.205575 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.206111 10737 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.208077 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.182236 11105 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:15:14.202858 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.221696 11110 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:14.233268 10635 leader_election.cc:343] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.261601 10591 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
W20260709 13:15:14.266739 10560 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.278025 10784 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:14.278612 10784 ts_tablet_manager.cc:1403] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.296s	user 0.005s	sys 0.023s
I20260709 13:15:14.282876 10785 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:14.283430 10785 ts_tablet_manager.cc:1403] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.391s	user 0.024s	sys 0.008s
I20260709 13:15:14.290942 10784 raft_consensus.cc:359] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.291586 10784 raft_consensus.cc:385] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.291837 10784 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.292459 10784 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.293639 10783 tablet_bootstrap.cc:492] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:14.294059 10783 ts_tablet_manager.cc:1403] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.317s	user 0.011s	sys 0.022s
I20260709 13:15:14.297166 10632 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.266757 11146 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.299338 11136 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.299815 11136 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:14.306396 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:14.307080 10593 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:14.307230 10785 raft_consensus.cc:359] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.307837 10785 raft_consensus.cc:385] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.308426 10785 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.300587 11136 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.308938 10784 ts_tablet_manager.cc:1434] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:15:14.310029 10669 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:14.312619 10785 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.313931 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.314184 10737 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:14.311440 11105 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:14.315956 10783 raft_consensus.cc:359] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.316584 10783 raft_consensus.cc:385] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.311461 10585 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:14.317845 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:14.316841 10783 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
W20260709 13:15:14.319010 10635 leader_election.cc:343] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.319438 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.327296 10783 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.336616 10785 ts_tablet_manager.cc:1434] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.002s
I20260709 13:15:14.336875 10784 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:14.322960 11027 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.334638 11127 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:14.318854 11146 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.346500 10783 ts_tablet_manager.cc:1434] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 13:15:14.338712 10785 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:14.339893 11009 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.360457 10783 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
W20260709 13:15:14.364127 10632 leader_election.cc:343] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.364468 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.367599 10492 catalog_manager.cc:5697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:14.371961 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.375371 11211 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.368858 11139 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.370236 10588 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:14.389070 11016 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.392989 11009 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.393415 10785 tablet_bootstrap.cc:654] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.396384 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:14.401559 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.404927 10784 tablet_bootstrap.cc:654] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.408447 11110 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.411471 10560 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.411861 11110 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.412218 11110 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:14.412518 11211 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:14.413074 11110 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.414259 11110 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.412690 10783 tablet_bootstrap.cc:654] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.448088 10785 tablet_bootstrap.cc:492] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:14.448535 10785 ts_tablet_manager.cc:1403] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.003s
I20260709 13:15:14.453470 10785 raft_consensus.cc:359] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.454145 10785 raft_consensus.cc:385] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.454427 10785 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.458580 10492 catalog_manager.cc:5697] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.478658 10783 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:14.479130 10783 ts_tablet_manager.cc:1403] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.005s
I20260709 13:15:14.479346 10784 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:14.479745 10784 ts_tablet_manager.cc:1403] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.021s
I20260709 13:15:14.481729 10783 raft_consensus.cc:359] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.482424 10783 raft_consensus.cc:385] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.482721 10783 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.483741 10784 raft_consensus.cc:359] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.483820 10783 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.484423 10784 raft_consensus.cc:385] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.484688 10784 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.485311 10784 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.485800 10783 ts_tablet_manager.cc:1434] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:14.486656 10783 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:14.487246 10784 ts_tablet_manager.cc:1434] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:14.488144 10784 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:14.489555 10785 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.491995 10783 tablet_bootstrap.cc:654] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.493381 10785 ts_tablet_manager.cc:1434] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:15:14.495177 10785 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:14.501551 10785 tablet_bootstrap.cc:654] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.506016 10784 tablet_bootstrap.cc:654] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.518533 10783 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:14.518982 10783 ts_tablet_manager.cc:1403] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 13:15:14.522505 10783 raft_consensus.cc:359] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.523483 10783 raft_consensus.cc:385] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.523842 10783 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.524641 10783 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.526968 10783 ts_tablet_manager.cc:1434] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:14.528105 11211 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.528738 10785 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:14.528784 10783 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:14.528558 11211 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.529148 11009 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.529412 10785 ts_tablet_manager.cc:1403] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.015s
I20260709 13:15:14.529652 11009 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.530876 11211 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.531641 11009 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.532922 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.533010 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.533598 10662 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:14.533658 10667 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:14.534369 10785 raft_consensus.cc:359] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.535398 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.541497 10785 raft_consensus.cc:385] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.535604 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.535732 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.541905 10783 tablet_bootstrap.cc:654] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.542071 10737 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:14.541887 10785 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.540230 11027 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.544298 11027 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.544044 10785 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.545280 10742 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:14.546857 10785 ts_tablet_manager.cc:1434] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:15:14.547302 11110 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.547991 11027 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.552711 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.553508 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:14.554540 10635 leader_election.cc:343] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:14.555253 10632 leader_election.cc:343] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.555663 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.556969 11136 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.548002 10785 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:14.562011 10559 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.562331 11211 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.562736 11157 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.562747 11211 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.563220 11157 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.563314 11211 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.563673 11157 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.571718 11157 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.572582 11211 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.573944 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:14.574214 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.574555 10662 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.574741 10742 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.577715 11201 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.583178 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:14.583786 10669 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.588375 10785 tablet_bootstrap.cc:654] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.590188 10742 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:14.591234 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:14.594278 10669 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:14.594990 11009 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.597189 11009 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:14.600767 11009 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.602610 10784 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:14.603201 10784 ts_tablet_manager.cc:1403] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.005s
I20260709 13:15:14.607963 11211 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.614573 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.615340 10742 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.600214 11157 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.618397 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.619686 11212 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.620285 11212 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:14.621356 11212 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.633643 10784 raft_consensus.cc:359] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.634814 10784 raft_consensus.cc:385] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.635061 10784 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.644160 10784 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.645576 10784 ts_tablet_manager.cc:1434] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:15:14.646590 10784 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:14.624243 10662 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:14.665971 10783 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:14.666519 10783 ts_tablet_manager.cc:1403] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.011s
I20260709 13:15:14.682523 10742 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:14.683890 10785 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:14.684484 10785 ts_tablet_manager.cc:1403] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.137s	user 0.036s	sys 0.028s
I20260709 13:15:14.689977 10783 raft_consensus.cc:359] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.690637 10783 raft_consensus.cc:385] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.690913 10783 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.692435 10783 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.695955 10783 ts_tablet_manager.cc:1434] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:15:14.698171 10785 raft_consensus.cc:359] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.698870 10785 raft_consensus.cc:385] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.699128 10785 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.701759 10784 tablet_bootstrap.cc:654] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.712809 11203 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.716094 11203 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.718621 11009 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.721974 11009 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.721335 10783 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:14.719247 10785 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.726914 11016 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.727573 10785 ts_tablet_manager.cc:1434] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 13:15:14.727360 11016 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.725246 11203 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.762876 10784 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:14.775593 11136 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:14.731702 10783 tablet_bootstrap.cc:654] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.784483 10784 ts_tablet_manager.cc:1403] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.012s
I20260709 13:15:14.728545 10785 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:14.786577 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.787266 10667 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:14.787050 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:14.787143 10784 raft_consensus.cc:359] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.787865 10784 raft_consensus.cc:385] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.787935 10588 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:14.788149 10784 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.728855 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:14.735003 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.788926 10662 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:14.789757 11016 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:14.789801 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.790899 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:14.791019 11212 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.729527 10492 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.791412 11212 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.791783 11212 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.791996 10785 tablet_bootstrap.cc:654] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.797293 10784 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.799443 10784 ts_tablet_manager.cc:1434] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:15:14.800303 10784 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:14.797045 11016 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.806358 11212 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.778921 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:14.811970 10560 leader_election.cc:343] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.814704 10783 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:14.815148 10783 ts_tablet_manager.cc:1403] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.024s
I20260709 13:15:14.727816 11009 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.818228 11016 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.818922 10783 raft_consensus.cc:359] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.821810 10783 raft_consensus.cc:385] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.822075 10783 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.824455 10783 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.825152 11027 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.745003 10589 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.737720 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.828917 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:14.829461 10662 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.829772 11212 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.840596 10785 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:14.841020 10785 ts_tablet_manager.cc:1403] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.035s
I20260709 13:15:14.843555 10785 raft_consensus.cc:359] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.844552 10785 raft_consensus.cc:385] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.844810 10785 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.845419 10785 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.846968 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.845968 10662 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:14.852298 10784 tablet_bootstrap.cc:654] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.856666 10783 ts_tablet_manager.cc:1434] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:15:14.858505 10489 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.860911 10783 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:14.836145 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:14.854111 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:14.855301 10785 ts_tablet_manager.cc:1434] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:14.862479 11009 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.863197 10785 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:14.863351 11009 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:14.864176 11009 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:14.874217 10560 leader_election.cc:343] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.894137 11027 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.895963 11027 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.890501 11105 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.897821 11027 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:14.897079 11105 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.900712 11105 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:14.900985 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:14.902622 10632 leader_election.cc:343] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.925576 11027 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.934047 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:14.934193 11027 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:14.934679 10669 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:14.936915 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:14.938037 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:14.938890 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:14.943879 11105 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.944340 11105 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.944723 11105 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:14.952807 10706 leader_election.cc:343] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.004071 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:15.005229 10632 leader_election.cc:343] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:15.009588 10635 leader_election.cc:343] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.009980 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:14.993443 11212 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.994402 11027 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.013525 11136 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.036288 10841 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.036855 10841 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.009119 11105 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.067800 10785 tablet_bootstrap.cc:654] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.072459 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:15.073017 10669 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.073613 11105 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.073729 10841 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.075276 10784 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:15.075678 10784 ts_tablet_manager.cc:1403] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.276s	user 0.021s	sys 0.022s
I20260709 13:15:15.078840 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.079506 10588 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
W20260709 13:15:15.079892 11247 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:15.079532 10669 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.081393 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.082683 10632 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:15.083190 10783 tablet_bootstrap.cc:654] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.082827 11154 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.083784 11154 raft_consensus.cc:697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:15.084597 11154 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.087577 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.087906 11127 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.088249 11127 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.088604 11127 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.094087 11027 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.094594 11027 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.094825 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:15.096678 10706 leader_election.cc:343] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.096846 11027 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.098069 10784 raft_consensus.cc:359] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.098701 10784 raft_consensus.cc:385] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.098948 10784 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.100255 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.103619 10783 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.104077 10783 ts_tablet_manager.cc:1403] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.245s	user 0.015s	sys 0.014s
I20260709 13:15:15.106627 10783 raft_consensus.cc:359] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.107398 10783 raft_consensus.cc:385] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.107786 10783 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
W20260709 13:15:15.107844 10635 leader_election.cc:343] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.110023 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.110654 10736 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:15.114841 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.116144 10841 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:15.116537 10841 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.117113 10841 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.128019 11127 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.127535 10492 catalog_manager.cc:5697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:15.136296 11245 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:15:15.138101 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.138684 10590 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.142385 10785 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.142803 10785 ts_tablet_manager.cc:1403] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.280s	user 0.019s	sys 0.042s
I20260709 13:15:15.131167 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.132448 10784 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.145555 10738 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 0.
I20260709 13:15:15.146689 10635 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:15.149827 11250 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.150164 11250 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.150483 11250 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.151731 11211 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.161795 10784 ts_tablet_manager.cc:1434] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:15:15.163409 10784 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:15.162256 10590 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:15.165076 10632 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:15.165899 11027 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.166659 10785 raft_consensus.cc:359] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.167089 11154 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.167318 10785 raft_consensus.cc:385] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.167640 10785 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.167629 11154 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.169795 11154 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.169726 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:15.171391 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.171942 10669 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.170704 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:15.172539 10635 leader_election.cc:343] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.172645 11211 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.173611 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.174139 11127 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:15.174288 10706 leader_election.cc:343] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.174686 11154 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.171129 10785 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.187608 11154 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.188016 11154 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.135577 10841 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.189036 10785 ts_tablet_manager.cc:1434] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.002s
I20260709 13:15:15.185953 11250 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.189942 10785 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.194226 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.194527 11154 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.172585 10783 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.198944 11104 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.199357 11104 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.201200 11104 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.202592 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.203274 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.204120 10669 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
W20260709 13:15:15.205255 10706 leader_election.cc:343] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.206154 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.206975 11104 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.207312 11104 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.207646 11104 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.208618 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:15.209156 10734 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:15.209270 10632 leader_election.cc:343] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.210071 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.212896 11250 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.213841 10841 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.215586 10783 ts_tablet_manager.cc:1434] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
I20260709 13:15:15.216202 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:15.216562 10783 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.216727 10738 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.216835 10785 tablet_bootstrap.cc:654] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.217556 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.218149 11104 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.219089 10734 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:15.218175 10590 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.219333 11027 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:15.220245 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:15.220779 11027 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.223187 10784 tablet_bootstrap.cc:654] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.223825 10738 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:15.224079 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:15.224682 10662 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.229744 10635 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:15.231998 10841 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.232575 10841 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:15.232108 11104 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:15.234366 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:15.233453 10841 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.221947 11253 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:15.241267 10662 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.241438 10785 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.242014 10785 ts_tablet_manager.cc:1403] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.006s
I20260709 13:15:15.242245 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:15.243592 11104 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.243793 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:15.244421 10669 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.244803 10783 tablet_bootstrap.cc:654] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.244644 11104 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:15.241474 11154 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.245754 11104 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.246394 11253 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:15.247360 11253 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.248433 10785 raft_consensus.cc:359] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.249128 10785 raft_consensus.cc:385] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.249403 10785 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.237663 10784 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:15.250226 10784 ts_tablet_manager.cc:1403] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.001s
I20260709 13:15:15.250039 10785 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.250722 11212 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.257213 10785 ts_tablet_manager.cc:1434] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:15:15.258173 10785 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.258298 11211 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.263432 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.263999 10590 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.266803 10784 raft_consensus.cc:359] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.267544 10784 raft_consensus.cc:385] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.267966 10784 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.283723 10669 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.285885 10785 tablet_bootstrap.cc:654] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.292577 10489 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.294056 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.297710 10783 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.298159 10783 ts_tablet_manager.cc:1403] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.005s
I20260709 13:15:15.300854 11212 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:15.301347 11212 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.304857 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.305612 10738 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:15.305485 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.307124 10560 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:15.307436 10560 leader_election.cc:403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:15.307926 11212 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.309612 11212 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.294973 11154 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.323661 11154 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:15.325039 11154 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.291764 10590 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.289031 10784 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.341514 11253 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.341917 11253 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.319043 11212 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:15.342828 10784 ts_tablet_manager.cc:1434] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
W20260709 13:15:15.320582 10560 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.343802 10784 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:15.319590 10783 raft_consensus.cc:359] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.344269 10783 raft_consensus.cc:385] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.344621 10783 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.345290 10783 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.346452 11253 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.346395 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.347426 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:15.348737 10635 leader_election.cc:343] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:15.350006 10632 leader_election.cc:343] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.350370 10632 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:15.351173 10784 tablet_bootstrap.cc:654] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.351218 11253 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.358520 10783 ts_tablet_manager.cc:1434] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.004s
I20260709 13:15:15.371078 11212 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.378065 11212 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.375703 10784 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:15.379341 10784 ts_tablet_manager.cc:1403] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:15:15.380035 11212 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.379755 10492 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.381907 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.381927 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.382637 10784 raft_consensus.cc:359] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.383630 10784 raft_consensus.cc:385] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.383968 10784 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.385010 10784 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.382675 10738 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:15.386893 10560 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:15.387320 10784 ts_tablet_manager.cc:1434] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:15.387768 11212 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.388232 10784 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:15.394354 11212 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.399703 10784 tablet_bootstrap.cc:654] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.401839 10785 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.402411 10785 ts_tablet_manager.cc:1403] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.053s
I20260709 13:15:15.404816 10785 raft_consensus.cc:359] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.405380 10783 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.405493 10785 raft_consensus.cc:385] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.405875 10785 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.406538 10785 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.408483 10785 ts_tablet_manager.cc:1434] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:15:15.409349 10784 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:15.409765 10784 ts_tablet_manager.cc:1403] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.006s
I20260709 13:15:15.409802 10785 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.411437 10783 tablet_bootstrap.cc:654] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.412233 10784 raft_consensus.cc:359] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.412879 10784 raft_consensus.cc:385] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.413141 10784 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.413868 10784 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.415493 10784 ts_tablet_manager.cc:1434] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:15.416087 11127 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.416400 10784 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Bootstrap starting.
I20260709 13:15:15.416538 11127 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.418439 11127 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.438153 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:15.442364 10632 leader_election.cc:343] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.447396 10784 tablet_bootstrap.cc:654] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.448863 10785 tablet_bootstrap.cc:654] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.458894 10785 tablet_bootstrap.cc:492] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.459265 10785 ts_tablet_manager.cc:1403] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:15:15.461748 10785 raft_consensus.cc:359] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.462391 10785 raft_consensus.cc:385] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.463346 10784 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: No bootstrap required, opened a new log
I20260709 13:15:15.463794 10784 ts_tablet_manager.cc:1403] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.002s
I20260709 13:15:15.464578 10783 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.465039 10783 ts_tablet_manager.cc:1403] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.020s
I20260709 13:15:15.466270 10784 raft_consensus.cc:359] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.466899 10784 raft_consensus.cc:385] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.467147 10784 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.467337 10783 raft_consensus.cc:359] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.467980 10783 raft_consensus.cc:385] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.467759 10784 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.468377 10783 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.467980 10489 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.468845 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.469429 10784 ts_tablet_manager.cc:1434] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:15:15.469125 10783 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.469733 10489 catalog_manager.cc:5697] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.471031 10783 ts_tablet_manager.cc:1434] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:15.471866 10783 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.462638 10785 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.477203 10783 tablet_bootstrap.cc:654] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.476999 10785 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.483070 10785 ts_tablet_manager.cc:1434] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:15:15.484311 10785 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.487840 10783 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.488260 10783 ts_tablet_manager.cc:1403] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:15:15.491384 10783 raft_consensus.cc:359] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.491986 10783 raft_consensus.cc:385] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.492226 10783 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.492777 10783 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:15.495041 10635 leader_election.cc:343] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.495514 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:15.497272 10783 ts_tablet_manager.cc:1434] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:15.497756 11253 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.498239 10783 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.501822 11212 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.509230 10783 tablet_bootstrap.cc:654] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.507193 10490 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.510216 10490 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.513839 10785 tablet_bootstrap.cc:654] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.520242 10783 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.520648 10783 ts_tablet_manager.cc:1403] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:15:15.523041 10783 raft_consensus.cc:359] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.523768 10783 raft_consensus.cc:385] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.524003 10783 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.524770 10783 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.526355 10783 ts_tablet_manager.cc:1434] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:15.531394 10783 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.536566 10783 tablet_bootstrap.cc:654] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.559581 10785 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.560165 10785 ts_tablet_manager.cc:1403] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.003s
I20260709 13:15:15.563346 10785 raft_consensus.cc:359] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.564203 10785 raft_consensus.cc:385] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.564533 10785 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.566103 10785 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.578960 10785 ts_tablet_manager.cc:1434] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:15:15.580076 10785 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.581079 10783 tablet_bootstrap.cc:492] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.587241 10783 ts_tablet_manager.cc:1403] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.023s
I20260709 13:15:15.586736 10785 tablet_bootstrap.cc:654] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.590256 10783 raft_consensus.cc:359] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.590943 10783 raft_consensus.cc:385] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.591245 10783 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.591904 10783 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.594099 10783 ts_tablet_manager.cc:1434] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:15.595860 10783 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.601739 10783 tablet_bootstrap.cc:654] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.617095 11127 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.621667 10783 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.622112 10783 ts_tablet_manager.cc:1403] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:15:15.624627 10783 raft_consensus.cc:359] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.625244 10783 raft_consensus.cc:385] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.625609 10783 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.626178 10783 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.628149 10783 ts_tablet_manager.cc:1434] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:15.629040 10783 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.622164 10785 tablet_bootstrap.cc:492] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.629907 10785 ts_tablet_manager.cc:1403] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.001s
I20260709 13:15:15.635389 10783 tablet_bootstrap.cc:654] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.645054 11127 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.652031 11027 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.652483 11027 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.655841 11027 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.658396 10783 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.658810 10783 ts_tablet_manager.cc:1403] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 13:15:15.659358 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:15.656972 10635 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:15.662647 10635 leader_election.cc:343] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.661968 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.665895 11201 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.632380 10785 raft_consensus.cc:359] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.666360 11201 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.666442 10785 raft_consensus.cc:385] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.667526 10785 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.661795 10783 raft_consensus.cc:359] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.668145 10783 raft_consensus.cc:385] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.668417 10783 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.669010 10783 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.669879 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.670457 10590 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.671078 10783 ts_tablet_manager.cc:1434] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:15.671557 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.671952 10783 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.672211 11104 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.672564 11104 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.672874 11104 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.675804 10785 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.677524 10783 tablet_bootstrap.cc:654] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.680969 10785 ts_tablet_manager.cc:1434] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:15:15.682780 11212 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.683367 11212 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.687912 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.687949 11212 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.688683 10662 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:15.688951 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.689020 11201 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.690372 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:15.692281 11212 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.693892 10785 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
W20260709 13:15:15.701985 10632 leader_election.cc:343] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.702395 10632 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:15.707926 11027 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.697060 10734 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:15.709661 10589 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:15.698567 11104 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.712168 11104 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.711103 11027 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.716228 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:15.716744 10590 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.716856 10785 tablet_bootstrap.cc:654] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.720610 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.721194 10662 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.721447 11253 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.724159 11212 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.725608 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:15.753890 10669 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.728273 10588 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.756383 11127 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:15.771921 11104 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.772414 11104 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.774319 11104 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.775255 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.776433 10667 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.778507 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.778507 10669 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.780877 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:15.781699 11201 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.779105 11154 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:15.782265 11201 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:15.782899 10785 tablet_bootstrap.cc:492] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:15.781630 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.783310 10785 ts_tablet_manager.cc:1403] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.012s
I20260709 13:15:15.784446 10783 tablet_bootstrap.cc:492] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:15.784881 10783 ts_tablet_manager.cc:1403] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.113s	user 0.030s	sys 0.038s
I20260709 13:15:15.783138 11201 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.776902 11127 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.788687 11127 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.783610 10594 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:15.792084 10590 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:15.792639 11127 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.793012 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:15.793757 10594 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:15.785807 11104 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.794759 11104 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.795068 11104 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.798431 11105 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.800276 10785 raft_consensus.cc:359] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.800961 10785 raft_consensus.cc:385] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.803148 10785 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.807662 11027 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.808498 11027 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.817687 11009 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.818244 11009 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.805050 10785 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.855952 10783 raft_consensus.cc:359] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.856614 10783 raft_consensus.cc:385] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.856890 10783 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.837679 11253 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.838168 11211 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.844646 11009 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:15.862406 10783 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.932956 10783 ts_tablet_manager.cc:1434] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.148s	user 0.007s	sys 0.006s
I20260709 13:15:15.916739 11285 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.945928 10785 ts_tablet_manager.cc:1434] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.162s	user 0.034s	sys 0.037s
I20260709 13:15:15.909032 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:15.921649 11009 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.919965 11211 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.958925 10785 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:15.909137 11253 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.977300 10783 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:15.944329 11284 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.950095 11104 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.985965 11284 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.002307 11027 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.003181 11104 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:15.959851 11009 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:15.989481 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:15.956084 11285 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.012143 11250 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.047348 11284 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.040413 11290 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.062644 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.086848 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.087816 10669 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:16.042390 11104 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:15:16.057018 10734 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:16.107575 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:16.067906 11250 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.115298 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.117736 10669 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:16.101831 11212 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.087682 11290 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.121263 11285 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.139663 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.140400 10667 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:16.129266 11284 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:16.130566 11291 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:15:16.143486 11104 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.125154 11212 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.145511 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:16.141685 10708 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:16.152185 11104 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.157531 11104 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.148814 10735 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.147253 11284 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:16.170363 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51571.3us
I20260709 13:15:16.161824 11284 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.174566 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.176491 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.177166 10667 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:16.178658 10559 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.184202 11309 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.184684 11309 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.185101 11309 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.215427 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.163826 11303 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.216110 11250 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.216322 11303 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.216534 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.216674 11303 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.172816 11212 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:16.218521 11292 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:15:16.217137 11290 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.219213 11300 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.219121 10664 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:16.234417 11300 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.246417 10785 tablet_bootstrap.cc:654] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.247735 11300 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:16.267488 11301 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:15:16.268945 10783 tablet_bootstrap.cc:654] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:16.270902 11287 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.406s	user 0.000s	sys 0.005s
I20260709 13:15:16.278509 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:16.278964 11009 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.279071 10586 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.281105 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:16.287492 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57490.9us
I20260709 13:15:16.292973 10559 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.296036 11211 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:16.298660 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 153241us
I20260709 13:15:16.301517 11299 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:16.301841 11299 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:16.302153 11299 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:16.307787 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:16.288763 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.326020 11309 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.327956 11309 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.315351 11316 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.328895 11316 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.329218 11316 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.319774 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.323153 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.346546 11303 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.346896 11300 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.348135 10585 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:16.348562 11303 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.350092 11300 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.347589 11299 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.352012 11299 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.353451 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.354058 10660 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.357188 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.357786 10662 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.360281 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.360872 10734 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:16.361657 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.339555 10591 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:16.402875 10662 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:16.403585 10586 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:16.405481 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.410840 10739 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:16.407181 10560 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:16.352959 11284 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.407706 10660 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:16.414223 11211 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:16.416193 11284 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.419183 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:16.420384 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:16.424135 11253 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.437076 10734 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.437956 11316 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.425786 10785 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:16.438859 10785 ts_tablet_manager.cc:1403] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.480s	user 0.020s	sys 0.005s
I20260709 13:15:16.438890 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.439713 10590 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:16.441083 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.440582 10491 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:16.427537 10560 leader_election.cc:343] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.427801 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.429708 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.431089 11154 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.443172 10588 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:16.433549 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.444780 10661 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.450248 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.451049 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.451562 10669 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.452539 10734 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:16.453553 11211 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.433720 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:16.434734 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.454164 11211 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:16.454324 10667 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.455230 11211 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.458532 10669 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:16.459661 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.460282 10667 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:16.461234 10559 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.461966 11294 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.424968 10783 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:16.462433 11294 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:16.462574 10783 ts_tablet_manager.cc:1403] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.504s	user 0.020s	sys 0.008s
I20260709 13:15:16.463217 11294 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.466295 10785 raft_consensus.cc:359] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.466950 10785 raft_consensus.cc:385] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.467202 10785 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.467810 10785 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:16.470873 10632 leader_election.cc:343] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.471150 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:16.471868 10591 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 1: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:16.474855 10560 leader_election.cc:343] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.475461 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:16.475999 10591 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.477453 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:16.480765 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.483848 11299 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:16.484226 11299 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.484606 11299 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.484665 10591 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:16.484876 10661 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
W20260709 13:15:16.489146 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55495.5us
I20260709 13:15:16.489418 11154 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.489897 11154 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:16.490689 11154 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.495642 10785 ts_tablet_manager.cc:1434] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:15:16.496830 10785 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:16.499841 10783 raft_consensus.cc:359] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.500478 10783 raft_consensus.cc:385] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.500738 10783 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.505683 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.506301 10734 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:16.507858 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:16.508267 10734 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.508807 10737 raft_consensus.cc:2368] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:16.512554 11317 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.513819 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.518939 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:16.519675 11317 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:16.520162 11317 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:16.520972 11317 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.517303 10661 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:16.523875 11316 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.525573 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:16.527701 11323 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.007s
I20260709 13:15:16.529070 11303 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.530432 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:16.483265 10635 leader_election.cc:343] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.531152 10737 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 1: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:16.530889 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:16.535262 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:16.538753 11154 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.539461 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:16.539981 11296 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.540684 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:16.541189 11294 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:16.540903 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 57664.7us
I20260709 13:15:16.548679 11299 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.551641 10783 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.564687 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:16.565477 10585 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.565786 10708 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:16.566736 11303 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.567188 11303 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:16.568135 11303 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.578212 11317 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.585726 10585 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:16.586163 10783 ts_tablet_manager.cc:1434] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.003s
I20260709 13:15:16.587141 10783 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:16.586995 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:16.587745 11296 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.588346 11296 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:16.589110 11296 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.596652 11299 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.615589 10635 leader_election.cc:400] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:16.616024 10635 leader_election.cc:403] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:16.659745 11295 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
W20260709 13:15:16.677312 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 61920.4us
W20260709 13:15:16.678189 10635 leader_election.cc:343] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.679260 10635 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:16.690111 10783 tablet_bootstrap.cc:654] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.699954 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:16.700660 10738 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.701509 10785 tablet_bootstrap.cc:654] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.695433 11295 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.711609 10783 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:16.712057 10783 ts_tablet_manager.cc:1403] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.002s
I20260709 13:15:16.717396 11154 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:16.811568 11286 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:16.817631 11316 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.812044 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47998.5us
I20260709 13:15:16.818138 11316 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.836243 10783 raft_consensus.cc:359] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.836858 10783 raft_consensus.cc:385] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.837088 10783 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.841964 10783 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.856324 11316 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.850832 11303 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.878811 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:16.880970 10738 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:16.881193 10785 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:16.881683 10785 ts_tablet_manager.cc:1403] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.385s	user 0.015s	sys 0.005s
I20260709 13:15:16.877849 11303 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.888204 11303 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:16.890210 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.890813 10666 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
W20260709 13:15:16.891243 10560 leader_election.cc:343] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.891686 10785 raft_consensus.cc:359] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.892321 10785 raft_consensus.cc:385] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.892571 10785 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.893252 10785 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.895334 10785 ts_tablet_manager.cc:1434] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:16.895601 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:16.896169 10785 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:16.896180 10665 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:16.898209 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:16.905730 11154 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.909852 11154 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.910269 11154 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.930497 10783 ts_tablet_manager.cc:1434] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.218s	user 0.024s	sys 0.013s
I20260709 13:15:16.930601 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:16.931900 11308 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.932214 11308 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.932518 11308 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.928390 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:16.941241 10591 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 0.
I20260709 13:15:16.946532 10734 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.926520 11154 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.957403 11308 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:16.967872 10490 catalog_manager.cc:5697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 0 to 2, leader changed from <none> to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.969383 11345 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.972174 10785 tablet_bootstrap.cc:654] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.973403 10783 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Bootstrap starting.
I20260709 13:15:16.981174 11285 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.983295 11308 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:16.984498 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:16.985258 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:16.985826 10665 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:16.986225 10560 leader_election.cc:343] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.994547 11284 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.992515 10489 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.000064 11308 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.013113 10489 catalog_manager.cc:5697] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.019281 11154 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:17.018747 10489 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.033111 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:17.033687 10661 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.041426 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:17.042138 10591 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.045508 10665 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:17.046959 10587 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:17.050338 10586 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:17.052291 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:17.057337 11317 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:17.063993 11346 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.066192 11212 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.069002 11346 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:17.070930 11346 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.064469 11297 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:15:17.088244 10783 tablet_bootstrap.cc:654] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.100522 10661 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:17.200131 10785 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:17.200604 10785 ts_tablet_manager.cc:1403] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.305s	user 0.015s	sys 0.009s
I20260709 13:15:17.214455 10785 raft_consensus.cc:359] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.214973 10785 raft_consensus.cc:385] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.215227 10785 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.216109 10785 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.157773 10591 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:17.222052 10785 ts_tablet_manager.cc:1434] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:15:17.211259 11285 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:17.223233 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:17.225536 11304 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.226260 11304 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:17.227314 11304 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.225442 11305 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:15:17.234498 11351 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:17.234680 10785 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Bootstrap starting.
I20260709 13:15:17.244940 11212 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.274272 10785 tablet_bootstrap.cc:654] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.314417 10783 tablet_bootstrap.cc:492] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: No bootstrap required, opened a new log
I20260709 13:15:17.314844 10783 ts_tablet_manager.cc:1403] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent bootstrapping tablet: real 0.351s	user 0.027s	sys 0.018s
I20260709 13:15:17.321720 10783 raft_consensus.cc:359] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.322355 10783 raft_consensus.cc:385] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.322603 10783 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.323208 10783 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.325385 10783 ts_tablet_manager.cc:1434] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:17.332712 10738 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:17.345438 10491 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.350636 10491 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.368043 10666 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:17.379091 10785 tablet_bootstrap.cc:492] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: No bootstrap required, opened a new log
I20260709 13:15:17.379536 10785 ts_tablet_manager.cc:1403] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.001s
I20260709 13:15:17.381700 11253 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.383345 10492 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 0 to 1, leader changed from <none> to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.385951 10785 raft_consensus.cc:359] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.386583 10785 raft_consensus.cc:385] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.386833 10785 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.387439 10785 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:17.404747 10540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:17.411686 10785 ts_tablet_manager.cc:1434] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:15:17.413965 11291 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.425283 10491 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.485649 10738 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.485962 11308 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.495028 11308 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.545830 11308 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.546327 11308 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.554201 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:17.554800 10666 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:17.555989 10559 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:17.556758 11345 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.557133 11345 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.557497 11345 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.561926 11308 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:17.563150 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:17.564108 10738 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 0.
I20260709 13:15:17.567885 11345 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.570891 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:17.570971 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:17.571456 10738 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.571543 10666 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.577173 10738 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:17.578078 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:17.579347 11289 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.579818 11289 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:17.580578 11289 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:17.581578 11345 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 1 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:17.581291 10666 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:17.595958 10491 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.764436 11284 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.783586 11154 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.864073  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.907708 11370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.907456 11373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.907464 11371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.910151  9489 server_base.cc:1061] running on GCE node
I20260709 13:15:17.913085  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.913277  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.913543  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783602917913524 us; error 0 us; skew 500 ppm
I20260709 13:15:17.914146  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.919631  9489 webserver.cc:533] Webserver started at http://127.9.68.68:34795/ using document root <none> and password file <none>
I20260709 13:15:17.920293  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.920557  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.920948  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.922426  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-3-root/instance:
uuid: "e71e2e44af1e46d8a8423ae08646bc22"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-9s6w"
I20260709 13:15:17.940089  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:15:17.946280 11378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.947379  9489 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
I20260709 13:15:17.947786  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
uuid: "e71e2e44af1e46d8a8423ae08646bc22"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-9s6w"
I20260709 13:15:17.948161  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.961444  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.963192  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.965088  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.969386  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.969594  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.969854  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.970027  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.974722 11308 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.998031 11289 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.124221  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.68:35619
I20260709 13:15:18.124305 11442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.68:35619 every 8 connection(s)
I20260709 13:15:18.141947  9489 auto_leader_rebalancer-test.cc:384] add a tserver: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:18.162832 11443 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35023
I20260709 13:15:18.163303 11443 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:18.164000 11443 heartbeater.cc:507] Master 127.9.68.126:35023 requested a full tablet report, sending...
I20260709 13:15:18.166292 10490 ts_manager.cc:194] Registered new tserver with Master: e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:18.168138 10490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35658
I20260709 13:15:18.527930 10586 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:18.534813 10738 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:18.536415 10660 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:18.536468 11345 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:18.545823 11308 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.567188 11345 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.571521 10666 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.580291 10738 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.602007 10490 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
W20260709 13:15:18.594303 10557 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00e9824bb588413ab262854eb713a965. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:18.634094 10738 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:18.642979 10666 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.644384 11447 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.649712 10586 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.651793 11284 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:18.658608 10706 consensus_peers.cc:597] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86f93e93739544bc8c7af65e566a65d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:18.721132 11291 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.725582 10666 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.744825 10489 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.761555 10586 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.795086 10666 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:18.801674 10738 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:18.803192 11465 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.805661 10586 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:18.807966 11465 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.834539 11253 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
W20260709 13:15:18.837482 10632 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9ac19ea4edd4e26890c806619f5b551. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:18.839257 10734 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.871340 10489 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.883526 10587 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.889039 10588 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:18.923790 10738 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:18.924049 10557 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d63a40a747147e987c1c81889fd1a0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:18.924562 10666 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.925209 11455 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.926200 11308 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.945473 11308 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.946882 10666 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.964939 10489 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:18.976704 10738 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:19.071601 11475 ts_tablet_manager.cc:933] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:19.075774 11475 tablet_copy_client.cc:323] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:19.089830 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 86f93e93739544bc8c7af65e566a65d6 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:19.090394 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 86f93e93739544bc8c7af65e566a65d6 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-86f93e93739544bc8c7af65e566a65d6
I20260709 13:15:19.098143 10753 tablet_copy_source_session.cc:215] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:19.099731 11478 ts_tablet_manager.cc:933] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:19.109728 11475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f93e93739544bc8c7af65e566a65d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.121922 11478 tablet_copy_client.cc:323] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:19.128988 11475 tablet_copy_client.cc:806] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:19.129712 11475 tablet_copy_client.cc:670] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:19.133982 11475 tablet_copy_client.cc:538] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:19.162443 11475 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:19.165910 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 00e9824bb588413ab262854eb713a965 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:19.166558 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 00e9824bb588413ab262854eb713a965 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-00e9824bb588413ab262854eb713a965
I20260709 13:15:19.173902 11443 heartbeater.cc:499] Master 127.9.68.126:35023 was elected leader, sending a full tablet report...
I20260709 13:15:19.178412 10604 tablet_copy_source_session.cc:215] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:19.181529 11478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e9824bb588413ab262854eb713a965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.206238 11475 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:19.207353 11475 tablet_bootstrap.cc:492] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:19.207985 11475 ts_tablet_manager.cc:1403] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.013s
I20260709 13:15:19.212745 11475 raft_consensus.cc:359] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.213567 11475 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:19.214282 11475 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.225811 11475 ts_tablet_manager.cc:1434] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:15:19.231529 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-86f93e93739544bc8c7af65e566a65d6 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:19.232089 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-86f93e93739544bc8c7af65e566a65d6 on tablet 86f93e93739544bc8c7af65e566a65d6 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:19.257660 11475 ts_tablet_manager.cc:933] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:19.266741 11478 tablet_copy_client.cc:806] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:19.267388 11478 tablet_copy_client.cc:670] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:19.269730 11475 tablet_copy_client.cc:323] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:19.270941 11478 tablet_copy_client.cc:538] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:19.291261 11478 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
W20260709 13:15:19.390244 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62353.2us
I20260709 13:15:19.451929 11482 ts_tablet_manager.cc:933] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:19.453826 11482 tablet_copy_client.cc:323] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:19.455823 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 3d63a40a747147e987c1c81889fd1a0d from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:19.456501 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 3d63a40a747147e987c1c81889fd1a0d from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-3d63a40a747147e987c1c81889fd1a0d
I20260709 13:15:19.468966 10604 tablet_copy_source_session.cc:215] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:19.497871 10679 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet d9ac19ea4edd4e26890c806619f5b551 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:19.563934 10679 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet d9ac19ea4edd4e26890c806619f5b551 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-d9ac19ea4edd4e26890c806619f5b551
I20260709 13:15:19.567452 11482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63a40a747147e987c1c81889fd1a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.571070 10679 tablet_copy_source_session.cc:215] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:19.574493 11475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ac19ea4edd4e26890c806619f5b551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.595126 11475 tablet_copy_client.cc:806] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:19.595992 11475 tablet_copy_client.cc:670] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:19.601814 11475 tablet_copy_client.cc:538] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:19.606019 11418 raft_consensus.cc:1217] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:15:19.605962 11482 tablet_copy_client.cc:806] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:19.609437 11482 tablet_copy_client.cc:670] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:19.613502 11482 tablet_copy_client.cc:538] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:19.629679 11478 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:19.630563 11478 tablet_bootstrap.cc:492] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:19.631244 11478 ts_tablet_manager.cc:1403] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.340s	user 0.128s	sys 0.132s
I20260709 13:15:19.632140 11482 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:19.634009 11478 raft_consensus.cc:359] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.634829 11478 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:19.635483 11478 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.637812 11478 ts_tablet_manager.cc:1434] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:19.641638 11475 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:19.642793 11417 raft_consensus.cc:1217] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:19.643371 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-00e9824bb588413ab262854eb713a965 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:19.643831 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-00e9824bb588413ab262854eb713a965 on tablet 00e9824bb588413ab262854eb713a965 with peer e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:19.707983 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48131.7us
I20260709 13:15:19.754324 11475 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:19.755748 11475 tablet_bootstrap.cc:492] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:19.756950 11475 ts_tablet_manager.cc:1403] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.013s
I20260709 13:15:19.771060 11482 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:19.772635 11482 tablet_bootstrap.cc:492] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:19.774009 11482 ts_tablet_manager.cc:1403] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.142s	user 0.023s	sys 0.008s
I20260709 13:15:19.775637 11475 raft_consensus.cc:359] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.780465 11475 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:19.781296 11475 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.797906 11475 ts_tablet_manager.cc:1434] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.006s
I20260709 13:15:19.800304 10679 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-d9ac19ea4edd4e26890c806619f5b551 received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:19.800933 10679 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-d9ac19ea4edd4e26890c806619f5b551 on tablet d9ac19ea4edd4e26890c806619f5b551 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:19.825374 11482 raft_consensus.cc:359] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.834743 11482 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:19.845824 11482 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:19.856451 11482 ts_tablet_manager.cc:1434] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 13:15:19.859844 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-3d63a40a747147e987c1c81889fd1a0d received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:19.860427 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-3d63a40a747147e987c1c81889fd1a0d on tablet 3d63a40a747147e987c1c81889fd1a0d with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:20.035526 11417 raft_consensus.cc:1217] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:20.043025 11490 raft_consensus.cc:1064] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:20.047643 11490 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.066764 11417 raft_consensus.cc:1217] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:15:20.092329 11417 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.093954 11500 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.095085 11486 raft_consensus.cc:1064] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:20.097962 11486 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.104627 10666 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.108467 10736 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.110219 11308 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.113298 11308 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.163343 10666 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.162508 11490 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.164134 11417 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.165006 11291 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:20.175338 11418 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.178972 11488 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:20.187134 10736 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.192338 10660 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.204283 10489 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.242015 10588 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.243455 11291 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:20.291792 11291 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.294517 10587 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.304152 11418 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.315285 10588 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.320660 10489 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.341101 11418 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:20.343169 10737 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:20.344801 11490 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.353034 11308 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.354629 11490 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.359144 11418 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.370639 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00e9824bb588413ab262854eb713a965 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:20.357805 10737 raft_consensus.cc:2955] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.406085 10666 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.427407 10489 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:15:20.434388 10476 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 00e9824bb588413ab262854eb713a965 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:15:20.483332 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 00e9824bb588413ab262854eb713a965 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35970
W20260709 13:15:20.490214 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 66714.6us
I20260709 13:15:20.527149 11512 tablet_replica.cc:333] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:20.528733 11512 raft_consensus.cc:2243] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:20.529533 11512 raft_consensus.cc:2272] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:20.533069 11512 ts_tablet_manager.cc:1916] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:20.537931 11490 raft_consensus.cc:1064] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:20.547108 11490 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.551978 10737 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.566234 11418 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:20.568444 10660 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:20.570950 11514 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:20.576465 11291 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.577245 11512 ts_tablet_manager.cc:1929] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:20.577761 11512 log.cc:1199] T 00e9824bb588413ab262854eb713a965 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/00e9824bb588413ab262854eb713a965
I20260709 13:15:20.579878 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 00e9824bb588413ab262854eb713a965 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:20.583334 11417 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.586812 11289 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:20.587764 10737 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.589838 11308 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.592669 11488 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.598824 11417 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.601770 10666 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:20.603232 11308 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.606703 10660 raft_consensus.cc:2955] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.643929 10490 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.656116 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet 86f93e93739544bc8c7af65e566a65d6 with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:20.674938 11521 tablet_replica.cc:333] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:20.673864 11490 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.675263 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86f93e93739544bc8c7af65e566a65d6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:20.696348 11521 raft_consensus.cc:2243] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:20.697160 11521 raft_consensus.cc:2272] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:20.697944 10660 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.698355 11418 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.701704 11496 raft_consensus.cc:1064] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:20.704320 11496 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.715164 10737 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.721931 11521 ts_tablet_manager.cc:1916] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:20.740459 10490 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.789538 11521 ts_tablet_manager.cc:1929] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:15:20.790107 11521 log.cc:1199] T 86f93e93739544bc8c7af65e566a65d6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/86f93e93739544bc8c7af65e566a65d6
I20260709 13:15:20.791761 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet 86f93e93739544bc8c7af65e566a65d6 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:20.795429 10737 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.796761 11517 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.797197 11418 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.797379 10587 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:20.799238 11517 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.800978 11516 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.826623 10588 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.827279 10738 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.825270 11465 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.847985 11418 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:20.848152 10660 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:20.849407 11308 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.853638 11455 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.866930 11490 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.868510 10660 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.872640 10588 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.875507 10492 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.885080 11418 raft_consensus.cc:2955] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.903746 11417 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.909919 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d63a40a747147e987c1c81889fd1a0d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:20.916757 10663 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:20.950856 11417 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:20.951855 10588 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:20.951226 10492 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.965888 11465 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.970494 11517 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.970927 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d63a40a747147e987c1c81889fd1a0d with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:20.978672 11528 tablet_replica.cc:333] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:20.980227 11528 raft_consensus.cc:2243] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:20.980325 11517 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.982761 10587 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:20.987399 11528 raft_consensus.cc:2272] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:20.990845 11528 ts_tablet_manager.cc:1916] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.004251 10492 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:21.007380 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9ac19ea4edd4e26890c806619f5b551 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:21.017781 11528 ts_tablet_manager.cc:1929] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:15:21.018214 11528 log.cc:1199] T 3d63a40a747147e987c1c81889fd1a0d P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/3d63a40a747147e987c1c81889fd1a0d
I20260709 13:15:21.020817 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 3d63a40a747147e987c1c81889fd1a0d (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:21.025285 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ac19ea4edd4e26890c806619f5b551 with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:21.025755 11418 raft_consensus.cc:2955] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:21.029826 11528 tablet_replica.cc:333] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:21.031036 11528 raft_consensus.cc:2243] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.031800 11528 raft_consensus.cc:2272] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.034910 11528 ts_tablet_manager.cc:1916] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.049518 11528 ts_tablet_manager.cc:1929] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:21.049964 11528 log.cc:1199] T d9ac19ea4edd4e26890c806619f5b551 P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/d9ac19ea4edd4e26890c806619f5b551
I20260709 13:15:21.051499 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet d9ac19ea4edd4e26890c806619f5b551 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:22.114560 10585 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.125559 10738 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.126183 10666 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.127707 11345 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.128500 11308 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:22.129681 10557 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c98bbebd7a849a6b0596781b7853ce3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.136441 11531 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.142431 10738 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.147921 10666 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.170375 10491 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.177172 10738 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.192056 10666 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.193382 11529 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:22.198781 10706 consensus_peers.cc:597] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: feaf88905a8f4cc8bf8e751c1f163180. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.200215 10585 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.202118 11291 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.219743 11291 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.227798 10666 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.233250 10585 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.254364 10588 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.269907 10490 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.280553 10738 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:15:22.282784 10557 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eaf67a9a92d14fbeaf459c21b6c42278. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.285074 11308 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:22.289304 10663 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:22.290983 11531 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:22.306150 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 60472.8us
I20260709 13:15:22.310806 11345 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.320606 10663 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.323827 10737 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.336395 10738 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.340350 10492 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.357291 10585 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:22.358814 11541 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:22.364818 10706 consensus_peers.cc:597] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d1c58f717d74f2fba0ed73c78de0673. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.364878 10663 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:22.367591 11529 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:22.384032 11291 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.386121 10588 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.389694 10666 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:22.408783 10492 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.600711 11550 ts_tablet_manager.cc:933] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:22.603035 11550 tablet_copy_client.cc:323] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:22.604835 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 2c98bbebd7a849a6b0596781b7853ce3 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:22.605381 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 2c98bbebd7a849a6b0596781b7853ce3 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-2c98bbebd7a849a6b0596781b7853ce3
I20260709 13:15:22.623808 10604 tablet_copy_source_session.cc:215] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:22.627020 11550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c98bbebd7a849a6b0596781b7853ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.643288 11550 tablet_copy_client.cc:806] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:22.643886 11550 tablet_copy_client.cc:670] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:22.652925 11550 tablet_copy_client.cc:538] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:22.663923 11550 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:22.696731 11550 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:22.697805 11550 tablet_bootstrap.cc:492] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:22.698527 11550 ts_tablet_manager.cc:1403] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.019s
I20260709 13:15:22.701514 11550 raft_consensus.cc:359] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.702279 11550 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:22.702924 11550 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.776316 11553 ts_tablet_manager.cc:933] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:22.793110 11550 ts_tablet_manager.cc:1434] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.094s	user 0.029s	sys 0.040s
I20260709 13:15:22.795081 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-2c98bbebd7a849a6b0596781b7853ce3 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:22.795369 11553 tablet_copy_client.cc:323] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:22.795503 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-2c98bbebd7a849a6b0596781b7853ce3 on tablet 2c98bbebd7a849a6b0596781b7853ce3 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:22.797328 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet feaf88905a8f4cc8bf8e751c1f163180 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:22.797881 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet feaf88905a8f4cc8bf8e751c1f163180 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-feaf88905a8f4cc8bf8e751c1f163180
I20260709 13:15:22.806270 10753 tablet_copy_source_session.cc:215] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:22.823187 11553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaf88905a8f4cc8bf8e751c1f163180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.841495 11553 tablet_copy_client.cc:806] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:22.842304 11553 tablet_copy_client.cc:670] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:22.848625 11553 tablet_copy_client.cc:538] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:22.855278 11553 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:22.869477 11550 ts_tablet_manager.cc:933] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:22.871778 11550 tablet_copy_client.cc:323] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:22.873854 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet eaf67a9a92d14fbeaf459c21b6c42278 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:22.874521 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet eaf67a9a92d14fbeaf459c21b6c42278 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-eaf67a9a92d14fbeaf459c21b6c42278
I20260709 13:15:22.883911 11553 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:22.884744 11553 tablet_bootstrap.cc:492] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:22.885447 11553 ts_tablet_manager.cc:1403] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.013s
I20260709 13:15:22.888757 11553 raft_consensus.cc:359] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.889596 11553 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:22.890254 11553 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:22.898555 11553 ts_tablet_manager.cc:1434] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:22.905750 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-feaf88905a8f4cc8bf8e751c1f163180 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:22.906177 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-feaf88905a8f4cc8bf8e751c1f163180 on tablet feaf88905a8f4cc8bf8e751c1f163180 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:22.907050 10604 tablet_copy_source_session.cc:215] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:22.910161 11550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf67a9a92d14fbeaf459c21b6c42278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.931073 11550 tablet_copy_client.cc:806] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:22.934037 11553 ts_tablet_manager.cc:933] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:22.935745 11550 tablet_copy_client.cc:670] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:22.942054 11553 tablet_copy_client.cc:323] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:22.944099 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 9d1c58f717d74f2fba0ed73c78de0673 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:22.944677 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 9d1c58f717d74f2fba0ed73c78de0673 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-9d1c58f717d74f2fba0ed73c78de0673
I20260709 13:15:22.945217 11550 tablet_copy_client.cc:538] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:22.952569 10753 tablet_copy_source_session.cc:215] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:22.955873 11553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1c58f717d74f2fba0ed73c78de0673. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.972328 11550 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:22.972756 11553 tablet_copy_client.cc:806] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:22.973677 11553 tablet_copy_client.cc:670] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:22.985893 11553 tablet_copy_client.cc:538] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:23.006608 11553 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:23.034618 11550 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.035928 11550 tablet_bootstrap.cc:492] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:23.037277 11550 ts_tablet_manager.cc:1403] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.004s
I20260709 13:15:23.058151 11550 raft_consensus.cc:359] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:23.060022 11550 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:23.067495 11550 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:23.074110 11550 ts_tablet_manager.cc:1434] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:15:23.075711 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-eaf67a9a92d14fbeaf459c21b6c42278 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:23.076097 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-eaf67a9a92d14fbeaf459c21b6c42278 on tablet eaf67a9a92d14fbeaf459c21b6c42278 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:23.087387 11553 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.088330 11553 tablet_bootstrap.cc:492] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:23.089061 11553 ts_tablet_manager.cc:1403] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.028s
I20260709 13:15:23.096149 11553 raft_consensus.cc:359] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:23.099028 11553 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:23.099686 11553 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:23.107028 11553 ts_tablet_manager.cc:1434] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:15:23.111176 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-9d1c58f717d74f2fba0ed73c78de0673 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:23.111606 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-9d1c58f717d74f2fba0ed73c78de0673 on tablet 9d1c58f717d74f2fba0ed73c78de0673 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:23.119419 11418 raft_consensus.cc:1217] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:23.136986 11418 raft_consensus.cc:1217] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:23.460286 11418 raft_consensus.cc:1217] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:23.483727 11418 raft_consensus.cc:1217] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:15:23.642055 11291 raft_consensus.cc:1064] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:23.644599 11291 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:23.667825 11418 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:23.669442 11291 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:23.872985 10666 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:23.944413 10585 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:23.961018 11291 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.014382 11308 raft_consensus.cc:1064] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:24.015050 11568 raft_consensus.cc:1064] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:24.019877 11308 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:24.021394 11568 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:24.055387 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 73447.8us
I20260709 13:15:24.071121 11529 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:24.130388 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 45355.5us
I20260709 13:15:24.136001 10665 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.136142 11572 raft_consensus.cc:1064] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:24.136343 10666 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:24.138417 11572 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:24.144133 11531 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.144544 11570 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.146878 10738 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.162361 11345 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.163486 10738 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:24.169929 11575 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:15:24.175030 11418 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.175616 11417 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:24.187950 11417 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:24.204588 10667 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:24.206574 11573 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:24.208082 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 76553.2us
I20260709 13:15:24.219089 11345 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.220446 11570 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.223671 10734 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.234848 11575 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.236747 11575 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.237888 10585 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:15:24.245613 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51500.1us
I20260709 13:15:24.239606 11572 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.240728 10492 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.251799 11529 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.248234 10586 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.255594 10667 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.234133 10742 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:15:24.310367 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44744us
I20260709 13:15:24.331491 11573 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.340251 11418 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.343834 11417 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.342229 10667 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.326695 11416 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.372443 11572 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.380483 10585 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.384186 10667 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.401422 10660 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.412710 11417 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.457217 10489 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.458709 10489 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.483534 10491 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.520169 10735 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:24.522222 10742 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:24.534272 11418 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:24.535856 11590 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.545109 11589 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.555435 11418 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.570966 10666 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.578879 11417 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.581830 11572 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.587196 11590 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.589672 10660 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:24.600095 11417 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.598778 11572 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.610460 11590 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.621532 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet feaf88905a8f4cc8bf8e751c1f163180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:24.624207 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d1c58f717d74f2fba0ed73c78de0673 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:24.630515 10660 raft_consensus.cc:2955] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.633978 10492 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 4 to 5, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.642591 10660 raft_consensus.cc:2955] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.647248 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d1c58f717d74f2fba0ed73c78de0673 with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:24.661957 10492 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:24.674014 10578 tablet_service.cc:1558] Processing DeleteTablet for tablet feaf88905a8f4cc8bf8e751c1f163180 with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:24.688627 11601 tablet_replica.cc:333] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:24.689668 11601 raft_consensus.cc:2243] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.690388 11601 raft_consensus.cc:2272] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.694172 11601 ts_tablet_manager.cc:1916] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:24.706063 11601 ts_tablet_manager.cc:1929] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:15:24.706424 11601 log.cc:1199] T 9d1c58f717d74f2fba0ed73c78de0673 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/9d1c58f717d74f2fba0ed73c78de0673
I20260709 13:15:24.707976 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet 9d1c58f717d74f2fba0ed73c78de0673 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:24.708165 11601 tablet_replica.cc:333] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:24.709625 11601 raft_consensus.cc:2243] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.710372 11601 raft_consensus.cc:2272] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.713706 11601 ts_tablet_manager.cc:1916] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:24.730293 11601 ts_tablet_manager.cc:1929] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:24.730695 11601 log.cc:1199] T feaf88905a8f4cc8bf8e751c1f163180 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/feaf88905a8f4cc8bf8e751c1f163180
I20260709 13:15:24.732151 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet feaf88905a8f4cc8bf8e751c1f163180 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
W20260709 13:15:24.736119 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800109860 after lost signal to thread 9492
W20260709 13:15:24.737102 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08000da7e0 after lost signal to thread 10526
W20260709 13:15:24.738210 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea560 after lost signal to thread 10618
W20260709 13:15:24.739188 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08002eaaa0 after lost signal to thread 10693
W20260709 13:15:24.740145 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800296b40 after lost signal to thread 10767
W20260709 13:15:24.741147 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800259760 after lost signal to thread 11442
I20260709 13:15:25.072943 10588 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:25.142674 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47807.6us
I20260709 13:15:25.145471 10735 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:25.148428 11604 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:25.155072 11605 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.157116 10742 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.181849 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c98bbebd7a849a6b0596781b7853ce3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:15:25.206086 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 112469us
I20260709 13:15:25.331360 10492 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.383984 11418 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:25.400264 11610 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:25.429176 11416 raft_consensus.cc:2955] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.461566 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c98bbebd7a849a6b0596781b7853ce3 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35970
I20260709 13:15:25.465191 10588 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:25.482703 11621 tablet_replica.cc:333] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:25.483942 11621 raft_consensus.cc:2243] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:25.484678 11621 raft_consensus.cc:2272] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.485054 11416 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.485685 10736 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.486660 11605 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.487593 11606 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.491835 11621 ts_tablet_manager.cc:1916] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:25.504696 11610 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.511317 11417 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.538226 11621 ts_tablet_manager.cc:1929] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:25.558068 11621 log.cc:1199] T 2c98bbebd7a849a6b0596781b7853ce3 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/2c98bbebd7a849a6b0596781b7853ce3
I20260709 13:15:25.570796 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 2c98bbebd7a849a6b0596781b7853ce3 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:25.748579 10734 raft_consensus.cc:2955] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.753577 10489 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:25.770722 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet eaf67a9a92d14fbeaf459c21b6c42278 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35970
I20260709 13:15:25.771786 11621 tablet_replica.cc:333] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:25.788326 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eaf67a9a92d14fbeaf459c21b6c42278 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:25.814132 11621 raft_consensus.cc:2243] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:25.814956 11621 raft_consensus.cc:2272] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.817595 11621 ts_tablet_manager.cc:1916] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:25.837587 11621 ts_tablet_manager.cc:1929] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:25.837893 11621 log.cc:1199] T eaf67a9a92d14fbeaf459c21b6c42278 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/eaf67a9a92d14fbeaf459c21b6c42278
I20260709 13:15:25.839178 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet eaf67a9a92d14fbeaf459c21b6c42278 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
W20260709 13:15:26.342697 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800305040 after lost signal to thread 9492
W20260709 13:15:26.343497 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800305720 after lost signal to thread 10526
W20260709 13:15:26.344527 11439 debug-util.cc:398] Leaking SignalData structure 0x7b080023b920 after lost signal to thread 10618
W20260709 13:15:26.345542 11439 debug-util.cc:398] Leaking SignalData structure 0x7b080027bf40 after lost signal to thread 10693
W20260709 13:15:26.346366 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800333de0 after lost signal to thread 10767
W20260709 13:15:26.347151 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800324bc0 after lost signal to thread 11442
I20260709 13:15:26.901062 10588 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:15:26.915535 10557 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7247478c2fbc418f85cf61569e673a75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.917927 10742 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:26.919507 11613 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:26.919809 10663 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:26.921232 11606 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:26.937054 11613 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:26.938742 10742 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:26.953377 10667 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:26.968920 10490 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.998669 10736 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:27.000741 11625 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.002542 10668 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
W20260709 13:15:27.005545 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0db5b0c3da3b45289300a692b98fa1c1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.019788 10589 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:27.021478 11625 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.043663 11565 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.045238 10742 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.078433 10663 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.079355 10588 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.113459 10736 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:27.117995 10589 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:27.120981 10632 consensus_peers.cc:597] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d2efcf18c8e45be8aebbfa42f61e9f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.120532 10489 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.126008 11565 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.132871 11565 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.151628 11625 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.189721 10736 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.210192 10591 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.218108 10489 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.220860 10589 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.293393 10661 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:27.295269 11613 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.298091 10736 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:27.302239 11610 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:27.303042 10557 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81565cb1f2054410aae97284b914f79c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:27.331979 11606 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.333210 10742 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.334759 10668 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.365236 10489 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:27.550786 11645 ts_tablet_manager.cc:933] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:27.560665 11645 tablet_copy_client.cc:323] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:27.562448 10679 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 0db5b0c3da3b45289300a692b98fa1c1 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:27.562942 10679 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 0db5b0c3da3b45289300a692b98fa1c1 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-0db5b0c3da3b45289300a692b98fa1c1
I20260709 13:15:27.572190 10679 tablet_copy_source_session.cc:215] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.576251 11645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db5b0c3da3b45289300a692b98fa1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.598543 11645 tablet_copy_client.cc:806] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:27.599120 11645 tablet_copy_client.cc:670] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:27.603300 11645 tablet_copy_client.cc:538] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:27.625409 11645 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:27.673838 11645 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:27.674744 11645 tablet_bootstrap.cc:492] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:27.675413 11645 ts_tablet_manager.cc:1403] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.003s
I20260709 13:15:27.678541 11645 raft_consensus.cc:359] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.684975 11645 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:27.685678 11645 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.703285 11645 ts_tablet_manager.cc:1434] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:15:27.722671 11644 ts_tablet_manager.cc:933] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:27.724090 10679 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-0db5b0c3da3b45289300a692b98fa1c1 received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:27.724568 10679 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-0db5b0c3da3b45289300a692b98fa1c1 on tablet 0db5b0c3da3b45289300a692b98fa1c1 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:27.726841 11647 ts_tablet_manager.cc:933] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:27.752031 11647 tablet_copy_client.cc:323] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:27.756471 10679 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:27.756982 10679 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-4d2efcf18c8e45be8aebbfa42f61e9f5
I20260709 13:15:27.764706 10679 tablet_copy_source_session.cc:215] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.770942 11647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.798769 11647 tablet_copy_client.cc:806] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:27.801847 11644 tablet_copy_client.cc:323] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:27.805769 11647 tablet_copy_client.cc:670] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:27.807233 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 7247478c2fbc418f85cf61569e673a75 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:27.807783 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 7247478c2fbc418f85cf61569e673a75 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-7247478c2fbc418f85cf61569e673a75
I20260709 13:15:27.816255 10604 tablet_copy_source_session.cc:215] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.817900 11647 tablet_copy_client.cc:538] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:27.821516 11644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7247478c2fbc418f85cf61569e673a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.862752 11647 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:27.867388 11645 ts_tablet_manager.cc:933] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:27.917148 11645 tablet_copy_client.cc:323] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:27.919238 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 81565cb1f2054410aae97284b914f79c from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:27.919790 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 81565cb1f2054410aae97284b914f79c from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-81565cb1f2054410aae97284b914f79c
I20260709 13:15:27.930572 10604 tablet_copy_source_session.cc:215] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.942770 11645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81565cb1f2054410aae97284b914f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.935776 11647 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:27.946110 11647 tablet_bootstrap.cc:492] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:27.946848 11647 ts_tablet_manager.cc:1403] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.007s
I20260709 13:15:27.950114 11647 raft_consensus.cc:359] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.951061 11647 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:27.951709 11647 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:27.954365 11647 ts_tablet_manager.cc:1434] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:27.956068 10679 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-4d2efcf18c8e45be8aebbfa42f61e9f5 received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:27.956468 10679 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-4d2efcf18c8e45be8aebbfa42f61e9f5 on tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:28.004009 11417 raft_consensus.cc:1217] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:28.201941 11417 raft_consensus.cc:1217] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:28.252944 11644 tablet_copy_client.cc:806] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:28.253669 11644 tablet_copy_client.cc:670] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:28.257259 11644 tablet_copy_client.cc:538] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:28.266848 11644 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:28.331171 11644 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:28.341992 11644 tablet_bootstrap.cc:492] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:28.342724 11644 ts_tablet_manager.cc:1403] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.005s
I20260709 13:15:28.345826 11644 raft_consensus.cc:359] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:28.357438 11644 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:28.358177 11644 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:28.361029 11644 ts_tablet_manager.cc:1434] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
I20260709 13:15:28.368760 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-7247478c2fbc418f85cf61569e673a75 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:28.369220 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-7247478c2fbc418f85cf61569e673a75 on tablet 7247478c2fbc418f85cf61569e673a75 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:28.410276 11645 tablet_copy_client.cc:806] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:28.417605 11645 tablet_copy_client.cc:670] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:28.424576 11645 tablet_copy_client.cc:538] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:28.484836 11645 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:28.487893 11653 raft_consensus.cc:1064] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:28.502946 11653 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:28.517167 11417 raft_consensus.cc:1217] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:28.558405 11417 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.559942 11625 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.562407 10742 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.566813 11625 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.567224 11645 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:28.568214 11645 tablet_bootstrap.cc:492] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:28.568939 11645 ts_tablet_manager.cc:1403] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.084s	user 0.027s	sys 0.010s
I20260709 13:15:28.576745 11645 raft_consensus.cc:359] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:28.577651 11645 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:28.578375 11645 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:28.585402 11645 ts_tablet_manager.cc:1434] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:15:28.586268 10588 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.587257 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-81565cb1f2054410aae97284b914f79c received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:28.587683 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-81565cb1f2054410aae97284b914f79c on tablet 81565cb1f2054410aae97284b914f79c with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:28.588609 11656 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.643213 11417 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.627980 11625 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.676208 11565 raft_consensus.cc:1064] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:28.678267 11565 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:28.684721 10588 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.702422 10489 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.727085 10588 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.729220 10742 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.729110 10734 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.735918 11417 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:28.748651 11565 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:15:28.756259 11666 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.767210 11666 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:28.875041 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 64358.7us
W20260709 13:15:28.885682 11670 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:15:28.891992 11416 raft_consensus.cc:1217] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:28.912388 11565 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.914136 11417 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:28.932336 10589 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.000254 10492 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.015058 10738 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.022114 10668 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.026643 11417 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:29.028115 11625 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.039359 10589 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:29.043066 11666 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.046011 11565 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.053205 11417 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.053819 10668 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.066881 10588 raft_consensus.cc:2955] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.070416 11416 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:29.072367 11625 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.077625 10492 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.086848 10738 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:29.089035 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 0db5b0c3da3b45289300a692b98fa1c1 with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:29.089485 11666 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.103216 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0db5b0c3da3b45289300a692b98fa1c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:29.106173 11565 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.109802 10742 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.108212 11610 raft_consensus.cc:1064] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:29.118250 11674 tablet_replica.cc:333] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:29.121603 11610 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.126088 11417 raft_consensus.cc:2955] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.223547 10661 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.228946 11416 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.229094 11643 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.238088 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:29.240000 10742 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.239308 10492 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.249948 11674 raft_consensus.cc:2243] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.250144 11610 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.260233 11674 raft_consensus.cc:2272] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:29.260365 11610 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.265700 11674 ts_tablet_manager.cc:1916] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.282584 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:29.293993 11610 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.300239 11416 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.302142 10742 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.306295 10661 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.320436 11674 ts_tablet_manager.cc:1929] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:29.334945 11674 log.cc:1199] T 0db5b0c3da3b45289300a692b98fa1c1 P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/0db5b0c3da3b45289300a692b98fa1c1
I20260709 13:15:29.322062 10492 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.321964 11680 tablet_replica.cc:333] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:29.340294 11643 raft_consensus.cc:1064] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:29.342667 11643 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.350004 11680 raft_consensus.cc:2243] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.352384 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 0db5b0c3da3b45289300a692b98fa1c1 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:29.352535 11680 raft_consensus.cc:2272] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:29.357597 11680 ts_tablet_manager.cc:1916] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.358402 10588 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.365576 10661 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:29.367166 11613 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:29.367453 11416 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:29.368758 11613 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:29.376256 11606 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.385427 10661 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.385550 11417 raft_consensus.cc:2955] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.403232 10492 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 4 to 5, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.405709 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7247478c2fbc418f85cf61569e673a75 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:29.432927 11416 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.435362 11610 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.436609 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 7247478c2fbc418f85cf61569e673a75 with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:29.437506 11674 tablet_replica.cc:333] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:29.438333 10661 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.438541 11674 raft_consensus.cc:2243] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.438865 10742 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:29.439285 11674 raft_consensus.cc:2272] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:29.439558 11613 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.444573 11674 ts_tablet_manager.cc:1916] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.445245 11613 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.467741 11613 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.480707 11680 ts_tablet_manager.cc:1929] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:29.481168 11680 log.cc:1199] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/4d2efcf18c8e45be8aebbfa42f61e9f5
I20260709 13:15:29.481280 11417 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.485899 10742 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.492350 11674 ts_tablet_manager.cc:1929] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:29.496170 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet 4d2efcf18c8e45be8aebbfa42f61e9f5 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:29.502178 11674 log.cc:1199] T 7247478c2fbc418f85cf61569e673a75 P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/7247478c2fbc418f85cf61569e673a75
I20260709 13:15:29.502686 10661 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.505059 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 7247478c2fbc418f85cf61569e673a75 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:29.518608 10492 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 3 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.573390 10588 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:29.584131 11417 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:29.585624 10736 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:29.585654 11613 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:29.594388 11613 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.598493 11606 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:29.602816 10736 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:29.604725 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81565cb1f2054410aae97284b914f79c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:29.605858 11417 raft_consensus.cc:2955] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:15:29.622081 10476 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 81565cb1f2054410aae97284b914f79c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 5
I20260709 13:15:29.634202 10492 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 4 to 5, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.652675 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 81565cb1f2054410aae97284b914f79c with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35970
I20260709 13:15:29.670341 11686 tablet_replica.cc:333] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:29.671382 11686 raft_consensus.cc:2243] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:29.672487 11686 raft_consensus.cc:2272] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:29.676849 11686 ts_tablet_manager.cc:1916] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:29.693442 11686 ts_tablet_manager.cc:1929] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:29.693883 11686 log.cc:1199] T 81565cb1f2054410aae97284b914f79c P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/81565cb1f2054410aae97284b914f79c
I20260709 13:15:29.698256 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 81565cb1f2054410aae97284b914f79c (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:30.761497 10738 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:30.770454 10661 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:30.770704 10589 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:30.772068 11651 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:30.773450 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2298132784d24fb2b78c3a21c68a9d40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.774298 11651 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.782052 11689 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.783083 10661 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.786501 10589 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.843761 10588 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:30.858692 10491 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.874701 10668 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:30.876065 11643 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:30.877357 10557 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94a8b7e07671442dafc4c3dcb271d352. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.880812 10738 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:30.882639 11643 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.897869 11610 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.905488 10738 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.914111 10668 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.931597 10489 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:30.962615 10738 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:15:31.026999 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 53266us
I20260709 13:15:31.030923 10668 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:31.033953 10588 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:31.036393 11695 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:31.039374 11608 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:31.054293 10706 consensus_peers.cc:597] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1e246154849412a97842c9d673bd0a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.066098 11695 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.070705 10588 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.072254 10667 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.091636 10738 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.097420 10489 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.115031 10661 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:31.116344 11694 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:31.128758 10589 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:31.129623 10706 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68a5bdce0f0846e2a7f8c9c6f36d560e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.130287 11694 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.140341 11694 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.143754 10589 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.161862 10661 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:31.168067 10491 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.227277 11712 ts_tablet_manager.cc:933] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:31.252825 11712 tablet_copy_client.cc:323] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:31.254983 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 2298132784d24fb2b78c3a21c68a9d40 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:31.255548 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 2298132784d24fb2b78c3a21c68a9d40 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-2298132784d24fb2b78c3a21c68a9d40
I20260709 13:15:31.265158 10753 tablet_copy_source_session.cc:215] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:31.267865 11712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2298132784d24fb2b78c3a21c68a9d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:31.277417 11714 ts_tablet_manager.cc:933] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:31.291476 11714 tablet_copy_client.cc:323] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:31.291426 11712 tablet_copy_client.cc:806] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:31.292393 11712 tablet_copy_client.cc:670] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:31.293534 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 94a8b7e07671442dafc4c3dcb271d352 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:31.294140 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 94a8b7e07671442dafc4c3dcb271d352 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-94a8b7e07671442dafc4c3dcb271d352
I20260709 13:15:31.296880 11712 tablet_copy_client.cc:538] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:31.309856 11712 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:31.336334 10604 tablet_copy_source_session.cc:215] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:31.340857 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a8b7e07671442dafc4c3dcb271d352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:31.353358 11712 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:31.355418 11712 tablet_bootstrap.cc:492] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:31.356096 11712 ts_tablet_manager.cc:1403] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.005s
I20260709 13:15:31.364853 11712 raft_consensus.cc:359] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.365756 11712 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:31.366513 11712 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.386754 11714 tablet_copy_client.cc:806] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:31.387511 11714 tablet_copy_client.cc:670] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:31.391798 11714 tablet_copy_client.cc:538] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:31.401583 11712 ts_tablet_manager.cc:1434] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.022s
I20260709 13:15:31.404227 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-2298132784d24fb2b78c3a21c68a9d40 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:31.404685 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-2298132784d24fb2b78c3a21c68a9d40 on tablet 2298132784d24fb2b78c3a21c68a9d40 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:31.406023 11714 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:31.433502 11714 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:31.434811 11714 tablet_bootstrap.cc:492] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:31.435534 11714 ts_tablet_manager.cc:1403] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.017s
I20260709 13:15:31.438458 11714 raft_consensus.cc:359] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.439311 11714 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:31.440050 11714 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.443086 11714 ts_tablet_manager.cc:1434] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:31.444778 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-94a8b7e07671442dafc4c3dcb271d352 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:31.445202 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-94a8b7e07671442dafc4c3dcb271d352 on tablet 94a8b7e07671442dafc4c3dcb271d352 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:31.535563 11714 ts_tablet_manager.cc:933] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:31.537179 11714 tablet_copy_client.cc:323] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:31.538753 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet e1e246154849412a97842c9d673bd0a8 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:31.539242 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet e1e246154849412a97842c9d673bd0a8 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-e1e246154849412a97842c9d673bd0a8
I20260709 13:15:31.546505 10753 tablet_copy_source_session.cc:215] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:31.549940 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e246154849412a97842c9d673bd0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:31.567083 11714 tablet_copy_client.cc:806] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:31.567852 11714 tablet_copy_client.cc:670] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:31.572144 11714 tablet_copy_client.cc:538] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:31.580287 11712 ts_tablet_manager.cc:933] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:31.596196 11712 tablet_copy_client.cc:323] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:31.598519 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:31.599017 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 68a5bdce0f0846e2a7f8c9c6f36d560e from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-68a5bdce0f0846e2a7f8c9c6f36d560e
I20260709 13:15:31.609386 10753 tablet_copy_source_session.cc:215] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:31.612336 11712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:31.626209 11714 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:31.651482 11712 tablet_copy_client.cc:806] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:31.652066 11712 tablet_copy_client.cc:670] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:31.656495 11712 tablet_copy_client.cc:538] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:31.668015 11712 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:31.683401 11714 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:31.685990 11714 tablet_bootstrap.cc:492] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:31.691630 11714 ts_tablet_manager.cc:1403] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.008s
I20260709 13:15:31.694521 11714 raft_consensus.cc:359] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.695353 11714 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:31.696004 11714 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.702221 11714 ts_tablet_manager.cc:1434] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:31.708160 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-e1e246154849412a97842c9d673bd0a8 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:31.708534 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-e1e246154849412a97842c9d673bd0a8 on tablet e1e246154849412a97842c9d673bd0a8 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:31.732224 11712 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:31.735061 11712 tablet_bootstrap.cc:492] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:31.735877 11712 ts_tablet_manager.cc:1403] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.006s
I20260709 13:15:31.740408 11712 raft_consensus.cc:359] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.741210 11712 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:31.741851 11712 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:31.745461 11417 raft_consensus.cc:1217] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:31.746083 11712 ts_tablet_manager.cc:1434] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:31.752185 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-68a5bdce0f0846e2a7f8c9c6f36d560e received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:31.752599 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-68a5bdce0f0846e2a7f8c9c6f36d560e on tablet 68a5bdce0f0846e2a7f8c9c6f36d560e with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:31.790113 11417 raft_consensus.cc:1217] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:31.966924 11416 raft_consensus.cc:1217] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:32.080575 11417 raft_consensus.cc:1217] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:32.247593 11723 raft_consensus.cc:1064] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:32.250151 11723 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.257541 10661 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.263864 11704 raft_consensus.cc:1064] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:32.265213 11695 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.278774 11704 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.298848 10588 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.299441 11417 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.301457 11694 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.309655 11695 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:32.375829 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 92048.6us
I20260709 13:15:32.374469 11726 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.382097 10588 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.416870 11417 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.450632 10661 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.455057 10491 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.469244 11416 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.471576 10667 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.473287 11732 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.477530 11606 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.476500 11727 raft_consensus.cc:1064] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:32.483148 11727 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:32.488837 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63040.5us
I20260709 13:15:32.490998 10738 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.507586 10661 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.507565 11732 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.509037 11695 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.520793 11416 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.522433 11694 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.523236 11606 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.526054 10588 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.527554 11727 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.529572 10667 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.534600 11416 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.538622 10738 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.563205 11694 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.566001 10668 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.572584 11726 raft_consensus.cc:1064] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:32.575187 11726 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.598685 10742 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.617544 11416 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.604224 10492 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.622104 11695 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.626652 10589 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.636222 11695 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.647601 11415 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.645112 11727 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.666126 10588 raft_consensus.cc:2955] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.710835 10661 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.715116 10589 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.717309 10490 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.726543 10492 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.733825 11747 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.746379 11415 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.749020 10667 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.751693 11704 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:32.755162 11732 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:32.756969 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 64002.3us
I20260709 13:15:32.756367 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2298132784d24fb2b78c3a21c68a9d40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.758625 11416 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.767902 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 2298132784d24fb2b78c3a21c68a9d40 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35970
I20260709 13:15:32.798928 11746 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.789002 11415 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.801231 11704 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.808818 10589 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.818861 10588 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:32.814961 10668 raft_consensus.cc:2955] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.819790 11416 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.829452 11751 tablet_replica.cc:333] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:32.834352 11727 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.840289 10489 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 1 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.862857 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 94a8b7e07671442dafc4c3dcb271d352 with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:32.887643 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94a8b7e07671442dafc4c3dcb271d352 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.893800 10736 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:32.894879 11726 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.899719 10589 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.900069 11415 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.906680 11751 raft_consensus.cc:2243] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.907430 11751 raft_consensus.cc:2272] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.908913 11723 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.909904 11758 tablet_replica.cc:333] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:32.913055 11751 ts_tablet_manager.cc:1916] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:32.920591 11723 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:32.926540 11417 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.927553 10668 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.946659 11758 raft_consensus.cc:2243] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.948117 11758 raft_consensus.cc:2272] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.929533 11608 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.953734 11416 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.958608 11758 ts_tablet_manager.cc:1916] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:32.959896 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.935256 11751 ts_tablet_manager.cc:1929] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:32.934458 10489 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.974602 11751 log.cc:1199] T 2298132784d24fb2b78c3a21c68a9d40 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/2298132784d24fb2b78c3a21c68a9d40
I20260709 13:15:32.938278 10588 raft_consensus.cc:2955] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.978142 10490 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.980127 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 2298132784d24fb2b78c3a21c68a9d40 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:32.938866 10589 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:32.990571 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 68a5bdce0f0846e2a7f8c9c6f36d560e with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35970
I20260709 13:15:32.991405 11751 tablet_replica.cc:333] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:15:32.992498 11751 raft_consensus.cc:2243] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.993238 11751 raft_consensus.cc:2272] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.998606 11751 ts_tablet_manager.cc:1916] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:33.011312 11758 ts_tablet_manager.cc:1929] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:33.012480 11758 log.cc:1199] T 94a8b7e07671442dafc4c3dcb271d352 P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/94a8b7e07671442dafc4c3dcb271d352
I20260709 13:15:33.018898 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 94a8b7e07671442dafc4c3dcb271d352 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:33.030506 10736 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:33.052107 11751 ts_tablet_manager.cc:1929] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:33.052942 11417 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:33.054292 10661 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:33.055013 11723 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:33.058389 11608 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:33.062175 11751 log.cc:1199] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/68a5bdce0f0846e2a7f8c9c6f36d560e
I20260709 13:15:33.064376 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 68a5bdce0f0846e2a7f8c9c6f36d560e (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:33.064780 11417 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:33.067799 10661 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:33.068869 11608 raft_consensus.cc:2955] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:33.078918 10489 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:33.085556 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1e246154849412a97842c9d673bd0a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:33.095331 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e246154849412a97842c9d673bd0a8 with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:33.102456 11759 tablet_replica.cc:333] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:33.103596 11759 raft_consensus.cc:2243] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.104236 11759 raft_consensus.cc:2272] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.108166 11759 ts_tablet_manager.cc:1916] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:33.120870 11759 ts_tablet_manager.cc:1929] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:33.121241 11759 log.cc:1199] T e1e246154849412a97842c9d673bd0a8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/e1e246154849412a97842c9d673bd0a8
I20260709 13:15:33.123217 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet e1e246154849412a97842c9d673bd0a8 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:34.164834 10667 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.170964 10737 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.172256 10589 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:34.172690 10632 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72b98b9d27524f83a9b567dee7f0718f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.173499 11763 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:34.174365 11760 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.181577 11763 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.183048 10737 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.184886 10588 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.196390 10668 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.202739 10490 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.217402 10737 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.219408 11760 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:34.220403 10632 consensus_peers.cc:597] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d3e32279b914c319fcf8afa158efa9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.230221 10588 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:34.231516 11763 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.233624 11703 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.246266 10734 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.257793 10588 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.274266 10489 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.281670 10736 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:15:34.282518 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55077.4us
I20260709 13:15:34.300915 10668 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:34.301451 10706 consensus_peers.cc:597] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7624b04076142a0bbf29cbbf066c4bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.302024 10588 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.302933 11723 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.303695 11775 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.312321 11769 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.316527 10588 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.318048 10668 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.333122 10490 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.328774 10667 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.355032 10736 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.356310 11703 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:34.358088 10632 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0958810fe1d74c67af02bd74dc0488bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.361054 10588 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:34.362212 11771 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.365091 11760 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.369767 10734 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.370847 10588 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:34.382516 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.643683 11782 ts_tablet_manager.cc:933] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:34.650756 11782 tablet_copy_client.cc:323] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:34.652308 11784 ts_tablet_manager.cc:933] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:34.652671 10679 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 6d3e32279b914c319fcf8afa158efa9c from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:34.653165 10679 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 6d3e32279b914c319fcf8afa158efa9c from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-6d3e32279b914c319fcf8afa158efa9c
I20260709 13:15:34.654409 11784 tablet_copy_client.cc:323] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:34.656095 10678 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 72b98b9d27524f83a9b567dee7f0718f from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:34.656837 10678 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 72b98b9d27524f83a9b567dee7f0718f from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-72b98b9d27524f83a9b567dee7f0718f
I20260709 13:15:34.667019 10679 tablet_copy_source_session.cc:215] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:34.670409 11782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3e32279b914c319fcf8afa158efa9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.671643 10678 tablet_copy_source_session.cc:215] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:34.674515 11784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b98b9d27524f83a9b567dee7f0718f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.681720 11782 tablet_copy_client.cc:806] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:34.682273 11782 tablet_copy_client.cc:670] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:34.685480 11782 tablet_copy_client.cc:538] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:34.688601 11784 tablet_copy_client.cc:806] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:34.689157 11784 tablet_copy_client.cc:670] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:34.694486 11782 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:34.698823 11784 tablet_copy_client.cc:538] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:34.709128 11784 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:34.721415 11782 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:34.723470 11782 tablet_bootstrap.cc:492] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:34.724138 11782 ts_tablet_manager.cc:1403] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:15:34.727841 11782 raft_consensus.cc:359] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.728495 11782 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:34.729148 11782 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.733862 11782 ts_tablet_manager.cc:1434] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:34.734515 11784 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:34.735363 10678 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-6d3e32279b914c319fcf8afa158efa9c received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:34.735806 10678 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-6d3e32279b914c319fcf8afa158efa9c on tablet 6d3e32279b914c319fcf8afa158efa9c with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:34.737586 11784 tablet_bootstrap.cc:492] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:34.738197 11784 ts_tablet_manager.cc:1403] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 13:15:34.741454 11784 raft_consensus.cc:359] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.742247 11784 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:34.742867 11784 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.745266 11784 ts_tablet_manager.cc:1434] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:15:34.746806 10678 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-72b98b9d27524f83a9b567dee7f0718f received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:34.747184 10678 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-72b98b9d27524f83a9b567dee7f0718f on tablet 72b98b9d27524f83a9b567dee7f0718f with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:34.772323 11784 ts_tablet_manager.cc:933] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:34.773854 11784 tablet_copy_client.cc:323] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:34.775180 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet f7624b04076142a0bbf29cbbf066c4bb from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:34.775708 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet f7624b04076142a0bbf29cbbf066c4bb from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-f7624b04076142a0bbf29cbbf066c4bb
I20260709 13:15:34.782850 10753 tablet_copy_source_session.cc:215] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:34.785513 11784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7624b04076142a0bbf29cbbf066c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.797946 11784 tablet_copy_client.cc:806] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:34.798694 11784 tablet_copy_client.cc:670] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:34.804899 11784 tablet_copy_client.cc:538] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:34.815584 11784 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:34.837283 11784 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:34.838145 11784 tablet_bootstrap.cc:492] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:34.838762 11784 ts_tablet_manager.cc:1403] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.005s
I20260709 13:15:34.841482 11784 raft_consensus.cc:359] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.842257 11784 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:34.842875 11784 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.845156 11784 ts_tablet_manager.cc:1434] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:15:34.847642 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-f7624b04076142a0bbf29cbbf066c4bb received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:34.848026 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-f7624b04076142a0bbf29cbbf066c4bb on tablet f7624b04076142a0bbf29cbbf066c4bb with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:34.850404 11782 ts_tablet_manager.cc:933] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:34.855463 11782 tablet_copy_client.cc:323] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:34.857501 10678 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 0958810fe1d74c67af02bd74dc0488bb from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:34.858026 10678 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 0958810fe1d74c67af02bd74dc0488bb from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-0958810fe1d74c67af02bd74dc0488bb
I20260709 13:15:34.866637 10678 tablet_copy_source_session.cc:215] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:34.868966 11782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0958810fe1d74c67af02bd74dc0488bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.883570 11782 tablet_copy_client.cc:806] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:34.884860 11782 tablet_copy_client.cc:670] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:34.893600 11782 tablet_copy_client.cc:538] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:34.899138 11782 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:34.915987 11782 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:34.916798 11782 tablet_bootstrap.cc:492] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:34.917429 11782 ts_tablet_manager.cc:1403] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.008s
I20260709 13:15:34.920096 11782 raft_consensus.cc:359] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.920883 11782 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:34.921504 11782 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:34.923705 11782 ts_tablet_manager.cc:1434] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:34.925525 10678 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-0958810fe1d74c67af02bd74dc0488bb received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:34.925941 10678 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-0958810fe1d74c67af02bd74dc0488bb on tablet 0958810fe1d74c67af02bd74dc0488bb with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:35.043385 11417 raft_consensus.cc:1217] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.158430 11417 raft_consensus.cc:1217] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:35.183162 11415 raft_consensus.cc:1217] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.439889 11415 raft_consensus.cc:1217] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.552035 11771 raft_consensus.cc:1064] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:35.554216 11771 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:35.562408 10734 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.564116 11415 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.563884 11771 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:35.566267 11760 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.566035 10588 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.568826 11703 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.591372 11771 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.595949 11415 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.602105 10734 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.635993 10491 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.636382 10588 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.723345 10668 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:35.733956 10588 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:35.735592 11804 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:35.738052 11417 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:35.745114 11804 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:35.747236 11806 raft_consensus.cc:1064] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:35.749487 11806 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:35.751907 11769 raft_consensus.cc:1064] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:35.754381 11769 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:35.755702 11760 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.772051 10585 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.773176 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72b98b9d27524f83a9b567dee7f0718f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:35.782968 10492 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.796096 10588 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.798049 10668 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.798962 11415 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:35.802613 11775 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.783231 11417 raft_consensus.cc:2955] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.813985 11793 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:35.824240 11769 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:35.834031 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b98b9d27524f83a9b567dee7f0718f with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:35.837113 11810 tablet_replica.cc:333] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:35.840854 11810 raft_consensus.cc:2243] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:35.851181 11810 raft_consensus.cc:2272] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:35.855437 11810 ts_tablet_manager.cc:1916] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:35.867129 11723 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.874104 11415 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.879884 10668 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.885128 10588 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:35.891309 10489 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.901561 11415 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:35.902490 10585 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:35.941372 11703 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:35.946799 11806 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.958530 11810 ts_tablet_manager.cc:1929] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:35.959225 11810 log.cc:1199] T 72b98b9d27524f83a9b567dee7f0718f P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/72b98b9d27524f83a9b567dee7f0718f
I20260709 13:15:35.962689 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 72b98b9d27524f83a9b567dee7f0718f (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
W20260709 13:15:35.989545 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 104072us
I20260709 13:15:35.995983 10734 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:35.992506 10736 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:36.003698 11703 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.008888 10586 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.014786 10668 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:36.018172 11804 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.020823 11415 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:36.022078 11769 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.028752 10490 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.033149 11817 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.035704 10736 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.039345 11723 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.041574 10668 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.052225 11703 raft_consensus.cc:1064] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:36.053946 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7624b04076142a0bbf29cbbf066c4bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:36.054570 11703 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:36.054863 11415 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.063722 10490 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.068392 11417 raft_consensus.cc:2955] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.075273 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet f7624b04076142a0bbf29cbbf066c4bb with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:36.104056 10736 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.105708 11804 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.106166 11820 tablet_replica.cc:333] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:36.108709 11820 raft_consensus.cc:2243] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.109464 11417 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.110023 11820 raft_consensus.cc:2272] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.113554 11771 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.119427 10586 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:36.120643 11804 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.122442 11820 ts_tablet_manager.cc:1916] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:36.134527 11804 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.145380 11820 ts_tablet_manager.cc:1929] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:36.146070 11820 log.cc:1199] T f7624b04076142a0bbf29cbbf066c4bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/f7624b04076142a0bbf29cbbf066c4bb
I20260709 13:15:36.147119 10736 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.157795 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet f7624b04076142a0bbf29cbbf066c4bb (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:36.159618 10586 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.165169 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.174445 11417 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.203205 10667 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:36.207394 11417 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:36.208662 11703 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.215960 11771 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.219938 11417 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.223873 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0958810fe1d74c67af02bd74dc0488bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:36.224609 10586 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:36.226210 11771 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.230123 10591 raft_consensus.cc:2955] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.234431 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 3 to 4, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 1 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.255254 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 0958810fe1d74c67af02bd74dc0488bb with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50130
I20260709 13:15:36.256139 11810 tablet_replica.cc:333] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:15:36.257104 11810 raft_consensus.cc:2243] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.258114 11810 raft_consensus.cc:2272] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.261264 11810 ts_tablet_manager.cc:1916] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:36.278007 11810 ts_tablet_manager.cc:1929] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:36.278329 11810 log.cc:1199] T 0958810fe1d74c67af02bd74dc0488bb P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/0958810fe1d74c67af02bd74dc0488bb
I20260709 13:15:36.279716 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 0958810fe1d74c67af02bd74dc0488bb (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:15:36.502962 10668 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:36.508682 11417 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:36.509919 11771 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.511493 10736 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:36.516077 11771 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.516940 11804 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.518664 11417 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.527788 10478 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d3e32279b914c319fcf8afa158efa9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:36.534585 10492 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.522046 10736 raft_consensus.cc:2955] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:36.558025 10582 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d3e32279b914c319fcf8afa158efa9c with delete_type TABLET_DATA_TOMBSTONED (TS 09799b1ddd3f45f1a08fcd6e271cdcf7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45604
I20260709 13:15:36.558964 11820 tablet_replica.cc:333] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:15:36.559866 11820 raft_consensus.cc:2243] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.560480 11820 raft_consensus.cc:2272] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.563723 11820 ts_tablet_manager.cc:1916] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:36.576647 11820 ts_tablet_manager.cc:1929] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:15:36.576925 11820 log.cc:1199] T 6d3e32279b914c319fcf8afa158efa9c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/wals/6d3e32279b914c319fcf8afa158efa9c
I20260709 13:15:36.578058 10476 catalog_manager.cc:5028] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): tablet 6d3e32279b914c319fcf8afa158efa9c (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
W20260709 13:15:36.940168 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48112.2us
I20260709 13:15:38.302682  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:38.494727 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080025d120 after lost signal to thread 9492
I20260709 13:15:38.526465 11831 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.527094 11831 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.529657 11831 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.530149 11831 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.530616 11831 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.533210 11831 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.542006 11833 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.542709 11833 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.545296 11833 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.558751 11830 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.559258 11830 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.560523 11834 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.561019 11834 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.561690 11830 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.562108 11804 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.562604 11804 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.563315 11834 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:38.563925 10764 debug-util.cc:398] Leaking SignalData structure 0x7b0800167c60 after lost signal to thread 9492
I20260709 13:15:38.564390 11804 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:38.564580 10764 debug-util.cc:398] Leaking SignalData structure 0x7b080019bde0 after lost signal to thread 10526
W20260709 13:15:38.565729 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08002eaa00 after lost signal to thread 10618
W20260709 13:15:38.566715 10764 debug-util.cc:398] Leaking SignalData structure 0x7b0800311880 after lost signal to thread 10693
W20260709 13:15:38.567759 10764 debug-util.cc:398] Leaking SignalData structure 0x7b080032c400 after lost signal to thread 10767
W20260709 13:15:38.568890 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08002da540 after lost signal to thread 11442
I20260709 13:15:38.569600 11836 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.570128 11836 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.572135 11836 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.574195 11836 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.574651 11836 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.575420 11831 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.575922 11831 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.576357 11833 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.576493 11836 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.576874 11833 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.577814 11831 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.578270 11831 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.578369 11830 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.578802 11833 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.578805 11830 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.583580 11830 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.578742 11831 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.588790 11831 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.585170 11833 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.589408 11833 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.592294 11833 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.592908 11833 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.599316 11833 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.602237 11833 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.602820 11831 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.603643 11769 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.603605 11831 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.604321 11769 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.606062 11831 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.606765 11606 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.607271 11832 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.607894 11832 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.607327 11606 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.610150 11606 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.610280 11832 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.615541 11769 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.624161 11840 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.659715 11606 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.660419 11606 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.687443 11606 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.624688 11840 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.625636 11804 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.754854 11844 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.765838 11835 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.755605 11844 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.769857 11606 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.770431 11606 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.685737 11831 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.734615 11833 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.769645 11771 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.788460 11833 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.789080 11771 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.790649 11833 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.791150 11833 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.791498 11771 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.792317 11834 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.792959 11834 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.795297 11834 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.795881 11834 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.796419 11834 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.771291 11804 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.800964 11804 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.817238 11837 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.817257 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:38.818120 10663 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:38.766484 11835 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.829066 11804 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.787912 11844 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.849222 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:38.818812 11771 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.861974 11723 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.863278 11723 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.864018 11841 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.863574 11795 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.862394 11769 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.847507 11830 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.865356 11769 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.871403 11723 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.844771 11606 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.874275 11769 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.876144 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:38.876969 10663 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:38.878610 11835 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.814785 11831 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.818037 11837 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.873833 11830 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.879122 11835 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.897131 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:38.897899 10663 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:38.791821 11833 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.893270 11830 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.895233 11831 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.897526 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:38.870995 11844 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:38.864461 11841 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.905447 11703 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.889043 11795 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.901933 11835 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.911182 11831 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.848848 11804 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.912602 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:38.913111 11723 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.926914 11723 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.927251 11723 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.919269 11703 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.874691 11840 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.923720 11769 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.924957 11851 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.867069 11771 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.930928 11769 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.901481 11836 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.940594 11769 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.914196 11844 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.941350 11703 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.943472 11703 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.943935 11703 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.945592 11703 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.946134 11703 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.929509 11830 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.947077 11769 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:38.947748 11769 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.948235 11769 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:38.945154 10589 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:38.926510 11839 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.953428 11703 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.952168 11723 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.955457 11830 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.956372 11832 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.957437 11830 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.934653 11840 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:38.960031 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 10526
I20260709 13:15:38.961848 11849 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.962574 11849 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.968616 11855 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.969063 11855 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.970085 11848 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.970595 11848 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.971494 11855 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.973140 11848 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.974071 11849 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:38.957919 11830 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.975122 11830 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.930567 11831 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.977164 11831 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:38.946352 11844 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:38.977053 11830 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.957053 11832 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.979513 11850 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.958993 11703 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:38.984776 11703 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.974556 11855 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.941711 11836 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.019541 11703 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:38.974556 11849 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:38.975632 11804 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.988082 11855 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.022101 11834 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:38.978689 11840 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:38.989691 11843 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.033285 11769 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.034230 11847 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:38.945266 11851 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.027431 11830 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.028569 11852 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.052364 11769 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.032155 11848 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.034838 11845 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:38.959928 11839 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.027624 11849 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.034220 11846 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.051581 11833 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.068346 11703 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.070160 11703 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.070901 11703 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:39.084089 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08001315e0 after lost signal to thread 10618
W20260709 13:15:39.085999 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3800 after lost signal to thread 10693
W20260709 13:15:39.087389 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08002e40e0 after lost signal to thread 10767
I20260709 13:15:39.107185 11769 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.072476 11723 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:39.108516 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080028a120 after lost signal to thread 11442
I20260709 13:15:39.072564 11835 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.110438 11703 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.060048 11848 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.113184 11703 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.113988 11769 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.114782 11703 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.088166 11771 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.085636 11837 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.053694 11843 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.117903 11858 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.117451 11723 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.117792 11703 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.122246 11769 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.024904 11850 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.054390 11847 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.073544 11830 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.123736 11723 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.086174 11845 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.126967 11840 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.106441 11846 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.137413 11859 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.131208 11862 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.142313 11723 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.143167 11769 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.144081 11769 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.142747 11860 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.138103 11839 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.138948 11845 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.141129 11851 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.142956 11857 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.146600 11769 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.143540 11842 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.084786 11852 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.143767 11846 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.146333 11862 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.159870 11769 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.162379 11769 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.163677 11723 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.164120 11723 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.165724 11723 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.167228 11771 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.167384 11835 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.176144 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.176846 10667 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.176841 11843 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.185029 11703 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.185482 11703 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.186100 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.186492 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.186626 10667 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:39.187005 10661 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.150573 11849 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.129251 11858 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.137926 11859 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.198439 11853 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.199118 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.198392 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.145676 11860 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.199934 11418 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:39.199064 11853 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.193295 11837 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.185302 11857 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.193011 11842 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.213506 11846 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.214126 11846 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.194379 11854 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.167708 11771 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.202422 11841 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.228308 11839 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.237427 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.186235 11835 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.237959 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.237996 10589 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.239679 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.206013 11848 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.243203 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.243950 11418 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:39.245260 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.246310 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.246873 10591 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.247171 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.248906 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.251523 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.252707 11769 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.237586 11795 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.254881 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.252436 11703 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.218226 11837 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.262560 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.236411 11845 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.253966 11832 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.241161 11855 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.273772 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.274523 10663 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:39.241338 11836 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.263533 10661 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.265836 11771 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.248075 11830 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.276988 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.271863 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.204154 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.278414 10667 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.276019 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.279441 10586 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.280726 11868 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.269481 11867 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.246574 11839 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.286511 11837 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.262568 11863 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.288903 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.246811 11854 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.291013 11847 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.293437 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.293447 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.294169 11418 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:39.300189 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.301859 11862 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.281423 11868 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.291694 11414 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:39.295360 11852 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.307790 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.273535 11845 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.319907 11854 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.320282 11868 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.293754 11867 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.322794 11857 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.300457 11859 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.298995 11847 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.317514 11863 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.334646 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.338231 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:39.340731 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 428154us
I20260709 13:15:39.344133 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:39.344794 10667 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.353559 10667 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:39.355293 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.355430 11837 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.361191 11837 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.361934 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.362947 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:39.363188 11837 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.356184 11771 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.363349 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.363566 10667 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.356302 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.363919 10736 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:39.364313 10737 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.356758 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.357522 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.365166 10734 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:39.357620 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.365756 10742 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.358007 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.366531 11830 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.358711 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.359015 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.363835 11771 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.367754 10661 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:39.359320 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.368609 10739 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:39.359925 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.369370 11771 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.367007 11830 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.370190 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.371172 11830 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.371716 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.374858 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.375384 10740 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:39.377797 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.378343 10666 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:39.379753 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.329901 11845 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.324277 11860 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.324522 11853 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.689728 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.529983 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.383631 10667 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:39.444579 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.444223 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.623718 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.449906 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.472743 11835 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.544953 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.698266 10735 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.702066 10736 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:39.327204 11850 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.598328 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.325738 11858 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.443378 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.445382 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.610872 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.602319 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.473397 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.443789 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.544381 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.711572 11417 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:39.711725 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 267996us
I20260709 13:15:39.529735 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.693436 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.442859 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.531355 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.698761 10734 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:39.355041 11868 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.711790 10589 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.704631 10662 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.713282 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.713658 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.714085 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.382695 11846 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.550388 11859 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.715035 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.444921 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.694015 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.716356 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.526695 11867 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.532737 11863 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.381827 11847 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.659245 11870 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.531167 11839 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.603720 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.435468 11857 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.716539 10742 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.410144 11844 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.729183 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.472550 11842 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.738615 10662 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:39.738948 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.731873 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.739948 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.717893 11854 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:39.733634 11870 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.733873 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.730252 10740 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:39.732764 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.727509 11864 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.736639 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.736058 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.751060 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.749771 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.751909 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:39.753126 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.753491 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.740705 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.734927 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.741590 11852 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:39.741816 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.736325 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.742226 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.737627 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.759017 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.761799 11416 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:39.761940 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.728295 11859 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.746279 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.746454 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.765409 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.765978 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.765997 10662 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:39.717309 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:39.750182 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.751271 11864 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.753844 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.756285 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.756649 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.727270 11868 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.770026 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.770569 10737 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.768860 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.750629 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.754801 11852 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.754222 11854 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:39.749565 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:39.774056 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.774359 11844 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.776444 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.777331 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.779109 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.779994 10738 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.779814 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:39.744447 11857 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.761735 10594 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:39.783422 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.782254 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.785941 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.775609 11864 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.782927 10737 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.789645 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.775210 11852 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.793517 10736 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:39.798017 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.804325 10739 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:39.805637 11854 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:39.824972 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79476.7us
I20260709 13:15:39.826905 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.827684 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:39.832413 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.838858 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.839887 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.840299 11877 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:39.841781 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.840767 11877 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.840749 11382 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.843909 11877 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.847045 11852 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.854048 11852 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.854440 11857 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:39.854610 11852 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.855089 11852 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.855463 11852 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.848793 11875 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.858212 11875 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:39.858654 11875 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.845927 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 139421us
I20260709 13:15:39.863884 11870 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.874156 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.879777 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.881068 11876 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.881636 11876 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.882076 11876 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.887059 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:39.884105 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.884164 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.892330 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.898749 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.899500 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:39.901631 10743 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:39.886205 11847 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.885450 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:39.904608 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.919028 11868 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:39.900008 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56753.4us
I20260709 13:15:39.920333 11382 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:39.939661 11877 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.941772 11877 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:39.942308 11877 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:39.942611 11877 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:39.942941 11877 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.944523 11864 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:39.950449 11875 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.952234 10489 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 3, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.958257 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.963508 11852 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:39.966377 11859 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:39.966363 10743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:39.968575 10743 raft_consensus.cc:606] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:39.969630 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:39.977959 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.979836 11859 raft_consensus.cc:993] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: : Instructing follower e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:39.980383 11859 raft_consensus.cc:1081] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Signalling peer e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:39.983268 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.983520 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:39.985070 11835 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:39.985159 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.985476 11835 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:39.985857 11835 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:39.987816 10742 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.997952 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:39.998458 10660 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.999630 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.000382 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.001965 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.002375 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.002465 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.007596 11417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40"
dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:44884
I20260709 13:15:40.008139 11417 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:40.008453 11417 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.009830 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.010284 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.011937 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:39.963531 11877 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.013455 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:40.017573 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.018555 10667 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:40.019615 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:39.968815 11878 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:39.992376 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 113994us
I20260709 13:15:40.028646 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.030304 10739 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:40.031006 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.028980 11878 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.006518 11875 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.006681 11864 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.030822 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.034971 11852 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.052660 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.038389 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.054059 11877 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.054616 11877 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.038908 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.055015 11877 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.055420 11877 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.055887 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.056452 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:40.057494 11852 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.057849 11852 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.058203 11852 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.039140 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.059263 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.060050 11875 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.060197 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.041236 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.061868 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.062223 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.041615 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.042872 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.063989 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:15:40.034144 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 113880us
I20260709 13:15:40.065140 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.065829 11382 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.066401 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.068408 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:40.044950 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.043107 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.057158 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.070955 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.040679 10660 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:40.048426 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.048871 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.049499 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.049746 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.049856 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.050420 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.050362 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.046566 11878 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.047636 11876 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.051139 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.054463 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.060418 11875 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.074157 11417 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.041471 11835 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.081928 11881 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.046947 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.091778 11886 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.091846 11417 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.092756 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.062302 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:40.105370 11877 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.092975 11875 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.114431 11876 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.114501 11835 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:40.109781 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45869us
I20260709 13:15:40.112715 11852 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.095256 11854 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.104583 11886 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.116539 11881 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.117194 11854 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.122751 11881 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.116410 11876 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.119086 11852 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.123225 11881 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.123370 11876 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.122833 11854 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.123987 11876 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.135484 11854 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.132640 11878 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.136667 11876 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.137247 11854 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.138098 11878 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.137784 11875 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.138358 11881 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.138870 11877 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.139643 11875 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.140290 11881 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.140617 11876 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.117460 11886 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.167922 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:40.170698 10559 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.549s (SENT) [suppressed 3 similar messages]
I20260709 13:15:40.036194 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.171837 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.174021 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.174335 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.175808 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.175998 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.180531 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.180778 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.074473 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.187935 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.188479 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.190164 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.190826 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.191120 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.192273 10669 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:40.194005 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.194154 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.194999 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.196321 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.199331 11417 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:40.199759 11839 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.200470 11839 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.201036 11839 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.124315 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.194095 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.201241 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:40.085239 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.186129 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.073657 10662 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:40.217873 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 155504us
I20260709 13:15:40.218221 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.222038 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:40.197695 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.205277 11414 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.226325 11415 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.226665 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.224433 11835 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.227603 11835 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.227931 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.228084 11835 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.230480 11868 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:40.181994 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:40.209372 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 92006.9us
I20260709 13:15:40.238722 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.216490 11847 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:15:40.241808 11415 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:40.239837 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69405.5us
I20260709 13:15:40.234566 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.250906 11868 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:40.255340 11874 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.255801 11874 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:15:40.261934 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 80211.2us
I20260709 13:15:40.267494 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.273113 11414 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.278301 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.283588 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.274287 11860 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.290014 11860 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.290503 11860 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.290746 10738 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.291196 10738 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.292356 10738 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.292212 11860 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.262578 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.297796 11845 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.298225 10738 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.298719 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:40.301890 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.302462 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.303309 11839 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.304109 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.305399 11876 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.305929 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.310202 11854 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.310937 11881 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.336366 11881 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.336866 11881 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.311784 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 63938.2us
I20260709 13:15:40.342167 11846 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.343981 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.344393 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.309257 11845 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.345669 11846 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.346011 11875 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.348768 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.321496 11853 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.351923 11853 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.353142 11853 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:40.316318 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 99462.9us
I20260709 13:15:40.326342 11414 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.358146 11860 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.325110 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.261516 11874 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.350590 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.350323 11845 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.351214 11876 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.329418 11835 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.366581 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.368050 11835 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.368623 11886 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.319238 10738 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:40.362478 11874 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.363344 11875 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.364316 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.365052 11839 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.365890 11892 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.365809 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.368988 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.369453 11876 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.370352 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.370523 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.371881 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.379062 11854 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.377549 11847 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:40.372761 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.373890 11850 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.381870 11847 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.382258 11847 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.382575 11875 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.382921 11881 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.383296 11847 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.383973 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.384649 11847 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.384840 11875 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.374754 11845 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.385560 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:40.360337 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 86806.6us
W20260709 13:15:40.374148 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49301.6us
I20260709 13:15:40.375389 11846 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.388496 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:40.389650 11850 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.390152 11850 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.390628 11850 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.390980 11382 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:40.392081 11875 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.394157 11875 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:40.395359 10559 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.387362 11881 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:40.397447 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.398061 11875 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.399479 11877 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.379057 11892 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.402637 11846 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.404026 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.405872 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.411473 11893 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.414878 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.416231 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:40.417269 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.417464 11891 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:40.417817 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.418190 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.418143 11893 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.418893 11893 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.424027 11869 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.419775 11846 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.427395 11893 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:40.429610 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.431830 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.433020 11850 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.433736 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.433933 10489 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 2 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.435066 11850 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.436691 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.437036 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.439735 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.440937 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.442395 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.449429 11839 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.450696 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.450877 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.452015 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.455199 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.465656 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.466689 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.466778 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.470057 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.472260 11854 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:40.473284 10587 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.467902 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.455013 11876 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:40.476075 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 105826us
I20260709 13:15:40.473348 11859 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:40.481228 11379 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.481560 11854 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.481925 11854 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.482825 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.483980 11877 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.484112 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.484432 11859 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.484645 11877 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.484881 11859 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.485533 11877 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.467833 11892 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.486119 11859 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.486654 10489 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 2 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.488456 11859 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.483115 11854 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.490903 11854 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.493991 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:40.495409 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79259.7us
I20260709 13:15:40.505110 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.504607 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.506747 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.509162 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.510862 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:40.513801 10587 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:40.515391 11414 raft_consensus.cc:1240] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.518096 11868 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.518923 11868 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.519307 11868 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.519696 11868 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.520037 11877 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.525729 11886 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.525782 11898 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:40.501502 11875 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.541723 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.542716 11876 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.543174 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.538707 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.544166 11839 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.554525 11839 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.555517 11839 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.556784 11839 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.564196 11892 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.564779 11877 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.565804 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.568387 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.576247 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.569219 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.583537 11895 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:40.587505 11877 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:40.589279 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 77359.9us
I20260709 13:15:40.590168 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.586093 11886 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.601984 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.604655 11886 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.609447 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.610226 11886 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.611480 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.612201 11886 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.602032 11868 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.615280 11868 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.618008 11899 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.619138 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.619867 11886 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.616756 10560 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.621004 11860 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.622273 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:40.622777 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.628368 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.630748 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.631346 11860 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.634654 11886 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.636029 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.636772 11899 raft_consensus.cc:2764] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:40.637117 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:40.638078 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.601958 10665 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:40.640957 11899 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.641337 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.641634 11899 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:40.641785 11860 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.642163 11899 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.642563 11860 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.643253 11860 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.645740 11902 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.647928 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.649493 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.650292 11886 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.650754 10557 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.651355 11892 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.651855 11892 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.651878 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.652015 11839 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.653136 11839 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.653234 11904 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.653713 11904 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.654094 11904 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.654155 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.654958 11835 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.656231 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.652004 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.657007 11835 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.657476 11835 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.657858 11835 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.658989 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.660162 11902 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.652617 11892 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.657686 11853 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.661542 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.662325 11853 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.663482 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.664235 11853 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.665616 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.665741 11835 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.665881 11904 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:40.673859 10557 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46f08f529e274f3799aa41f54ca844f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.666179 11839 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.674525 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.678014 11414 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.669432 11853 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.679116 11904 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.642446 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.670375 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.670732 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.672547 11899 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.668948 11835 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.693733 11835 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.693931 11899 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:40.694097 11835 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.694520 11835 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.695386 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:40.695847 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.696632 11904 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.697096 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.697875 11904 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.698310 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.699062 11904 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.699433 11904 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.699803 11904 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.700043 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.700842 11868 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.678838 11860 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.650096 11900 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.683054 11892 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.680222 11853 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.701555 11835 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.683997 11898 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.702419 11898 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.684108 11895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37074 (request call id 7) took 1740 ms. Trace:
I20260709 13:15:40.702788 11860 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:40.684908 11847 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.703429 11835 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.704104 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.685338 11894 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:40.705581 11894 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.705914 11894 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.706758 11894 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.707932 11894 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.708067 11904 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.709813 11416 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.709946 11904 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:40.686048 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43686.4us
I20260709 13:15:40.711208 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.686467 11839 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.712538 10594 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:40.712702 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.713487 11839 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:40.683354 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.687341 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.687879 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.714469 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.689174 10588 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:40.689122 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.690299 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.716378 11853 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.716557 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.717649 11853 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.711238 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.720063 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.720603 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.721407 11839 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.721997 11839 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.721782 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.723687 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.702800 11898 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.724524 10662 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.702915 11895 rpcz_store.cc:276] 0709 13:15:38.943383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.943518 (+   135us) service_pool.cc:224] Handling call
0709 13:15:38.982260 (+ 38742us) log.cc:844] Serialized 492 byte log entry
0709 13:15:40.683997 (+1701737us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2535,"raft.run_cpu_time_us":1937,"raft.run_wall_time_us":64418,"thread_start_us":15021,"threads_started":1,"wal-append.queue_time_us":21722,"wal-append.run_cpu_time_us":1534,"wal-append.run_wall_time_us":1001557}
I20260709 13:15:40.729343 11901 consensus_queue.cc:1059] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:40.730079 11415 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.730518 11854 raft_consensus.cc:3055] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.730949 11854 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.731949 11854 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.733012 11854 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.733268 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.735558 11898 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.736554 11845 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.737305 11845 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.738673 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.738813 11839 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.740641 11854 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.742789 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.743057 11898 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:40.744429 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.744905 10589 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:40.746011 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.746662 11854 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.747054 11854 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.746944 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.748010 11854 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.748838 10589 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.701196 10635 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.750075 11874 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:40.750854 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49732.7us
I20260709 13:15:40.751451 11847 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.751533 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.752243 11874 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.752493 11839 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.752602 11874 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.752872 11839 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.753037 11874 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.753136 10588 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.753777 11839 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.755142 11839 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.752841 11835 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:15:40.759728 11874 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:40.761535 11868 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.761900 11868 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.762027 10489 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:40.760280 10586 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:40.762878 11868 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.764058 11868 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.766408 11854 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.767808 11835 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.768944 11893 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.769294 11893 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.770253 11893 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.771541 11893 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.772006 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.773661 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.774755 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.773497 11898 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.761863 11874 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.777846 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:40.783939 11900 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.785465 11900 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.786813 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.787135 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:40.787916 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.788398 11904 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.789528 11900 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:40.789439 11904 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.790051 11900 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.790520 11835 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.790944 11835 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.790894 11900 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.792621 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:40.791492 11835 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.795354 11904 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.795769 11904 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.796748 11904 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.797622 11906 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.797477 11868 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.797930 11904 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.798105 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:40.798717 11906 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.798105 11893 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.802424 11835 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.799646 11906 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.804348 11835 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.789112 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.773193 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.810442 11414 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.812529 11900 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.812794 10560 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.814049 11898 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.814652 11898 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.814705 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.815683 11899 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.815728 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.817034 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.817804 11899 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.818985 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.819411 11892 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.819703 11899 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.820992 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.821808 11899 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.823179 11899 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.823699 10489 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.827144 10738 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.829128 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.840040 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.841428 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.842203 11899 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.842669 10557 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.843405 11899 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.843804 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.844550 11899 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.845268 11899 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.845662 11835 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.846096 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.847558 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.848253 11893 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.812227 11854 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:15:40.848898 11893 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.849269 11893 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.849743 11893 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.846269 11899 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.850463 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.850725 11899 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.850939 11854 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.851524 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.851445 11854 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.851783 11899 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.852270 11900 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.852623 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.852779 11907 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.853153 11853 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.853571 11907 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.853730 11853 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.855832 11853 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.856844 11853 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.857347 11853 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.846101 11835 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:40.861793 11835 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.862296 11899 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.862891 10665 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:40.853830 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.864841 11900 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.865429 11853 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.865911 11898 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.866356 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.867093 11898 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.867457 11898 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.867799 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:40.868295 11898 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.868779 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.868947 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.870087 11844 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.870853 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:40.870952 11844 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:40.871704 11844 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.873672 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.873865 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.874641 10736 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:40.872673 11844 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.874526 11893 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.875731 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.876591 11893 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.870280 11898 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.877782 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.872690 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.878798 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.880537 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.880612 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.882216 10660 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:40.880628 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.883641 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:40.883641 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.886924 11864 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.885130 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:40.888104 11902 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.888067 10665 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.888823 10736 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:40.889206 11902 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:40.890316 11886 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.890506 11850 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.890910 11850 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:40.891815 11850 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.892853 11835 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.894954 11835 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:40.895530 11850 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.896396 11906 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.901969 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 108943us
I20260709 13:15:40.904882 11868 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.905958 11868 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.906258 11868 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:40.907157 11868 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.907387 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.908259 11868 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.909520 11902 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.918052 10666 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.924525 10736 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:40.925825 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.925509 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.924544 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.928944 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.931110 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:40.933436 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.934886 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.936529 11854 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:40.936787 10590 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:40.942611 10666 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.945830 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.948235 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:40.948565 10666 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:40.954048 11414 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:40.955356 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.958352 11898 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.959352 11898 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.959671 11898 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.960119 10590 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:40.960474 11898 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.961402 11886 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.961773 11898 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.961665 11839 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.963377 11839 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:40.964814 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.965061 11835 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.965664 10590 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.964757 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.968329 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:40.969128 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:40.969220 11839 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:40.972258 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.972432 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:40.973223 11839 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.973699 10666 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.973649 11839 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:40.974198 11839 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.975069 11894 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.975970 11868 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.976119 11894 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.976588 11894 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:40.977264 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:40.977869 10588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:40.978612 10588 raft_consensus.cc:606] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.979013 10588 raft_consensus.cc:614] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:40.980226 11894 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:40.975140 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:40.981630 11894 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.983045 10743 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:40.984491 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:40.990326 11853 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.992144 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.993521 11853 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:40.993906 10706 consensus_peers.cc:597] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e245cc261b6415fac3d372489a49ceb. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:40.995482 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.997155 11902 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.997720 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:40.998570 10738 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:41.001470 11853 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.001729 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:41.011646 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.012329 11899 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.016284 11845 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.017225 11868 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.018332 11899 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.020238 11894 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.022068 11860 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:41.022524 11860 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.022193 10587 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.018731 11899 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.023516 11860 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.024953 11868 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:41.025679 11868 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:41.026530 11868 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.024554 11899 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.028283 11899 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:41.029655 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54561.1us
W20260709 13:15:41.030820 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53647.1us
I20260709 13:15:41.031682 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.029245 11860 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.036952 11835 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.038733 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.039554 11835 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.019347 11839 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.046639 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.050725 11864 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:41.052600 11893 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.053752 10666 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:41.056592 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:41.058557 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.064795 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.066795 11835 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.068661 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.071568 11835 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.060562 11906 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.076120 11839 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:41.076336 11902 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.074842 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.081133 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.081758 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:41.072556 11891 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.088487 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:41.072935 11894 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:41.081875 11906 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.089157 11835 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.102177 10663 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:41.107905 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:41.108893 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:41.091979 11891 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.113924 11891 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.112371 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:41.118459 10594 raft_consensus.cc:606] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.122989 10594 raft_consensus.cc:614] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.126372 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:41.127067 10594 raft_consensus.cc:606] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.130056 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81565cb1f2054410aae97284b914f79c"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:41.130734 10594 raft_consensus.cc:606] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:41.131141 10594 raft_consensus.cc:614] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.134171 10660 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.115247 11839 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:15:41.118881 11921 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.146310 11923 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:41.146687 11923 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.146950 11921 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.138715 11847 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:41.148181 11847 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.147855 11921 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.149020 11847 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.149537 11839 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.150477 11847 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.150571 11839 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.147495 11923 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.152137 11923 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.150938 11839 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.173615 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:41.174510 11415 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:41.177140 11414 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:41.158941 11839 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.197711 11860 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:15:41.216542 10660 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:41.188809 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:41.220798 11860 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:41.221199 11860 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.222117 11860 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.224576 11860 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.232648 11416 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:41.227898 10594 raft_consensus.cc:606] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.230099 11894 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:41.233965 10594 raft_consensus.cc:614] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:41.236095 11894 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:41.236419 11894 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.236894 11924 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.237180 11894 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.240470 11894 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:41.246798 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 173722us
I20260709 13:15:41.248034 11414 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.250563 10588 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.247885  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:41.252132 11835 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.252885  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:41.242149 11839 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:41.254776 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 63363.6us
I20260709 13:15:41.259013 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.260064 11904 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.262125 11901 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.261878 11904 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.262504 11901 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:41.263368 11901 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.264032 11904 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:41.255164 11924 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:15:41.269827 11922 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:41.269771 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:41.270350 11922 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.270917 11414 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:41.271386 11922 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.272758 11922 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.280810 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.287189 10492 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 3 to 4, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.281167 11927 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.294361 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:41.297297 11921 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:41.297717 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.297043 11844 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.298502 11901 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.300568 10587 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:41.306928 10592 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.314776 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:41.317498 11927 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.318389 11921 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:41.318724 11921 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.319357 10666 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.319531 11921 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.320086 11902 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.320765 11921 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.321192 11859 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:41.311806 11864 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.301808 11900 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.329250 10661 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:41.337762 11932 ts_tablet_manager.cc:933] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:41.342106 11904 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.354665 11928 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:41.353116 11904 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.359395 11904 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:41.360623 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:41.364821 11904 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:41.365630 11904 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.366874 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:41.370791 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:41.371709 10590 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:41.372998 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:41.374038 11900 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.374480 11900 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:41.374889 11900 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.381194 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.383098 10743 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.384404 11906 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.392633 11906 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.398382 10665 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.401780 11904 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:41.406186 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:41.406603 11895 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.406915 10736 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:41.406251 11932 tablet_copy_client.cc:323] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:15:41.410979 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet 46f08f529e274f3799aa41f54ca844f9 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:15:41.411504 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet 46f08f529e274f3799aa41f54ca844f9 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-46f08f529e274f3799aa41f54ca844f9
I20260709 13:15:41.406929 11895 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:41.419539 11895 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.420857 11895 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.424152 10604 tablet_copy_source_session.cc:215] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:41.406185 11844 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.426771 11844 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:41.428202 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f08f529e274f3799aa41f54ca844f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.428085 11844 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.431620 11900 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.436542 11844 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.439932 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:41.448192 11900 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:41.448297 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:41.449014 10736 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:41.451892 10592 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:41.453207 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:41.465651 11900 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.477972 11900 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:41.479080 11900 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:41.486860 11932 tablet_copy_client.cc:806] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:41.488366 11932 tablet_copy_client.cc:670] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:41.499372 11932 tablet_copy_client.cc:538] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:15:41.503221 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 152048us
I20260709 13:15:41.515102 11844 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:15:41.542505 10489 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 3, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.553296 10666 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: [1.2-1.2]
W20260709 13:15:41.558373 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ae2b9cd744b4a2bba38c92a5f4b94f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.560017 10743 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:41.572523 10592 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:41.572599 10588 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:41.573750 11932 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:41.574019 11904 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:41.579573 10490 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.583788 11835 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:41.581492 10490 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.585520 10490 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.589970 10736 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:41.590541 11904 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:41.600597 11904 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:41.610548 10492 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.615501 11835 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.616986 10592 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.639091 10665 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:41.640192 11932 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:41.640779 11921 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:41.641165 11932 tablet_bootstrap.cc:492] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:41.642023 11932 ts_tablet_manager.cc:1403] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.008s
I20260709 13:15:41.644826 10743 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.645571 11415 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:41.645102 11932 raft_consensus.cc:359] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.646166 11932 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:41.646848 11932 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:41.649385 11932 ts_tablet_manager.cc:1434] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:41.651273 10604 tablet_copy_service.cc:342] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-46f08f529e274f3799aa41f54ca844f9 received from {username='slave'} at 127.0.0.1:34318
I20260709 13:15:41.651856 10604 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-46f08f529e274f3799aa41f54ca844f9 on tablet 46f08f529e274f3799aa41f54ca844f9 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:41.652575 11895 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.660758 10665 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.662238 11901 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.668295 10492 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 4, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.670835 10706 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 456c58bcf67c4357b892184c57ce7e09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.678733 10592 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.711306 11931 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.717656 10743 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:41.730489 11415 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:41.737499 11894 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.739560 11894 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:41.745635 10743 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.761142 11931 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.767360 10660 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.802837 11900 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.803369 11900 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.805413 10594 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.807667 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:41.808233 10738 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:41.811523 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:41.812709 11907 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:41.813139 11907 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.813602 11907 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.820888 11900 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:41.829483 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:41.830606 11415 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:41.847957 10491 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 1 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:41.849454 11907 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.861754 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:41.862340 10736 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.868351 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:41.868925 11415 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.872139 10736 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:41.873433 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:41.874205 11835 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:41.874672 11835 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:41.875451 11835 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.880877 11415 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:41.891192 11907 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:41.899452 10491 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.910120 10594 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.911607 11835 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.929593 11907 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.930124 11907 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.932803 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:41.933379 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:41.933408 10588 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:41.936175 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:41.936968 11835 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.937350 11835 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.937674 11835 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.950616 10736 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.961306 11893 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.981868 11907 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:41.985580 11835 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.987495 11895 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.992055 11895 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:41.994148 11895 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:41.995659 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:41.999799 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.000363 11415 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.001585 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:42.002777 11895 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.003535 11895 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.004051 11895 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.016429 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:42.017465 10594 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.027112 11895 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.029510 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.031769 10594 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:42.050966 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:42.052047 11893 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.052496 11893 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:42.053288 11893 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.032490 11835 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.044835 11886 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.047005 11932 ts_tablet_manager.cc:933] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.060200 11886 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.067314 11886 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.074162 11860 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.074784 11860 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.075117 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.076880 11860 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.069057 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.077389 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.077941 10660 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.077648 10588 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:42.078984 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.079792 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.081248 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.083730 11860 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.084161 11860 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.084537 11860 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.085777 10743 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:42.093869 11886 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.095038 11886 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.102340 11886 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.112658 11886 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.110886 11932 tablet_copy_client.cc:323] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.66:33499
I20260709 13:15:42.115173 10491 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.117668 10678 tablet_copy_service.cc:140] P 18f1a9f5e66846dba474825fb5b2b784: Received BeginTabletCopySession request for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:42652)
I20260709 13:15:42.118207 10678 tablet_copy_service.cc:161] P 18f1a9f5e66846dba474825fb5b2b784: Beginning new tablet copy session on tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:42652: session id = e71e2e44af1e46d8a8423ae08646bc22-3ae2b9cd744b4a2bba38c92a5f4b94f3
I20260709 13:15:42.121253 11886 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.123106 11895 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.123355 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.124651 11853 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.124509 11860 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.125097 11853 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.126509 11860 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.127458 11853 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.128136 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.128711 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:42.129227 10588 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.130831 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.131448 11414 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:42.133031 10706 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:42.133601 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.134112 10666 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.134189 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.134781 10660 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.135385 10678 tablet_copy_source_session.cc:215] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.128746 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.137574 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.137931 11415 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.138124 10736 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.141098 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.143934 10666 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.150416 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.151149 11860 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.151573 11860 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:42.152346 11860 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.146462 11931 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.155874 11931 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.156301 11931 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.157338 11895 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.157774 11895 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.159718 11895 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.163306 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.163988 10665 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.147439 10588 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:42.165446 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:42.149331 11415 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.166894 10559 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.167116 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.167850 11895 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.168220 11895 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.168659 11895 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.169518 11886 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:42.168147 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.174863 11860 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.175544 11860 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:42.176348 11860 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.177911 10491 catalog_manager.cc:5697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.183671 10660 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.191817 11895 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.198868 11895 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.189550 11931 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.190569 11886 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:42.191377 11853 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.199824 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.200264 11853 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.200625 11886 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.196314 10736 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.199539 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.208750 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.208971 10660 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.208395 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.209334 10665 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:42.211047 11853 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.211390 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.212231 11927 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.212572 11927 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.212687 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.212939 11927 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.215736 11844 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.216192 11844 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.216389 11931 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.217909 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.218190 11844 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.218560 11415 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.219568 10489 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.223371 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.224846 11853 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.225370 11853 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.227464 11853 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.230049 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.230914 11414 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:42.230141 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.232064 11416 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:42.234066 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.236492 11415 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:42.236634 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:42.237986 10706 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:42.242913 10660 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:42.244153 10559 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:42.241117 11901 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.247565 11901 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.247952 11901 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.251068 11895 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:42.251591 11895 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:42.252450 11895 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.266261 11967 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:42.266798 11967 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.242146 11853 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.269685 11853 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.269783 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.270080 11853 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.270478 10660 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:42.241395 11886 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:42.275693 11886 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.281414 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.282528 10588 raft_consensus.cc:2368] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 2. Current term is 3.
I20260709 13:15:42.294793 11379 leader_election.cc:400] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 2. Current term is 3.
I20260709 13:15:42.295081 11379 leader_election.cc:403] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.305648 10489 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 4, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 4 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.306856  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:42.308739 11927 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.310622 11927 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.316912 11932 tablet_copy_client.cc:806] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.318487 11901 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.320577 11901 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.330004 11886 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.330523 11886 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:42.331038 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.330962 11886 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.332975 11886 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.334172 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.335080 10660 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:42.335994 11967 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.336954 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.337174 11967 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.337636 11860 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.338090 11860 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.340085 11860 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.340703 11970 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.358930 10489 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.362041 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.362707 10660 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.360977 11835 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.365777 11835 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.355288 11932 tablet_copy_client.cc:670] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.367740 11835 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.341094 11970 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:42.363842 11860 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.369663 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:42.370213 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 85238.4us
I20260709 13:15:42.370321 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.371006 11415 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:42.349824 11853 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.361198 11886 raft_consensus.cc:476] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Not starting pre-election -- already a leader
W20260709 13:15:42.378430 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 133958us
I20260709 13:15:42.379961 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.380018 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.380599 10665 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.381564 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.382126 10594 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:42.383095 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:42.383337 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.384168 11835 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.384524 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.384184 10736 raft_consensus.cc:2368] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:42.384534 11835 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.386159 11835 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.387822 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.388751 10588 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:42.368983 11970 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.374696 11923 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.364105 11927 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.417785 11906 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:42.418161 10665 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:42.418646 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.419864 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.373719 11860 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.431660 11853 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.442901 11417 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.436390 11923 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.386945 11893 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:42.444442 11923 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.444834 11907 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:42.449344 11906 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.445127 11414 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.451295 11382 leader_election.cc:400] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:42.451622 11382 leader_election.cc:403] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.444919 11927 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.452461 11886 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.452935 11886 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.453836 11893 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.449476 11907 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.443220 11835 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.469842 11972 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.470340 11972 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.472328 11972 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.472795 11972 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.467494 11901 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.475111 10706 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:42.476629 11931 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.477164 10588 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:42.479763 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.480434 10743 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:42.481703 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.483858 11927 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.475764 11853 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.485514 11853 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.487356 11853 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.487810 11975 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.488288 11975 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.490156 11975 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.490366 11886 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.491070 11860 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.491894 11904 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:42.492295 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.492631 11932 tablet_copy_client.cc:538] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.492982 11415 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.493753 11904 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.494211 11904 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.480397 11973 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.476639 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.476752 11901 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:42.496657 11895 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.505026 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.510062 10736 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:42.497961 11978 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.511432 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.512070 10736 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.513087 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.513877 11415 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.515969 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.516539 10585 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:42.517657 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.520680 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.526762 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.527530 10665 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:42.531646 11985 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.477864 11972 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.536832 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.537470 10660 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:42.539767 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.507704 11981 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.540494 11416 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:42.525838 11860 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.518630 10590 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:42.536401 11973 raft_consensus.cc:697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:42.518958 11975 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.499051 11931 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.524433 11978 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.529186 11895 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.549911 11415 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:42.558354 11980 ts_tablet_manager.cc:933] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.558044 11982 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:42.570348 11983 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.567173 11417 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:42.532243 11985 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.596419 11835 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.571646 11978 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.597534 10592 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:42.552774 11923 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.586331 11906 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.557888 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.589232 11967 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 2. Current term is 3.
I20260709 13:15:42.607909 11973 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.611356 11979 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.611786 11979 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.614738 11923 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.615264 11923 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.615660 11923 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.615841 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.591825 11975 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.618677 11972 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.619786 11975 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.620213 11895 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.620710 11895 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.621091 11895 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.622577 11985 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.623067 11985 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.623479 11895 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.624948 11904 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.589000 11844 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:42.625560 11844 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.626441 10736 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.627475 11844 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.630590 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.631139 10743 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:42.631966 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.632164 10560 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.632480 10738 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.633553 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.634254 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.634721 10660 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.635047 10736 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.635609 11895 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.635979 11895 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.636318 11895 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.637611 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.638163 10665 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.560395 11860 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:42.623438 11985 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.641963 10666 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:42.595063 11982 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:42.643873 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.644420 11417 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.602962 11907 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.553929 11981 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.659494 10660 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.655524 11886 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.669448 11982 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.670372 11901 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.659943 11987 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.670971 11931 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:42.643132 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 101510us
I20260709 13:15:42.690644 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.606249 11983 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.699352 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.699774 11983 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.700827 11967 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.701272 11967 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.701617 11967 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.704819 11893 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.705596 11972 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.706039 11972 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.706691 11981 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.707898 11972 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.710098 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.672043 11886 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.710677 10660 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:42.710880 11886 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.711905 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:42.712745 11972 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.713102 11972 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.713433 11972 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.685159 11987 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.672698 11414 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:42.720959 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.717293 11895 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.746240 10743 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:42.722652 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.747496 11417 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.747785 11932 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:15:42.724443 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.726601 11987 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.719686 11923 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.749802 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.750005 11923 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:42.750929 11984 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.751394 11984 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.726727 10738 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 1.
I20260709 13:15:42.751784 11984 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.727047 11976 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:42.764103 11976 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.764623 11976 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.728283 11860 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.769189 11860 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.769713 11860 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.772181 11860 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.719481 11979 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.723233 11415 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:42.727386 11412 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:42.724642 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.725618 11985 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.774689 11413 raft_consensus.cc:2368] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.736294 11886 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.776607 11418 raft_consensus.cc:2368] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:15:42.777827 11886 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.743916 11967 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.778573 11987 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.780177 11967 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.780548 11987 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.727063 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.781662 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.725656 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.782191 10738 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.782517 11416 raft_consensus.cc:2368] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.710678 11970 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.758008 11972 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.786733 11970 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.787024 11410 raft_consensus.cc:2368] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:42.787883 11976 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.788331 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.747504 11895 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.790228 10738 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:42.791293 11972 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.791512 11382 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.726192 11978 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.798890 10587 raft_consensus.cc:2368] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
I20260709 13:15:42.801604 11978 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:42.797068 11984 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:42.821782 11984 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.832144 11979 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.832845 11979 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.835325 11979 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:42.838689 10632 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.838991 10632 leader_election.cc:403] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.840643 11985 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.841080 11985 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:42.841656 11904 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.842115 11904 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:42.842983 11985 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:42.844120 11904 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:42.849546 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 255978us
I20260709 13:15:42.867175 10632 leader_election.cc:400] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.867588 10632 leader_election.cc:403] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.870066 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.872140 10660 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.875725 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.877619 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.878345 10665 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.881359 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:42.874619 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.882180 10665 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.887734 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.888556 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.899857 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.868347 11985 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.901434 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:42.868148 11995 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.909906 10667 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:42.876621 11976 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.911827 10661 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:42.914320 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.917033 10743 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.917337 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.917910 10736 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:42.922971 10665 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.882761 11984 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:42.875341 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83934.4us
I20260709 13:15:42.871274 11906 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:15:42.901590 11860 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.870911 11904 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:15:42.929461 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:42.936144 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 69113.6us
I20260709 13:15:42.936234 10736 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.928733 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:42.901459 11978 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.906052 11923 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.901383 11895 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.930598 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.938786 10738 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:42.950047 11416 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:42.942798 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.950608 10742 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.923992 11980 tablet_copy_client.cc:323] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:42.951316 10665 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:42.941040 10743 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:42.937023 10632 leader_election.cc:400] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:15:42.954994 10632 leader_election.cc:403] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.955690 10632 leader_election.cc:400] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:42.955946 10632 leader_election.cc:403] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.959298 10736 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:42.927225 11984 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:42.959360 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:42.971992 10632 leader_election.cc:400] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:42.974895 10632 leader_election.cc:403] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.943114 11983 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.981003 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.973631 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:42.981572 10594 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:42.933746 11860 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.974911 11416 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.942022 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.993757 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:42.994576 10741 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:42.979189 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:42.942209 11923 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.980077 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.988164 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.936450 11991 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:42.998231 11835 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.998358 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.010766 10706 leader_election.cc:400] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
I20260709 13:15:43.011112 10706 leader_election.cc:403] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.999295 11977 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.928239 11976 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.005349 10585 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:43.013074 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 61266.8us
I20260709 13:15:43.047570 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:42.994011 11860 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:43.013981 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.047830 11991 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.049072 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.050079 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.050177 11991 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.014979 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.050789 10591 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:43.051532 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.052161 10591 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:43.016273 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:43.019263 11978 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:43.019578 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:43.019933 11853 raft_consensus.cc:2764] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:43.022830 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:43.025646 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:42.958514 11895 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.033399 11927 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:43.037899 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.039004 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.039558 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.039745 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.040534 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.042690 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.039615 10491 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.044198 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.044487 10706 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.078671 10734 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:43.045668 10588 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:43.045863 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.079439 10586 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:42.924749 11995 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.060106 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.061620 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:43.047851 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.970314 11907 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:15:43.105019 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:42.993768 11988 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:15:43.062978 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46798.4us
I20260709 13:15:43.062647 11418 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:43.064383 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 87516us
I20260709 13:15:43.065718 11835 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:43.047854 11410 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:43.031549 11990 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.009891 11923 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.068346 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:43.118639 10589 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:43.119056 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 50796.2us
W20260709 13:15:43.073520 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.015s	sys 0.007s
W20260709 13:15:43.120194 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.015s	sys 0.008s
I20260709 13:15:43.118158 11412 raft_consensus.cc:2368] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
W20260709 13:15:43.120503 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 615490us
I20260709 13:15:43.075693 12006 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:43.121922 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48595.2us
I20260709 13:15:43.076259 12010 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.045260 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.046967 11977 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:43.078805 10737 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
W20260709 13:15:43.104174 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 59783.8us
I20260709 13:15:43.138109 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:43.138543 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.077797 11999 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.114786 10587 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:43.069476 11967 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:43.127139 10593 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:43.109055 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:43.151506 10667 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.072192 11987 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.137226 10740 raft_consensus.cc:2368] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:43.154919  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:43.119398 11981 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.147815 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:43.148489 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.160233 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.160907 10588 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:43.161917 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.163005 10588 raft_consensus.cc:2368] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.164155 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.149075 10706 leader_election.cc:400] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.149406 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.143136 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.165289 10706 leader_election.cc:403] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.166663 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.169636 10668 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:43.172592 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:43.173098 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:43.141310 11977 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.138429 11970 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.104390 11927 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.141069 12006 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.196373 11895 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:43.197853 10635 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:43.199898 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:43.174734 11973 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.206369 10742 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:43.197218 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.150276 11990 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:43.210704 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 456c58bcf67c4357b892184c57ce7e09 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:43.211323 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 456c58bcf67c4357b892184c57ce7e09 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-456c58bcf67c4357b892184c57ce7e09
I20260709 13:15:43.211568 11990 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:43.212276 11990 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.213018 10593 raft_consensus.cc:2368] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.116721 11984 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.178553 11981 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:43.216322 11416 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:43.216823 10668 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:43.207908 10741 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.191624 11970 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.224308 11970 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.208894 10735 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:43.196568 12016 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.194624 12006 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.171799 11987 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.243702 10741 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:43.208364 11901 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
I20260709 13:15:43.247222 12000 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.252943 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.194748 11991 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:43.259267 10666 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:43.260303 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:43.261196 11416 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:43.155349 11978 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.262069 11412 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:43.265764 10593 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
W20260709 13:15:43.267279 12003 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:15:43.267621 12007 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
W20260709 13:15:43.268271 11997 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:15:43.268664 12008 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.238354 11973 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:43.157775 12010 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.272601 10739 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:43.277598 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 167320us
W20260709 13:15:43.241025 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 99860.7us
I20260709 13:15:43.258553 11986 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.222543 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:43.270607 12000 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.237617 12011 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:43.284101 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 84921.3us
I20260709 13:15:43.285837 10632 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:43.290619 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 141660us
I20260709 13:15:43.299361 10753 tablet_copy_source_session.cc:215] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:43.301458 11972 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:43.302416 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.281893 12016 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:43.307364 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.308372 10706 leader_election.cc:400] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.307893 10585 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:43.286242 11976 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:43.291738 12008 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.295285 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.315037 12018 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:43.293618 12000 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.320982 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.311124 11999 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:15:43.315567 11904 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:43.287118 11986 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.281225 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:43.311022 11982 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.305162 11970 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.324219 12008 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.315812 11995 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:43.323177 12011 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:43.342466 12023 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:43.343031 10662 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:43.337386 11973 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.337146 11982 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.331645 12018 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:43.319264 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 110125us
I20260709 13:15:43.290971 11981 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.363950 12020 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:43.364477 12020 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.364872 12020 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:43.306279 12016 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.359475 11999 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:43.366065 12014 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:43.366122 11999 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.366671 11999 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.328073 11860 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.382345 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:43.386843 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.362534 12018 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:43.362711 11982 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.336043 11904 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.367908 11927 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:43.402879 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 76012us
I20260709 13:15:43.403563 10594 raft_consensus.cc:2368] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:43.389739 11976 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:43.391453 11991 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.385900 10590 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:43.339380 11977 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:43.399513 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 127349us
W20260709 13:15:43.419167 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 98302.6us
I20260709 13:15:43.391719 12007 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:43.427378 10665 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:43.429023 10736 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:43.431905 10706 leader_election.cc:400] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.432257 10706 leader_election.cc:403] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.434122 10635 leader_election.cc:400] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:43.417807 11976 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:43.425707 11991 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:43.362164 12023 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.463268 12010 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.433595 12007 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:43.468410 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.474727 10667 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:43.476513 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:43.476735 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 45014us
I20260709 13:15:43.463267 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.484278 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.437582 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:43.489372 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.490273 10588 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:43.469255 11975 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.496444 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.506028 12028 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:43.506747 12028 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.507666 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.508625 10667 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
W20260709 13:15:43.513566 12025 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
W20260709 13:15:43.518612 12024 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:15:43.486730 11970 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.485618 11986 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.522527 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.498067 10664 raft_consensus.cc:2368] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
I20260709 13:15:43.528584 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:15:43.501938 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 68256.6us
I20260709 13:15:43.536448 11977 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:43.526587 12004 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.528784 11860 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:43.555022 12011 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.587255 12010 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:43.589133 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:43.589805 11410 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:43.595616 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.597654 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:43.598313 10736 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.604168 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.605556 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.603068 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.611552 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.613093 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:43.521173 11991 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.615943 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:43.613785 10588 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:43.593221 12004 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:15:43.615463 11983 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.626s	user 0.003s	sys 0.008s
I20260709 13:15:43.532177 11976 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.565527 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:43.617784 12023 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.631181 11893 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.657548 11980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456c58bcf67c4357b892184c57ce7e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:43.665171 11982 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.627791 11860 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:43.645043 11983 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:43.675369 10736 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:43.534410 12007 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.662667 11893 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.649668 11970 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:43.724202 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.726481 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:43.738343 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:43.739327 10587 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.742085 11416 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:43.743979 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.744867 10741 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:43.684187 11860 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.742300 11893 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.773365 12005 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.743394 11983 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.707190 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:43.813516 11970 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.814078 11970 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:43.814978 11970 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.816023 10587 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
W20260709 13:15:43.812919 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 110861us
I20260709 13:15:43.812139 12011 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:43.742466 12004 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:43.836516 12011 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.803409 11982 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:43.842679 12011 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:43.843186 11923 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.004s
I20260709 13:15:43.834422 11999 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:43.877772 10736 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.877657 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.878538 10741 raft_consensus.cc:2368] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:43.849726 12018 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.885603 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251650397d264ac1a42a2fde5932424f"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:43.886188 10589 raft_consensus.cc:606] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:43.888100 12018 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.889897 10663 raft_consensus.cc:2368] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:43.843636 11923 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:43.879056 11904 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.834131 12005 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:43.900151 12005 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.904165 10560 leader_election.cc:400] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:43.904574 10560 leader_election.cc:403] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.907075 10586 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:43.912812 10588 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:43.914538 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.925767 10736 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:43.914062 10740 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.943996 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:43.914947 12016 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:43.941129 11860 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:43.949188 11985 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.023s	user 0.015s	sys 0.000s
I20260709 13:15:43.956797 11999 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:43.945438 11904 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:43.957559 12001 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:43.974663 10668 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:43.976415 11988 consensus_meta.cc:287] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.007s
I20260709 13:15:43.976816 11988 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
I20260709 13:15:43.977128 11901 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:43.977633 11901 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:43.979414 12006 consensus_meta.cc:287] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.724s	user 0.015s	sys 0.000s
I20260709 13:15:43.979529 11901 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:43.943630 12010 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:15:43.960580 11985 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3.
W20260709 13:15:43.984022 12008 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.002s
W20260709 13:15:44.005365 12000 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.006s
I20260709 13:15:44.005759 12000 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.009853 11987 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.011075 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.011801 10742 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:44.014700 10660 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:43.979851 12006 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.019213 12000 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.020570 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:44.021348 10662 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:44.013782 10560 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:44.024085 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.024430 12006 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.025135 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.026118 10669 raft_consensus.cc:2368] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:44.032601 10742 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:43.967466 11904 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.043900 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.044787 10662 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:44.045588 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.048326 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.053021 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:44.053445 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:44.054100 10742 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.055500 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:44.054093 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:44.056869 10662 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:44.057670 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:44.070116 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:44.071000 10662 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:44.073045 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.029s	sys 0.025s
W20260709 13:15:44.073452 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.029s	sys 0.026s
W20260709 13:15:44.073688 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 583229us
I20260709 13:15:44.077525 10742 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:44.078197 11992 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:44.079253 10560 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:44.079669 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 474991us
I20260709 13:15:44.081122 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.075181 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 933) took 1057 ms. Trace:
I20260709 13:15:44.032609 11984 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:15:44.058106 12001 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.092388 10743 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:44.092664 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 50) took 1015 ms. Trace:
I20260709 13:15:44.097690 10665 rpcz_store.cc:276] 0709 13:15:43.061183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.061360 (+   177us) service_pool.cc:224] Handling call
0709 13:15:44.076104 (+1014744us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000c2e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:44.076201 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540699904}
I20260709 13:15:44.081831 10735 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:44.064765 11895 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:44.092990 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 927) took 1088 ms. Trace:
I20260709 13:15:44.082804 10586 rpcz_store.cc:276] 0709 13:15:43.018239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.104711 (+ 86472us) service_pool.cc:224] Handling call
0709 13:15:44.074978 (+970267us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540020ec54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:44.075117 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842413952}
I20260709 13:15:44.057818 11923 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.094615 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:44.058199 11987 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.099375 10594 rpcz_store.cc:276] 0709 13:15:42.987824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.987963 (+   139us) service_pool.cc:224] Handling call
0709 13:15:44.075697 (+1087734us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:44.075834 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911363328}
I20260709 13:15:44.013540 12008 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.106328 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:44.107632 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:44.099771 11973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.018s	sys 0.018s
I20260709 13:15:44.101104 11992 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:44.100539 12001 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:44.137404 10592 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:44.135008 11973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.020s	sys 0.020s
I20260709 13:15:44.102043 11860 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:44.101274 11972 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:15:44.136829 12013 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.018s	sys 0.016s
I20260709 13:15:44.138828 12001 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.154274 10708 leader_election.cc:400] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
I20260709 13:15:44.169052 10708 leader_election.cc:403] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.169098 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:44.155308 12008 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.137387 11987 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:44.140139 11992 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:44.161155 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:44.175824 11416 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:44.164924 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.175020 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.173697 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:44.168432 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:44.178139 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.175292 11987 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.153463 11990 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:44.194375 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1500) took 1302 ms (client timeout 1702 ms). Trace:
I20260709 13:15:44.195906 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:44.211479 10743 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:44.139624 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:15:44.177666 12020 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.006s
I20260709 13:15:44.197160 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:44.218791 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:44.223820 12008 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.223944 11923 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:44.224215 12008 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.224598 12008 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.217651 12030 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3.
W20260709 13:15:44.191736 12013 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.018s	sys 0.016s
W20260709 13:15:44.210464 10660 rpcz_store.cc:269] 0709 13:15:42.872882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.875521 (+  2639us) service_pool.cc:224] Handling call
0709 13:15:44.175564 (+1300043us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003b3154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:44.175676 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599630208}
I20260709 13:15:44.205698 11987 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:44.210274 11990 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.229586 11986 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.235461 11986 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.236464 12028 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.237113 11990 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.248888 12044 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:44.256608 12044 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:44.248904 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:44.259459 12042 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.255314 10665 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:44.255704 10669 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:44.225714 12020 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:44.282693 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.004s	sys 0.004s
W20260709 13:15:44.283407 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.004s
I20260709 13:15:44.259824 12042 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.285084 10662 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:44.286769 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:44.287443 10734 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:44.283862 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 634653us
I20260709 13:15:44.307507 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:44.308766 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 82732.5us
I20260709 13:15:44.309211 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:44.309901 10741 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:44.310520 10708 leader_election.cc:400] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:44.310815 10708 leader_election.cc:403] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.311497 11973 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:44.312152 10661 raft_consensus.cc:2368] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:15:44.257745 12044 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.313519 10708 leader_election.cc:400] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:44.317955 10708 leader_election.cc:403] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.289964 12042 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.322657 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:44.331408 12001 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:44.297395 12011 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:44.336632 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:44.333166 10734 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:15:44.404378 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 81808.8us
I20260709 13:15:44.405524 10669 raft_consensus.cc:2368] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:15:44.405807 10632 leader_election.cc:400] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:44.408638 10669 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:44.411217 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:44.411890 10586 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:44.412962 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:44.413648 10588 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.415982 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:44.416810 10669 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.416123 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:44.417220 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:44.421639 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:44.423846 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:44.404354 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:44.236061 11992 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:44.312184 11979 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:44.478778 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 72957.5us
I20260709 13:15:44.479617 10586 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:44.323417 11994 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.301946 11923 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:15:44.502285 10663 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:44.488638 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:44.488592 10734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:44.504321 10734 raft_consensus.cc:606] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:44.484947 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:44.534430 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49582.4us
I20260709 13:15:44.535243 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:44.511546 11986 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.499630 11844 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:15:44.543211 11981 raft_consensus.cc:2764] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:44.491171 11979 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:44.552450 12054 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:15:44.579130 10588 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:44.546120 12031 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:44.582382 11991 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:44.605489 10667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.045s	sys 0.060s
I20260709 13:15:44.590837 12020 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:44.602893 11893 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.805s	user 0.004s	sys 0.007s
W20260709 13:15:44.608278 10668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.013s	sys 0.048s
W20260709 13:15:44.650839 10668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.014s	sys 0.049s
I20260709 13:15:44.617951 11991 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.646394 10669 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:44.647605 11987 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.648612 12031 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:44.661667 11972 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.662134 12028 raft_consensus.cc:2764] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:44.618722 11893 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:44.676051 12007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.040s	sys 0.072s
W20260709 13:15:44.701859 11976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.016s	sys 0.101s
W20260709 13:15:44.722121 11976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.016s	sys 0.101s
I20260709 13:15:44.723891 12008 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.733419 11893 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.693885 11972 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.736166 12008 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.736716 12008 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:44.737310 12046 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:15:44.737191 12008 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:44.738292 12045 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:15:44.701753 12007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.040s	sys 0.073s
W20260709 13:15:44.709908 11410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.047s
W20260709 13:15:44.743191 12055 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:15:44.701406 12011 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:44.755689 11995 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.744066 11410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.048s
I20260709 13:15:44.758492 11995 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.748905 11972 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.767410 10664 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:44.789966 11995 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.759697 12011 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.788867 11980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44884 (request call id 213) took 2387 ms. Trace:
I20260709 13:15:44.846308 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:44.848156 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.023s
W20260709 13:15:44.848302 10667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.055s	sys 0.075s
I20260709 13:15:44.801700 12007 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:44.744163 12008 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.778837 12031 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.927254 11923 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.905952 12041 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.509s	user 0.003s	sys 0.000s
I20260709 13:15:44.842451 11980 rpcz_store.cc:276] 0709 13:15:42.382221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.382337 (+   116us) service_pool.cc:224] Handling call
0709 13:15:42.592095 (+209758us) ts_tablet_manager.cc:934] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
0709 13:15:43.654022 (+1061927us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:44.224893 (+570871us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:44.225033 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:44.688966 (+463933us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:44.731111 (+ 42145us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:44.766782 (+ 35671us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:44.769892 (+  3110us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":45038,"tablet-copy.queue_time_us":125978,"thread_start_us":310271,"threads_started":2}
I20260709 13:15:44.944833 11980 tablet_copy_client.cc:806] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:44.945508 11980 tablet_copy_client.cc:670] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
W20260709 13:15:44.926205 11990 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.006s
I20260709 13:15:44.854769 12011 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.847877 12030 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:44.949338 11923 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:44.964920 11923 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:44.856139 11994 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:15:44.948989 12008 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:44.872447 11987 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:44.871505 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:44.981987 11980 tablet_copy_client.cc:538] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:15:44.995791 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.034s
I20260709 13:15:44.979077 11991 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:44.997850 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.034s
I20260709 13:15:44.865543 12007 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:45.014453 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 479264us
I20260709 13:15:44.981716 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 270) took 1385 ms. Trace:
W20260709 13:15:45.034771 10736 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.020s	sys 0.025s
W20260709 13:15:45.035223 10736 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.020s	sys 0.025s
I20260709 13:15:44.979877 12030 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:44.959322 11990 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:45.096729 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1231) took 1104 ms. Trace:
I20260709 13:15:44.866096 12042 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.099423 10736 rpcz_store.cc:276] 0709 13:15:43.965698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.003315 (+ 37617us) service_pool.cc:224] Handling call
0709 13:15:44.033449 (+ 30134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.045810 (+ 12361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.045839 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.057895 (+ 12056us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.405216 (+347321us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:45.035625 (+630409us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.069302 (+ 33677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.069426 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.069491 (+    65us) raft_consensus.cc:1685] finished
0709 13:15:45.069508 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.069657 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65650,"raft.queue_time_us":42426,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":17323,"thread_start_us":855597,"threads_started":2,"wal-append.queue_time_us":594645}
I20260709 13:15:45.065500 11995 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.110716 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1189) took 1091 ms. Trace:
I20260709 13:15:45.110502 11995 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.111111 10668 rpcz_store.cc:276] 0709 13:15:44.019142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.020045 (+   903us) service_pool.cc:224] Handling call
0709 13:15:44.020318 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.020636 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.020664 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.043275 (+ 22611us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.653081 (+609806us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:44.653134 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.653219 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.110496 (+457277us) raft_consensus.cc:1685] finished
0709 13:15:45.110516 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.110640 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8914,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13297,"thread_start_us":609421,"threads_started":1,"wal-append.queue_time_us":1035766}
I20260709 13:15:45.079938 11985 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.109045 11853 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.070427 12009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.025s	sys 0.021s
I20260709 13:15:45.120782 10741 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:45.079061 12020 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.065279 11967 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.078630 11975 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:45.147972 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1517) took 1704 ms (client timeout 1865 ms). Trace:
W20260709 13:15:45.129876 12009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.026s	sys 0.021s
I20260709 13:15:45.014254 12008 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.079281 11986 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.079763 11893 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:45.148454 10661 rpcz_store.cc:269] 0709 13:15:43.443488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.458592 (+ 15104us) service_pool.cc:224] Handling call
0709 13:15:45.147737 (+1689145us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54000c3854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:45.147895 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884438912}
I20260709 13:15:45.146374 11413 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:45.168007 12008 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.133495 11904 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.143354 11995 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:45.180568 11379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.022s	sys 0.035s
W20260709 13:15:45.181015 11379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.022s	sys 0.035s
I20260709 13:15:45.150450 11967 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.186975 11904 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.198908 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 165) took 1611 ms. Trace:
I20260709 13:15:45.199751 11418 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:45.199584 11904 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:45.174232 11999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.023s	sys 0.026s
I20260709 13:15:45.132205 11853 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.148463 11985 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.148583 12020 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.193761 11932 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:15:45.214140 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.060s	sys 0.104s
W20260709 13:15:45.238090 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.061s	sys 0.105s
I20260709 13:15:45.176774 11893 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.211200 11981 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:45.219465 11967 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.223307 10739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:45.253693 10739 raft_consensus.cc:606] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:45.254048 10739 raft_consensus.cc:614] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:45.254961 11893 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.237033 12007 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:45.227602 10734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.010s
W20260709 13:15:45.256636 10734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.016s	sys 0.011s
W20260709 13:15:45.227978 11381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.008s	sys 0.018s
W20260709 13:15:45.209256 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.003s	sys 0.024s
I20260709 13:15:45.212908 12053 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.174494 11986 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:45.235036 11999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.029s	sys 0.032s
I20260709 13:15:45.216543 11904 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.239533 11853 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:45.241410 11979 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:45.216409 12037 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.288292 12037 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.248924 11970 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.290184 12037 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:45.291477 11970 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.293009 10491 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 194) took 2293 ms. Trace:
I20260709 13:15:45.293918 11970 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.249532 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1234) took 1054 ms. Trace:
I20260709 13:15:45.294443 10735 rpcz_store.cc:276] 0709 13:15:44.194784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.196733 (+  1949us) service_pool.cc:224] Handling call
0709 13:15:44.217916 (+ 21183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.218640 (+   724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.218668 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.230499 (+ 11831us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.848615 (+618116us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:44.848670 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.848755 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.249346 (+400591us) raft_consensus.cc:1685] finished
0709 13:15:45.249366 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.249472 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5806,"raft.queue_time_us":1036,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7341,"thread_start_us":603897,"threads_started":1,"wal-append.queue_time_us":998111}
I20260709 13:15:45.295783 10492 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 1 to 3, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 3 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.296777 10490 catalog_manager.cc:5697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:45.283777 11381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.008s	sys 0.018s
I20260709 13:15:45.251035 12030 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:45.314348 10489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 217) took 1317 ms. Trace:
I20260709 13:15:45.314898 12007 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.314852 10489 rpcz_store.cc:276] 0709 13:15:43.996946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.997127 (+   181us) service_pool.cc:224] Handling call
0709 13:15:44.485239 (+488112us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:15:45.314269 (+829030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12722,"reported_tablets":1,"spinlock_wait_cycles":593341696}
I20260709 13:15:45.315438 12007 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.282116 12001 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.317605 12001 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.293346 10491 rpcz_store.cc:276] 0709 13:15:42.999639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.001636 (+  1997us) service_pool.cc:224] Handling call
0709 13:15:45.292924 (+2291288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:43.251235 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:43.283693 (+ 32458us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:43.283757 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:15:43.283789 (+    32us) tablet.cc:662] Decoding operations
0709 13:15:43.284393 (+   604us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:43.284449 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:43.284476 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:43.285298 (+   822us) tablet.cc:701] Row locks acquired
0709 13:15:43.285337 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:15:43.311765 (+ 26428us) write_op.cc:270] Start()
0709 13:15:43.316894 (+  5129us) write_op.cc:276] Timestamp: P: 1783602943309182 usec, L: 0
0709 13:15:43.318894 (+  2000us) op_driver.cc:348] REPLICATION: starting
0709 13:15:43.369649 (+ 50755us) log.cc:844] Serialized 530 byte log entry
0709 13:15:43.851319 (+481670us) op_driver.cc:464] REPLICATION: finished
0709 13:15:44.558617 (+707298us) write_op.cc:301] APPLY: starting
0709 13:15:44.564382 (+  5765us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:44.572463 (+  8081us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:44.588973 (+ 16510us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:44.641432 (+ 52459us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:44.665303 (+ 23871us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:44.673302 (+  7999us) write_op.cc:312] APPLY: finished
0709 13:15:44.685984 (+ 12682us) log.cc:844] Serialized 23 byte log entry
0709 13:15:44.741799 (+ 55815us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.747547 (+  5748us) write_op.cc:454] Released schema lock
0709 13:15:44.754780 (+  7233us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:44.789008 (+ 34228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.790887 (+  1879us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10671,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":650463,"apply.run_cpu_time_us":2934,"apply.run_wall_time_us":219500,"num_ops":1,"prepare.queue_time_us":107754,"prepare.run_cpu_time_us":4123,"prepare.run_wall_time_us":157500,"replication_time_us":527488,"thread_start_us":464548,"threads_started":2}]]}
I20260709 13:15:45.318037 12001 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.319773 11986 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.279937 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1235) took 1084 ms. Trace:
I20260709 13:15:45.283318 11893 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.303433 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:45.250134 11990 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:45.310014 11904 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.321954 10588 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:45.322101 11991 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.285207 12053 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.322335 11904 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.322981 10589 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:45.284061 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.003s	sys 0.024s
W20260709 13:15:45.323758 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 821215us
I20260709 13:15:45.312587 11923 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.312695 12010 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.344131 12010 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.313179 12016 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.313599 11895 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.314389 12008 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:45.311918 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 54) took 1753 ms (client timeout 1719 ms). Trace:
I20260709 13:15:45.332036 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:45.332940 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:45.333843 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:45.334791 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:45.321952 11987 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.322659 11991 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.320983 11893 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:45.432487 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:45.433216 10589 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:45.433473 12028 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.434268 11893 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:45.337824 11970 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:45.336747 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:45.336644 10590 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.336707 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:45.340003 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:45.435770 10591 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:45.199949 11412 rpcz_store.cc:276] 0709 13:15:43.588057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.588848 (+   791us) service_pool.cc:224] Handling call
0709 13:15:43.589202 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.616086 (+ 26884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.616136 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.616657 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.074121 (+457464us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:44.091835 (+ 17714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.096303 (+  4468us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.846439 (+750136us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:15:45.127057 (+280618us) raft_consensus.cc:1685] finished
0709 13:15:45.127095 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.180058 (+ 52963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23661,"raft.queue_time_us":34037,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4302,"spinlock_wait_cycles":18946432,"thread_start_us":442795,"threads_started":1,"wal-append.queue_time_us":675349}
I20260709 13:15:45.340101 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:45.384428 12008 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.341089 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:45.435087 11970 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:45.442011 10594 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:45.442649 10587 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:45.435983 11417 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:45.343451 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:45.444393 12034 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.337857 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:45.433952 12028 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:45.435252 11991 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.439426 12008 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.439615 11932 tablet_bootstrap.cc:492] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:45.440789 12020 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.404443 11835 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:45.349481 12016 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:45.435174 10593 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:45.443555 10586 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:45.444428 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:45.446774 10743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.010s	sys 0.031s
I20260709 13:15:45.437938 10592 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:45.472882 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:45.537493 11835 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:45.542151 10743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.011s	sys 0.032s
W20260709 13:15:45.543764 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 216487us
I20260709 13:15:45.545629 10741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:45.546378 10741 raft_consensus.cc:606] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:45.453862 10632 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:45.347281 11972 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:15:45.342793 12007 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.442265 11970 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:45.399760 11980 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
W20260709 13:15:45.447304 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.009s	sys 0.023s
W20260709 13:15:45.559150 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 105346us
I20260709 13:15:45.384521 11895 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:45.471205 12044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.014s	sys 0.018s
I20260709 13:15:45.347569 11923 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.201579 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1239) took 1962 ms. Trace:
I20260709 13:15:45.634842 11835 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:45.394483 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.26485e+06us
I20260709 13:15:45.389997 11986 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.560256 10635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.008s	sys 0.039s
W20260709 13:15:46.265194 10635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.757s	user 0.009s	sys 0.039s
W20260709 13:15:46.075011 11999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.005s	sys 0.006s
I20260709 13:15:45.764488 12027 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:45.716856 11985 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.921370 12000 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:46.252897 12044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.014s	sys 0.028s
W20260709 13:15:45.537294 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88312.7us
I20260709 13:15:45.751722 11975 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:45.948894 12070 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.253364 12007 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:46.068873 12001 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.112346 11972 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:45.709688 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.018s	sys 0.039s
I20260709 13:15:45.742180 12030 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:45.728835 10667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.000s	sys 0.039s
I20260709 13:15:45.668524 11901 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.842836 11990 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:45.949005 10737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.011s	sys 0.081s
I20260709 13:15:45.878229 12021 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:46.006770 12008 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:45.958117 12031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.006s	sys 0.055s
W20260709 13:15:46.257059 10708 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.001s	sys 0.035s
I20260709 13:15:45.022785 11410 rpcz_store.cc:276] 0709 13:15:43.592342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.608132 (+ 15790us) service_pool.cc:224] Handling call
0709 13:15:43.646201 (+ 38069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.668688 (+ 22487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.668737 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.679490 (+ 10753us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.131381 (+451891us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:44.785610 (+654229us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.841897 (+ 56287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.866884 (+ 24987us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.898179 (+ 31295us) raft_consensus.cc:1685] finished
0709 13:15:44.898277 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.977843 (+ 79566us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3318,"prepare.queue_time_us":959640,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":20963,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":19822,"thread_start_us":987083,"threads_started":2,"wal-append.queue_time_us":551101}
I20260709 13:15:46.245606 10743 rpcz_store.cc:276] 0709 13:15:44.239336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.239518 (+   182us) service_pool.cc:224] Handling call
0709 13:15:44.239928 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.240249 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.240285 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.242559 (+  2274us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.542665 (+1300106us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:45.542721 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.542806 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.201301 (+658495us) raft_consensus.cc:1685] finished
0709 13:15:46.201347 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.201506 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1299681,"threads_started":1,"wal-append.queue_time_us":1786715}
W20260709 13:15:45.734800 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.006s	sys 0.033s
W20260709 13:15:45.716720 10560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.010s	sys 0.033s
W20260709 13:15:46.258414 11416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.013s	sys 0.009s
I20260709 13:15:45.473527 12010 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.267761 12053 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:45.653177 12073 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.658s
I20260709 13:15:45.675380 11991 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:46.268149 11989 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:46.244976 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.015s	sys 0.045s
W20260709 13:15:45.349496 10664 rpcz_store.cc:269] 0709 13:15:43.558892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.565166 (+  6274us) service_pool.cc:224] Handling call
0709 13:15:45.311729 (+1746563us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540026a2d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:45.311854 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489350528}
I20260709 13:15:45.620596 11995 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:46.262476 12004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.013s	sys 0.009s
W20260709 13:15:46.203385 12082 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:15:46.225244 12083 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.460s	user 0.004s	sys 0.000s
W20260709 13:15:46.199237 12084 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:15:45.550644 11987 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.254020 11970 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:46.075213 11415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.003s	sys 0.008s
W20260709 13:15:46.272611 10490 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.016s	sys 0.004s
I20260709 13:15:45.553047 12042 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:45.706993 12013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.468s	user 0.023s	sys 0.033s
W20260709 13:15:45.678388 12005 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.017s	sys 0.038s
I20260709 13:15:46.275627 10741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:33266
W20260709 13:15:45.853027 12012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.020s	sys 0.026s
I20260709 13:15:45.618839 11932 ts_tablet_manager.cc:1403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 2.921s	user 0.034s	sys 0.021s
W20260709 13:15:45.724380 11992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.033s	sys 0.109s
I20260709 13:15:45.451220 11413 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
W20260709 13:15:46.272466 11999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.005s	sys 0.010s
I20260709 13:15:45.543395 12034 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.224228 11904 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.281666 11835 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.921510 12069 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:15:46.272027 11923 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:46.295641 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.759s	user 0.028s	sys 0.044s
W20260709 13:15:46.299398 10667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.007s	sys 0.049s
W20260709 13:15:46.274782 11409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.008s	sys 0.021s
W20260709 13:15:46.375253 10737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.014s	sys 0.099s
I20260709 13:15:46.275105 11986 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.295205 11985 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:46.280596 12000 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.282387 11975 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.282404 12027 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.303925 11972 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.305277 12030 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.364256 11973 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.363691 11901 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:46.761638 10560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.913s	user 0.028s	sys 0.076s
W20260709 13:15:46.635016 10588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.019s	sys 0.014s
I20260709 13:15:46.765856 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1193) took 2723 ms. Trace:
I20260709 13:15:46.765232 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:46.768827 10490 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.020s	sys 0.014s
W20260709 13:15:46.769220 11415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.603s	user 0.013s	sys 0.016s
I20260709 13:15:46.769248 10741 raft_consensus.cc:606] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:46.771698 10708 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.653s	user 0.022s	sys 0.057s
I20260709 13:15:46.784204 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:15:46.784670 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.67784e+06us
I20260709 13:15:46.294857 12028 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.775080 10667 rpcz_store.cc:276] 0709 13:15:44.042287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.042516 (+   229us) service_pool.cc:224] Handling call
0709 13:15:44.051183 (+  8667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.051345 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:44.848953 (+797608us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.765534 (+1916581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.765583 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:46.765622 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.765682 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.765780 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":649598,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1529,"raft.queue_time_us":17066,"thread_start_us":2668762,"threads_started":2}
W20260709 13:15:46.761813 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.898s	user 0.038s	sys 0.060s
I20260709 13:15:46.777840 10593 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:46.769034 11835 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.789611 11418 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:15:46.774435 11416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.609s	user 0.032s	sys 0.031s
W20260709 13:15:46.775611 10588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.020s	sys 0.018s
I20260709 13:15:46.770851 12076 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:46.768551 12012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.197s	user 0.023s	sys 0.039s
I20260709 13:15:46.797851 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:46.302564 12016 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.459375 12078 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:46.771437 12005 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.222s	user 0.037s	sys 0.060s
W20260709 13:15:46.774026 12013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.535s	user 0.048s	sys 0.054s
I20260709 13:15:46.765347 11972 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:46.806555 11835 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:46.813582 10590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.042s	sys 0.056s
W20260709 13:15:46.776079 11409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.430s	user 0.014s	sys 0.034s
W20260709 13:15:46.770167 11992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.101s	user 0.060s	sys 0.122s
W20260709 13:15:46.761704 12031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.790s	user 0.020s	sys 0.095s
I20260709 13:15:46.817544 11418 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Advancing to term 4
W20260709 13:15:46.769871 12004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.017s	sys 0.013s
I20260709 13:15:46.778044 12053 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:46.433298 11990 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:46.820881 10590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.042s	sys 0.056s
I20260709 13:15:46.785600 11995 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:46.789853 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 230) took 1456 ms. Trace:
I20260709 13:15:46.767724 12030 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:46.424077 12008 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.296442 12007 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:46.807046 11895 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:46.768752 11991 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.778950 11985 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.808874 12079 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:46.805819 12087 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:45.320760 10740 rpcz_store.cc:276] 0709 13:15:44.195121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.201484 (+  6363us) service_pool.cc:224] Handling call
0709 13:15:44.212678 (+ 11194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.242509 (+ 29831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.242542 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.276848 (+ 34306us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.741200 (+464352us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:44.743827 (+  2627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.243924 (+500097us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b540014c154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:45.243981 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.244048 (+    67us) raft_consensus.cc:1685] finished
0709 13:15:45.244067 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.279871 (+ 35804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9787,"raft.queue_time_us":10061,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":15724,"spinlock_wait_cycles":43827456,"thread_start_us":390970,"threads_started":1,"wal-append.queue_time_us":832554,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1001659}
I20260709 13:15:46.915863 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 66) took 2309 ms. Trace:
I20260709 13:15:46.817427 11970 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.873399 12013 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.817991 12042 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.866117 11972 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:46.818634 12016 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:46.811813 11923 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:46.872308 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:46.929996 10734 rpcz_store.cc:276] 0709 13:15:44.595697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.596034 (+   337us) service_pool.cc:224] Handling call
0709 13:15:44.596373 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.596737 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.596773 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.597203 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.257104 (+659901us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:45.257155 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.257239 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.881895 (+1624656us) raft_consensus.cc:1685] finished
0709 13:15:46.905080 (+ 23185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.905266 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1189,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9894,"thread_start_us":656378,"threads_started":1,"wal-append.queue_time_us":1307557}
I20260709 13:15:46.906402 12030 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.768167 11973 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:46.884146 12053 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.970140 11985 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:46.971047 12077 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:15:46.907001 12010 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:46.935988 12096 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:15:46.978961 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:47.005380 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33266 (request call id 4) took 1037 ms. Trace:
I20260709 13:15:46.977597 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 227) took 1847 ms. Trace:
I20260709 13:15:46.303277 12070 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:46.972838 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1203) took 2380 ms. Trace:
I20260709 13:15:46.978529 11986 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:46.932011 11995 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.881834 11413 rpcz_store.cc:276] 0709 13:15:45.325605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.337615 (+ 12010us) service_pool.cc:224] Handling call
0709 13:15:46.778377 (+1440762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.964883 11975 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:46.976351 12095 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.479s	user 0.000s	sys 0.001s
I20260709 13:15:46.966229 12075 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.982165 12089 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.467s	user 0.000s	sys 0.001s
I20260709 13:15:46.939304 12042 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:47.021298 10633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.016s
W20260709 13:15:47.061820 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.000s	sys 0.016s
W20260709 13:15:47.028651 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.002s	sys 0.014s
W20260709 13:15:47.018479 12097 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:15:46.768369 11989 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.031855 11416 rpcz_store.cc:276] 0709 13:15:45.129790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.129917 (+   127us) service_pool.cc:224] Handling call
0709 13:15:45.145087 (+ 15170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.146542 (+  1455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.146582 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.147813 (+  1231us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.793031 (+1645218us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:46.793069 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.793127 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.972386 (+179259us) raft_consensus.cc:1685] finished
0709 13:15:46.972403 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.977531 (+  5128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1627135,"threads_started":1,"wal-append.queue_time_us":1800677}
I20260709 13:15:46.810933 12076 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:47.019037 10635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.002s	sys 0.014s
W20260709 13:15:47.072418 10635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.002s	sys 0.014s
I20260709 13:15:46.467969 12021 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:46.921914 12079 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.020953 11901 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:46.982999 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 75) took 1261 ms. Trace:
I20260709 13:15:46.822328 12078 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.037369 10741 rpcz_store.cc:276] 0709 13:15:45.931096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.275532 (+344436us) service_pool.cc:224] Handling call
0709 13:15:46.967680 (+692148us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b5400367ca0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f4257236520 00007f42572b3652 00007f425c28160a 00007f42558077d4 00007f4255807762 00007f4255807691 00007f425580760c 00007f42558068c2 00007f42555f448c 00007f42555f38c6
0709 13:15:46.968036 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93052800}
I20260709 13:15:47.034024 10660 rpcz_store.cc:276] 0709 13:15:44.592604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.592782 (+   178us) service_pool.cc:224] Handling call
0709 13:15:44.593146 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.593517 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.593556 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.598571 (+  5015us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.238587 (+640016us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:45.238629 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.238713 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.143723 (+905010us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:15:46.947677 (+803954us) raft_consensus.cc:1685] finished
0709 13:15:46.947708 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.972766 (+ 25058us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":483,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5780,"spinlock_wait_cycles":6518656,"thread_start_us":605132,"threads_started":1,"wal-append.queue_time_us":1157923}
I20260709 13:15:47.072131 11985 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:47.066989 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.004s	sys 0.014s
I20260709 13:15:47.023214 11923 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.068636 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 69) took 2046 ms. Trace:
I20260709 13:15:47.068655 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.099557 10743 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:47.066812 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:47.064886 11986 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:46.973431 11972 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.023412 12016 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.076548 10588 rpcz_store.cc:276] 0709 13:15:45.711545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.711669 (+   124us) service_pool.cc:224] Handling call
0709 13:15:45.712035 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.712399 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.712435 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.725119 (+ 12684us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.794724 (+1069605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:46.794773 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.794853 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.972276 (+177423us) raft_consensus.cc:1685] finished
0709 13:15:46.972294 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.972408 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":486,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12182,"thread_start_us":959046,"threads_started":1,"wal-append.queue_time_us":1224241}
I20260709 13:15:46.973140 12013 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.076937 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:46.937707 12087 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.065083 12042 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:47.086007 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 830521us
I20260709 13:15:47.064759 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:47.088115 12088 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:15:47.088701 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.090171 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 228) took 1959 ms. Trace:
I20260709 13:15:47.090286 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:47.143880 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 99929.3us
I20260709 13:15:47.083721 11987 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.097173 11973 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.073545 12004 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.021126 12030 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.100545 10734 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.113682 12044 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:47.114481 11381 connection.cc:256] RPC call timeout handler was delayed by -1.1815877089998139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:15:47.069326 12031 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:47.033615 12010 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:47.122467 10742 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:47.099381 10737 rpcz_store.cc:276] 0709 13:15:45.022226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.022377 (+   151us) service_pool.cc:224] Handling call
0709 13:15:45.079471 (+ 57094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.079711 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:46.770659 (+1690948us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.068333 (+297674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:47.068380 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:47.068432 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.068492 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.068589 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634966,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":17050,"thread_start_us":1933075,"threads_started":2}
I20260709 13:15:47.095974 12027 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:47.140013 11415 rpcz_store.cc:276] 0709 13:15:45.130908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.131183 (+   275us) service_pool.cc:224] Handling call
0709 13:15:45.131524 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.133098 (+  1574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.133146 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.159095 (+ 25949us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.781840 (+1622745us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:46.781879 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.781939 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.089979 (+308040us) raft_consensus.cc:1685] finished
0709 13:15:47.090003 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.090117 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":717,"raft.queue_time_us":912,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":2881,"thread_start_us":1615554,"threads_started":1,"wal-append.queue_time_us":1116273}
I20260709 13:15:47.148851 11986 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.170254 11991 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.140780 12001 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.171128 12001 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.171564 11986 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.136996 12090 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:47.117069 11985 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.090121 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:47.148145 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:47.149466 10706 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 1.619s (SENT) [suppressed 1 similar messages]
I20260709 13:15:47.122244 11901 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.153373 10739 raft_consensus.cc:2368] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:47.153729 11992 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.153792 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.154412 12034 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.154493 12109 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:47.155026 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:47.154891 12004 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:47.155395 12099 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:47.156829 11417 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:47.159222  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:47.143705 12073 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:47.153311 12115 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.171728 12076 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.074558 12075 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.329173 12104 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.333547 12104 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.333909 11992 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.335796 11992 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.335752 12104 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.336436 11992 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.335518 11970 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:47.264317 10635 connection.cc:256] RPC call timeout handler was delayed by -1.4009210049998728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 13:15:47.309921 11904 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.290299 11987 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.338096 11904 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.337670 12053 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.309042 12103 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.339486  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:47.339708 12103 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.338423 11987 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:47.340447 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 192366us
I20260709 13:15:47.340670 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 232) took 2001 ms. Trace:
I20260709 13:15:47.263509 12012 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.341105 11409 rpcz_store.cc:276] 0709 13:15:45.339574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.343972 (+  4398us) service_pool.cc:224] Handling call
0709 13:15:45.344403 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.344868 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.344895 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.345608 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:15:46.893335 (+1547727us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:46.914393 (+ 21058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.928003 (+ 13610us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.340465 (+412462us) raft_consensus.cc:1685] finished
0709 13:15:47.340482 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.340613 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1477684,"threads_started":1,"wal-append.queue_time_us":1682934}
I20260709 13:15:47.342818 11987 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.343223 12004 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.343807 11904 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.344390 11990 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.157845 11988 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:47.337353 11970 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.345235 11988 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.346050 12103 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.345690 11932 raft_consensus.cc:359] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:47.341904 12104 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:47.346560 11932 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:47.347083 12104 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:47.347187 12073 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:47.341697 12012 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:47.177752 10634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.004s	sys 0.008s
I20260709 13:15:47.348073 12104 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:47.349192 10634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.004s	sys 0.026s
I20260709 13:15:47.158814 12102 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.350929 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:47.169385 11975 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:47.342998 12107 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:47.351742 10660 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:47.351765 12053 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.337802 10635 connection.cc:256] RPC call timeout handler was delayed by -1.231721005000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:15:47.352557 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:47.352723 10635 connection.cc:256] RPC call timeout handler was delayed by -1.2245210050000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 13:15:47.352854 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:47.353258 10635 connection.cc:256] RPC call timeout handler was delayed by -1.0958210050000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:15:47.352805 12107 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.353513 10667 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:47.351859 12103 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.353673 10664 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:47.351485 11987 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:47.354285 12103 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.355159 12107 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.354763 11987 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.355508 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:47.355791 11975 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.356253 12103 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.356329 10664 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:47.291184 12007 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.291563 12008 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.357836 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.352589 12053 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.173302 11989 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.359305 11985 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:47.351507 12102 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.359999 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:47.342919 10708 connection.cc:256] RPC call timeout handler was delayed by -1.4135016620000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:15:47.358505 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.360622 10737 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:47.360675 12053 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.161689 11973 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:47.330374 10734 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:47.361956 11973 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.362349 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.350445 12012 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:47.363224 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:47.363600 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.364073 12012 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.365061 11970 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
W20260709 13:15:47.365517 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 216089us
I20260709 13:15:47.365967 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.364096 10632 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:47.367067 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.367600 11995 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:47.360654 10708 connection.cc:256] RPC call timeout handler was delayed by -1.0544016619999184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 13:15:47.368083 11995 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.368438 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.368759 11995 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.367878 10737 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:47.353623 10635 connection.cc:256] RPC call timeout handler was delayed by -1.0553210049999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:15:47.172737 12031 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.371922 10708 leader_election.cc:400] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:15:47.372279 12090 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.373413 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.375140 11990 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:47.376027 12007 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.376639 12007 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.377940 10743 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:47.378427 12109 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.378837 12109 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.379338 12007 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:47.322642 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.006s	sys 0.010s
W20260709 13:15:47.380159 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 202502us
I20260709 13:15:47.343638 11901 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.380431 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.403093 10660 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:47.350556 12073 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.376791 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:47.382072 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.347334 11932 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:47.367801 10632 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:47.388463 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.393015 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:47.336915 11992 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.364377 11418 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:47.405160 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.364758 12012 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.415970 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:47.441767 10592 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.416450 12027 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:15:47.446270 12108 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:47.416875 12090 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:47.358111 11975 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.417172 12073 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.418092 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.418738 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.419116 10734 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:47.420112 12021 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.420804 12070 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.161872 12044 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.422091 12013 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.422377 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.427911 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.531941 10585 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 1.
I20260709 13:15:47.382966 12115 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.347304 11988 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.460994 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.364156 11973 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.448055 12012 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.362345 12102 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:47.485221 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70730.1us
W20260709 13:15:47.484328 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 116579us
I20260709 13:15:47.469018 10669 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:47.597424 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:47.599584 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:47.401861 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.009s	sys 0.010s
I20260709 13:15:47.533960 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.534982 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:47.533201 12119 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:15:47.447314 12030 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:47.554718 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.498605 11986 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.661597 11986 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.662111 11986 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:47.602756 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 67860.9us
I20260709 13:15:47.535110 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.623564 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.621634 11988 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:47.669536 11988 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.669922 11988 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.624759 12075 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:47.661656 10585 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:47.624328 12007 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:47.673395 12007 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:47.674511 12007 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.700525 10591 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:47.701861 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.703058 11988 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:47.684789 11986 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:47.731829 11986 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.551882 12090 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:47.579028 12112 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:47.780850 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.792982 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.879467 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.889984 10742 raft_consensus.cc:2410] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:47.878721 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.815037 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.886686 10592 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
W20260709 13:15:47.856666 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 190358us
I20260709 13:15:47.923578 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.905159 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:47.922492 12001 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.967942 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:47.968715 10587 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:48.007587 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:47.854925 11991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.008s
I20260709 13:15:47.818466 11932 ts_tablet_manager.cc:1434] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 1.048s	user 0.008s	sys 0.037s
I20260709 13:15:47.898404 12078 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:47.778137 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 395607us
I20260709 13:15:47.864005 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:47.815665 11972 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.957544 12079 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:47.789187 12090 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:48.698298 12042 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.541s	user 0.011s	sys 0.008s
I20260709 13:15:48.613770 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:48.713086 12115 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.733948 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:48.648599 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:48.631971 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:48.345557 12070 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.009s
W20260709 13:15:48.708475 12109 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.329s	user 0.005s	sys 0.015s
W20260709 13:15:47.789300 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77566.3us
I20260709 13:15:48.767547 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.767939 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.768690 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.347960 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.768605 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 909) took 1184 ms. Trace:
I20260709 13:15:48.770117 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:48.793342 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:48.798415 11415 raft_consensus.cc:2410] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:48.762274 11414 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.008s	sys 0.001s
W20260709 13:15:48.800946 11414 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.009s	sys 0.002s
I20260709 13:15:48.806793  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:48.814265 12085 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.814858 12085 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:48.817170 12085 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:48.823580 12010 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.825616 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.827895 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1471) took 1224 ms. Trace:
I20260709 13:15:48.828315 10590 rpcz_store.cc:276] 0709 13:15:47.603715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.826946 (+1223231us) service_pool.cc:224] Handling call
0709 13:15:48.827308 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.827508 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.827544 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.827608 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.827651 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.827721 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.827835 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.831245 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 963) took 1200 ms. Trace:
I20260709 13:15:48.831732 10591 rpcz_store.cc:276] 0709 13:15:47.631222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.830338 (+1199116us) service_pool.cc:224] Handling call
0709 13:15:48.830688 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.830877 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.830912 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.830964 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.831006 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.831072 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.831184 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.817008 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.840348 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:48.841277 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1218) took 1219 ms (client timeout 1514 ms). Trace:
W20260709 13:15:48.842583 11417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 235) took 1864 ms (client timeout 1840 ms). Trace:
W20260709 13:15:48.842533 10660 rpcz_store.cc:269] 0709 13:15:47.621458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.840056 (+1218598us) service_pool.cc:224] Handling call
0709 13:15:48.841209 (+  1153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:48.843214 11417 rpcz_store.cc:269] 0709 13:15:46.978463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.978630 (+   167us) service_pool.cc:224] Handling call
0709 13:15:48.842397 (+1863767us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400571f54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:48.842524 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287887616}
I20260709 13:15:48.844014 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.844861 10660 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:48.851735 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.852676 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1552) took 1317 ms. Trace:
I20260709 13:15:48.855887 11987 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.857213 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.857981 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:48.858551 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 968) took 1005 ms. Trace:
I20260709 13:15:48.858925 10586 rpcz_store.cc:276] 0709 13:15:47.852743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.856926 (+1004183us) service_pool.cc:224] Handling call
0709 13:15:48.858492 (+  1566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.860704 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.861605 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 966) took 1105 ms. Trace:
I20260709 13:15:48.862005 10587 rpcz_store.cc:276] 0709 13:15:47.755990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.860405 (+1104415us) service_pool.cc:224] Handling call
0709 13:15:48.861539 (+  1134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.864647 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1548) took 1488 ms. Trace:
I20260709 13:15:48.865947 12016 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.868463 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1555) took 1331 ms. Trace:
I20260709 13:15:48.868942 10669 rpcz_store.cc:276] 0709 13:15:47.536566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.653242 (+116676us) service_pool.cc:224] Handling call
0709 13:15:48.867656 (+1214414us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:48.867867 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.868070 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.868108 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.868160 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:48.868202 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.868271 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.868397 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8637184}
I20260709 13:15:48.870790 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.872185 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.874779 11988 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:48.875517 11988 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.876091 12031 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:48.865101 10662 rpcz_store.cc:276] 0709 13:15:47.375943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.557405 (+181462us) service_pool.cc:224] Handling call
0709 13:15:48.863655 (+1306250us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:48.863909 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.864112 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.864145 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.864199 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.864242 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.864348 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.864561 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46539136}
I20260709 13:15:48.878011 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 279) took 2088 ms. Trace:
I20260709 13:15:48.878470 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.879999 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:48.881589 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.878520 11412 rpcz_store.cc:276] 0709 13:15:46.789674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.797968 (+  8294us) service_pool.cc:224] Handling call
0709 13:15:47.171924 (+373956us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:48.845870 (+1673946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.846111 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.846151 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.846207 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:48.846258 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.846333 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.877798 (+ 31465us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400571f50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:48.877942 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857604096}
I20260709 13:15:48.882475 10594 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:48.883520 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 967) took 1102 ms. Trace:
I20260709 13:15:48.883917 10594 rpcz_store.cc:276] 0709 13:15:47.780833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.881299 (+1100466us) service_pool.cc:224] Handling call
0709 13:15:48.883445 (+  2146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.853057 10666 rpcz_store.cc:276] 0709 13:15:47.535597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.535726 (+   129us) service_pool.cc:224] Handling call
0709 13:15:48.851532 (+1315806us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:48.852595 (+  1063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61098240}
I20260709 13:15:48.885175 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.890525 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.891717 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.892979 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.893771 10666 raft_consensus.cc:2368] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:15:48.894614 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.895256 10666 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:48.896188 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.901185 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1558) took 1192 ms. Trace:
I20260709 13:15:48.901705 10660 rpcz_store.cc:276] 0709 13:15:47.708725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.843745 (+1135020us) service_pool.cc:224] Handling call
0709 13:15:48.901114 (+ 57369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.905009 12031 raft_consensus.cc:993] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: : Instructing follower e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:48.880987 10662 raft_consensus.cc:2376] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:15:48.907910 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 80) took 1568 ms. Trace:
I20260709 13:15:48.913357 10737 rpcz_store.cc:276] 0709 13:15:47.584133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.631651 (+1047518us) service_pool.cc:224] Handling call
0709 13:15:48.768456 (+136805us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:48.681576 12012 consensus_meta.cc:287] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.056s	user 0.004s	sys 0.004s
W20260709 13:15:48.247571 11991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.003s	sys 0.008s
W20260709 13:15:48.762071 11895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.011s	sys 0.064s
I20260709 13:15:48.683637 12044 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.936892 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1472) took 1228 ms. Trace:
W20260709 13:15:48.774087 12070 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.010s	sys 0.018s
I20260709 13:15:48.095007 10740 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:48.710920 11995 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.009s
I20260709 13:15:48.906185 11972 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:15:47.974216 12112 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:48.650610 12000 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.369912 12087 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:48.753509 11901 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:48.950394 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.951174 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.951418 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.952314 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.954444 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.954655 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:48.955204 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.955981 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.962168 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:48.706184 12111 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.023s	sys 0.023s
I20260709 13:15:48.964130 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 910) took 1176 ms. Trace:
I20260709 13:15:48.940418 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1557) took 1295 ms. Trace:
I20260709 13:15:48.766985 12042 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:48.966174 12031 raft_consensus.cc:1081] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Signalling peer e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:48.305470 12114 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.098716 10662 rpcz_store.cc:276] 0709 13:15:47.645159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.923807 (+1278648us) service_pool.cc:224] Handling call
0709 13:15:48.939466 (+ 15659us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:48.939706 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.940033 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.940057 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.940096 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.940138 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.940211 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.940341 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":689,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":34124032}
I20260709 13:15:49.101330 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:48.953672 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:48.250083 12027 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:48.924259 10589 rpcz_store.cc:276] 0709 13:15:47.339142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.339254 (+   112us) service_pool.cc:224] Handling call
0709 13:15:48.907076 (+1567822us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:48.907293 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.907527 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.907564 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.907617 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:48.907660 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.907728 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.907846 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21497216}
I20260709 13:15:48.993729 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:48.642544 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:49.044175 10591 rpcz_store.cc:276] 0709 13:15:47.708348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.832908 (+1124560us) service_pool.cc:224] Handling call
0709 13:15:48.833226 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.936471 (+103245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.936513 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.936568 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.936611 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.936687 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.936824 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90640,"raft.queue_time_us":97432,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83}
I20260709 13:15:49.106629 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:48.247061 11932 ts_tablet_manager.cc:1467] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Tablet startup took 1423ms
W20260709 13:15:48.974661 11895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.013s	sys 0.066s
I20260709 13:15:48.773885 12146 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:48.643432 12122 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.792968 12109 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:49.105772 12111 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.928s	user 0.025s	sys 0.025s
I20260709 13:15:49.057624 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:49.107321 10591 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:49.099138 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:49.064414 11990 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.114158 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1553) took 1578 ms. Trace:
I20260709 13:15:49.111244 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.156581 10594 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:49.115648 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:48.975574 12012 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:49.109472 10662 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:49.100250 11992 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:49.143730 10664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.075s	sys 0.164s
W20260709 13:15:49.215577 10664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.075s	sys 0.168s
I20260709 13:15:49.216667 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1210) took 1842 ms. Trace:
I20260709 13:15:49.102813 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 74) took 1390 ms. Trace:
W20260709 13:15:49.124143 10633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.021s	sys 0.025s
W20260709 13:15:49.222643 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.023s	sys 0.026s
I20260709 13:15:49.217087 10664 rpcz_store.cc:276] 0709 13:15:47.374437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.377341 (+  2904us) service_pool.cc:224] Handling call
0709 13:15:47.377676 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.377964 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.377991 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.378410 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.585162 (+206752us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:49.216043 (+1630881us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.216289 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.216382 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.216432 (+    50us) raft_consensus.cc:1685] finished
0709 13:15:49.216449 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.216608 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1241,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":38016,"thread_start_us":1633339,"threads_started":2,"wal-append.queue_time_us":1218768}
W20260709 13:15:49.159368 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 43805.7us
I20260709 13:15:49.224784 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.155174 10663 rpcz_store.cc:276] 0709 13:15:47.536039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.558719 (+ 22680us) service_pool.cc:224] Handling call
0709 13:15:49.113595 (+1554876us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:49.113751 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.113890 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.113911 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.113949 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.113974 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.114024 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.114111 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33171840}
I20260709 13:15:49.057139 11995 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:49.121466 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.040s
W20260709 13:15:49.227954 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.041s
I20260709 13:15:49.219863 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.220579 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.233804 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.238294 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.244138 10661 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:49.225769 12139 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:15:49.116992 11409 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:49.257967 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.221534 12044 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.260272 10668 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:49.098492 10739 rpcz_store.cc:276] 0709 13:15:47.787611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.799542 (+ 11931us) service_pool.cc:224] Handling call
0709 13:15:48.964038 (+1164496us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:49.221874 12004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.040s
I20260709 13:15:49.261375 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.263559 10743 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:49.242177 11410 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:49.264580 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.265278 10743 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:49.260823 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.274052 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:49.275027 10560 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.011s
W20260709 13:15:49.275398 10560 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.011s
W20260709 13:15:49.275692 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 515545us
I20260709 13:15:49.274659 10587 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:49.285612 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.241421 12031 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.110227 12027 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:49.116487 12114 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:49.245973 12121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.520s	user 0.011s	sys 0.074s
W20260709 13:15:49.255370 11980 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.029s	sys 0.069s
I20260709 13:15:49.300062 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1261) took 1485 ms. Trace:
I20260709 13:15:49.312433 12112 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:49.223892 11990 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:49.146437 12122 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:49.274152 12004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.014s	sys 0.041s
I20260709 13:15:49.314146 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.294127 11411 raft_consensus.cc:2410] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:49.294224 12124 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:15:49.314311 12121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.011s	sys 0.075s
W20260709 13:15:49.320842 10706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.017s
W20260709 13:15:49.329172 10706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.001s	sys 0.017s
W20260709 13:15:49.329680 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 560578us
I20260709 13:15:49.322412 12152 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:49.254827 12008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.501s	user 0.015s	sys 0.046s
I20260709 13:15:49.325423 11418 raft_consensus.cc:2410] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:49.313887 10742 rpcz_store.cc:276] 0709 13:15:47.814998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.737603 (+922605us) service_pool.cc:224] Handling call
0709 13:15:48.739352 (+  1749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.739576 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:49.121770 (+382194us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.297216 (+175446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.297280 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:49.299260 (+  1980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.299858 (+   598us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.300003 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":554795,"threads_started":2}
I20260709 13:15:49.222498 10740 rpcz_store.cc:276] 0709 13:15:47.712856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.753785 (+ 40929us) service_pool.cc:224] Handling call
0709 13:15:47.858399 (+104614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.055671 (+1197272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.100081 (+ 44410us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:49.313576 11980 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.029s	sys 0.069s
W20260709 13:15:49.338143 10559 connection.cc:256] RPC call timeout handler was delayed by -1.1647834259999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:15:49.339800 10559 connection.cc:256] RPC call timeout handler was delayed by -1.1458834259999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:15:49.297482 11923 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:49.340276 10559 connection.cc:256] RPC call timeout handler was delayed by -1.1089834259998952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:15:49.343552 10559 connection.cc:256] RPC call timeout handler was delayed by -1.0513834259998021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
I20260709 13:15:49.344264 11895 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:49.344686 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.344861 11895 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:49.345701 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.346235 10587 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:49.347051 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.347543 10587 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:49.347615 11895 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:49.348716 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.353377 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.354339 10742 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:49.359404 10557 connection.cc:256] RPC call timeout handler was delayed by -1.0920617089998359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:15:49.341914 12008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.589s	user 0.016s	sys 0.047s
W20260709 13:15:49.361774 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.019s	sys 0.007s
W20260709 13:15:49.369428 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.019s	sys 0.007s
I20260709 13:15:49.356781 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 175) took 1436 ms. Trace:
W20260709 13:15:49.368059 10635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.001s	sys 0.027s
I20260709 13:15:49.313598 12031 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:49.368656 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.373581 10735 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:49.370236 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.374622 10742 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:49.348307 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.319682 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.339466 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:49.375509 10635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.001s	sys 0.027s
I20260709 13:15:49.377771 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.378041 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.382663 10660 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:49.382954 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:49.383456 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 614999us
I20260709 13:15:49.384187 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:49.343981 12090 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:49.369964 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 593977us
I20260709 13:15:49.387038 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.393836 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:49.341969 12087 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:15:49.396697 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.397728 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:49.398990 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:49.401341 10587 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:49.403182 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.403926 10669 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:49.353973 12152 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:49.379292 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.422632 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.393047 10739 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
W20260709 13:15:49.401822 12133 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:15:49.399188 12140 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:49.415113 12157 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:15:49.405309 12004 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:49.433887 12158 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:15:49.406519 12146 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.448988 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.430212 12109 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:49.425774 12042 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:49.459720 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.459854 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.460482 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.461023 10664 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:49.425335 12044 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.466775 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.406839 12121 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:49.400525 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 107696us
I20260709 13:15:49.461241 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:49.472325 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 98697.4us
I20260709 13:15:49.470162 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.472898 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.475301 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.465725 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:49.478179 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.521394 10664 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:49.472386 10662 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:49.447836 12004 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.437637 10740 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:15:49.497875 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118100us
I20260709 13:15:49.454715 12140 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.537989 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.519881 10660 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:49.523940 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:49.528628 10708 leader_election.cc:336] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.702s (SENT)
I20260709 13:15:49.480319 12146 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.541757 10663 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:49.545361 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.548375 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.548565 10662 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:15:49.545871 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 145210us
W20260709 13:15:49.550300 10708 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.865s (SENT)
I20260709 13:15:49.552047 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.550876 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:49.557000 10560 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.537686 12004 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.558087 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:49.551776 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 157991us
W20260709 13:15:49.554070 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 223680us
I20260709 13:15:49.555451 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.564944 10660 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:49.565327 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:49.110414 11932 ts_tablet_manager.cc:1469] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Trace:
0709 13:15:42.046346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.046460 (+   114us) service_pool.cc:224] Handling call
0709 13:15:42.061226 (+ 14766us) ts_tablet_manager.cc:934] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
0709 13:15:42.139900 (+ 78674us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:42.198014 (+ 58114us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:42.198135 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:42.316137 (+118002us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:42.316391 (+   254us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:42.316685 (+   294us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:42.316739 (+    54us) inbound_call.cc:177] Queueing success response
0709 13:15:42.684862 (+368123us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:46.778794 (+4093932us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:47.031496 (+252702us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:47.148072 (+116576us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":7821,"mutex_wait_us":29917,"raft.queue_time_us":31197,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"tablet-copy.queue_time_us":101,"tablet-download-pool.queue_time_us":128,"tablet-download-pool.run_cpu_time_us":1298,"tablet-download-pool.run_wall_time_us":124707,"thread_start_us":36496,"threads_started":1}
I20260709 13:15:49.372862 11414 rpcz_store.cc:276] 0709 13:15:47.920482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.920657 (+   175us) service_pool.cc:224] Handling call
0709 13:15:47.921043 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.921342 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:48.802941 (+881599us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.318916 (+515975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.326694 (+  7778us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:49.338802 (+ 12108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.351775 (+ 12973us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.356720 (+  4945us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":774334,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":7184,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5405,"thread_start_us":1375808,"threads_started":2,"wal-append.queue_time_us":602432}
I20260709 13:15:49.565896 10667 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.560797 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.571511 10735 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:49.566226 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.539727 12027 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:49.564180 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.567744 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:49.573882 10635 connection.cc:256] RPC call timeout handler was delayed by -1.0680070009998417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:15:49.473548 12044 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:49.574572 10635 connection.cc:256] RPC call timeout handler was delayed by -1.0356070009997893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:15:49.540609 12012 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:49.561767 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.570433 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:49.570586 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.563575 11995 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:49.478950 12121 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:49.574694 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.569276 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.558377 11992 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:49.576498 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.577248 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.541082 12114 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:49.583881 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.565543 12079 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.568463 12112 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:49.568622 12010 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.569893 12122 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:49.590034 10667 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:49.595587 12031 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:49.642549 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:49.599328 11895 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:15:49.589902 12111 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:49.642550 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1551) took 2107 ms (client timeout 1935 ms). Trace:
I20260709 13:15:49.575793 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:49.605860 12010 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:49.602937 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.603621 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.541113 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:49.578734 11411 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:49.644066 12111 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:49.645190 12010 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.588992 11992 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.648464 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:49.674909 10587 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:49.649082 12145 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:15:49.648993 10667 rpcz_store.cc:269] 0709 13:15:47.535320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.536779 (+  1459us) service_pool.cc:224] Handling call
0709 13:15:49.565185 (+2028406us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:49.642435 (+ 77250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61832960}
I20260709 13:15:49.681102 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:49.682217 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.683557 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.684414 10667 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:49.594848 12079 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:49.595038 12016 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:49.606374 11995 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:49.704097 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 111874us
I20260709 13:15:49.593114 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:49.646632 12143 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:15:49.595206 12169 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:49.605201 12112 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:49.649585 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:15:49.687198 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 136917us
W20260709 13:15:49.714540 12156 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:15:49.692183 11418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 174) took 1812 ms (client timeout 1974 ms). Trace:
I20260709 13:15:49.705366 11995 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.698414 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1556) took 2108 ms. Trace:
I20260709 13:15:49.745752 10665 rpcz_store.cc:276] 0709 13:15:47.590494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.667002 (+ 76508us) service_pool.cc:224] Handling call
0709 13:15:49.697267 (+2030265us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:49.697700 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.697982 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.698021 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.698081 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.698128 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.698186 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.698324 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907566976}
I20260709 13:15:49.705785 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:49.747715 10589 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.656275 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:49.645869 12165 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:49.677225 12160 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:15:49.709570 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.672250 12111 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:49.714133 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 137710us
I20260709 13:15:49.680774 11992 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.678512 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:49.719800 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.679778 12114 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:49.722829 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.704035 12016 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.704283 12079 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:49.679179 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 148845us
I20260709 13:15:49.688087 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:49.705588 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:49.694006 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1543) took 2321 ms. Trace:
W20260709 13:15:49.737936 11418 rpcz_store.cc:269] 0709 13:15:47.879701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.896543 (+ 16842us) service_pool.cc:224] Handling call
0709 13:15:49.691939 (+1795396us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540043f8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:49.692111 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283244416}
I20260709 13:15:49.687450 12164 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:49.748729 11417 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:49.718134 12109 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.737166 12112 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.737342 11991 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:15:49.737023 12169 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:49.762709 10667 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:49.814018 10587 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:49.747771 11995 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:49.819391 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 112022us
I20260709 13:15:49.942301 10661 rpcz_store.cc:276] 0709 13:15:47.373042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.373134 (+    92us) service_pool.cc:224] Handling call
0709 13:15:47.373390 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.254576 (+1881186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.693719 (+439143us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:49.693939 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4301912320}
I20260709 13:15:49.897877 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:49.946278 10593 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.948731 10660 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:49.949832 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.951773 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.954087 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 84) took 1007 ms. Trace:
I20260709 13:15:49.954466 10592 rpcz_store.cc:276] 0709 13:15:48.947025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.952880 (+  5855us) service_pool.cc:224] Handling call
0709 13:15:48.953250 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.028748 (+ 75498us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:49.057990 (+ 29242us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.273007 (+215017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.273052 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:49.273089 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.938539 (+665450us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b180002b8a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419
0709 13:15:49.953887 (+ 15348us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b540016ab54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:49.953932 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.954038 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35286,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":57,"raft.queue_time_us":82,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":20155,"spinlock_wait_cycles":179652736,"thread_start_us":214623,"threads_started":1,"wal-append.queue_time_us":258611}
W20260709 13:15:49.960448 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 253798us
I20260709 13:15:49.960759 10664 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:49.961594 10660 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:49.940196 12159 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:15:49.751739 12152 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:49.963228 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 218295us
I20260709 13:15:49.969261 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.030534 10661 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:49.941246 12109 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.781088 12179 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:49.957760 12161 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
W20260709 13:15:49.957365 12162 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:15:49.948288 12016 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:50.020447 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:49.941435 12164 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:49.947999 12114 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:50.024088 11413 raft_consensus.cc:2410] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:50.023238 12166 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:15:50.016075 12044 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:50.022966 11414 raft_consensus.cc:2410] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:50.059952 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:50.040758 12109 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.084512 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:50.077546 12171 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:15:50.071477 12114 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.095712 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:50.057072 12179 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.069355 12164 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:50.101711 12175 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:15:50.102659 12178 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:15:50.104995 10632 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:50.066860 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:50.126405 10706 connection.cc:256] RPC call timeout handler was delayed by -2.5645486729999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 13:15:50.127185 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.129120 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:50.103282 12172 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.344s	user 0.001s	sys 0.001s
I20260709 13:15:50.127808 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:50.127924 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:50.131543 11418 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:50.132488 10706 connection.cc:256] RPC call timeout handler was delayed by -2.200048673000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2484s for a response
I20260709 13:15:50.121588 12140 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:50.134955 10706 connection.cc:256] RPC call timeout handler was delayed by -1.3579176350001489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:15:50.135298 10706 connection.cc:256] RPC call timeout handler was delayed by -1.2252606870001728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:15:50.135612 10706 connection.cc:256] RPC call timeout handler was delayed by -1.2177011450000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:15:50.106312 12179 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:50.135995 10706 connection.cc:256] RPC call timeout handler was delayed by -1.1268011450001723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:15:50.138478 10632 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:50.140568 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:50.141208 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 105584us
W20260709 13:15:50.139416 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 73128.5us
W20260709 13:15:50.143026 10706 connection.cc:256] RPC call timeout handler was delayed by -1.047060687000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:15:50.142972 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.124221 12180 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.135366 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:50.130260 12181 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.094012 12190 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:50.160452 10593 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:50.154424 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.138019 12174 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:50.155581 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1571) took 1460 ms. Trace:
I20260709 13:15:50.164713 10666 rpcz_store.cc:276] 0709 13:15:48.689216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.114022 (+424806us) service_pool.cc:224] Handling call
0709 13:15:49.117958 (+  3936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.118226 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.118261 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.118737 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.445848 (+327111us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.445906 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.445999 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.148932 (+702933us) raft_consensus.cc:1685] finished
0709 13:15:50.148952 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.149392 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":190906,"threads_started":1,"wal-append.queue_time_us":322322}
I20260709 13:15:50.166664 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.167933 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:50.130260 11413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8"
dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:44884
I20260709 13:15:50.148228 12012 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.195709 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.196460 10661 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:50.155557 12180 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.162588 12190 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.198997 11413 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:50.162643 12181 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.194855 12012 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.214546 12181 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.215489 10678 tablet_copy_service.cc:342] P 18f1a9f5e66846dba474825fb5b2b784: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-3ae2b9cd744b4a2bba38c92a5f4b94f3 received from {username='slave'} at 127.0.0.1:42652
I20260709 13:15:50.215919 10678 tablet_copy_service.cc:434] P 18f1a9f5e66846dba474825fb5b2b784: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-3ae2b9cd744b4a2bba38c92a5f4b94f3 on tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:50.216557 12184 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:50.205101 12180 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.216987 12184 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:50.217487 12184 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.169219 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.214929 11413 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:50.236763 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 68878us
I20260709 13:15:50.206951 12190 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.241281 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:50.241864 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70818.7us
I20260709 13:15:50.217864 12012 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.212320 12169 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.252426 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.253633 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.253237 10661 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:50.256698 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.256212 11418 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:50.262255 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.264417 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.267252 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.267989 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:15:50.170085 12174 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.282689 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.288947 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.286356 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.289616 10661 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:50.290205 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:50.260458 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 183018us
I20260709 13:15:50.291774 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.292523 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.292722 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.293524 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:50.293807 12195 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:15:50.294561 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:50.294998 12189 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:15:50.295737 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.296351 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:50.300840 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 134561us
W20260709 13:15:50.283110 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 117123us
I20260709 13:15:50.304184 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.306631 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.309697 10632 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:50.325014 12194 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:15:50.325160 12192 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:15:50.328753 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 89888.9us
I20260709 13:15:50.269224 12199 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:15:50.303839 12141 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.165s
W20260709 13:15:50.343482 12196 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:15:50.358661 12174 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:50.404083 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:50.410941 10490 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 202) took 6164 ms. Trace:
I20260709 13:15:50.411535 10490 rpcz_store.cc:276] 0709 13:15:44.246764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.249407 (+  2643us) service_pool.cc:224] Handling call
0709 13:15:50.410697 (+6161290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:46.970290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.122267 (+151977us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.137071 (+ 14804us) write_op.cc:435] Acquired schema lock
0709 13:15:47.140210 (+  3139us) tablet.cc:662] Decoding operations
0709 13:15:47.380723 (+240513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.383752 (+  3029us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.387006 (+  3254us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:47.412129 (+ 25123us) tablet.cc:701] Row locks acquired
0709 13:15:47.412158 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:15:47.468482 (+ 56324us) write_op.cc:270] Start()
0709 13:15:47.498070 (+ 29588us) write_op.cc:276] Timestamp: P: 1783602947466717 usec, L: 0
0709 13:15:47.500388 (+  2318us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.184269 (+683881us) log.cc:844] Serialized 535 byte log entry
0709 13:15:49.311128 (+1126859us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.540968 (+229840us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f42541af0ac 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f425acefef0
0709 13:15:49.758451 (+217483us) write_op.cc:301] APPLY: starting
0709 13:15:49.780602 (+ 22151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.843760 (+ 63158us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.846669 (+  2909us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.930420 (+ 83751us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.936693 (+  6273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:49.936753 (+    60us) write_op.cc:312] APPLY: finished
0709 13:15:49.936999 (+   246us) log.cc:844] Serialized 23 byte log entry
0709 13:15:49.937187 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.937269 (+    82us) write_op.cc:454] Released schema lock
0709 13:15:49.937310 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.362325 (+425015us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b540041b828. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d6759e1 00007f425d67464c 00007f425ad053fd 00007f425acf1389 00007f425acf0b53 00007f425acf4d61 00007f425acf4d19 00007f425acf4ca9 00007f425acf4c71 00007f425acf3e9d 000000000038f354
0709 13:15:50.362786 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.362815 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":425015,"apply.run_cpu_time_us":10699,"apply.run_wall_time_us":610139,"num_ops":1,"prepare.queue_time_us":1670976,"prepare.run_cpu_time_us":10975,"prepare.run_wall_time_us":1720935,"raft.queue_time_us":871055,"raft.run_cpu_time_us":95465,"raft.run_wall_time_us":545924,"replication_time_us":1775906,"spinlock_wait_cycles":27658368,"thread_start_us":2342166,"threads_started":4,"wal-append.queue_time_us":537556}]]}
I20260709 13:15:50.418212 10492 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 112) took 6267 ms. Trace:
I20260709 13:15:50.424764 10492 rpcz_store.cc:276] 0709 13:15:44.150308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.150476 (+   168us) service_pool.cc:224] Handling call
0709 13:15:45.183909 (+1033433us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:15:50.417991 (+5234082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.691455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.750519 (+ 59064us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.750570 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:15:48.750591 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:48.750983 (+   392us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.751044 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.751082 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:48.751289 (+   207us) tablet.cc:701] Row locks acquired
0709 13:15:48.751313 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:15:48.751455 (+   142us) write_op.cc:270] Start()
0709 13:15:48.751551 (+    96us) write_op.cc:276] Timestamp: P: 1783602948751414 usec, L: 0
0709 13:15:48.751571 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.752235 (+   664us) log.cc:844] Serialized 530 byte log entry
0709 13:15:49.680269 (+928034us) op_driver.cc:464] REPLICATION: finished
0709 13:15:50.198332 (+518063us) write_op.cc:301] APPLY: starting
0709 13:15:50.201119 (+  2787us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:50.208491 (+  7372us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:50.213717 (+  5226us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:50.288613 (+ 74896us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:50.295618 (+  7005us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:50.295663 (+    45us) write_op.cc:312] APPLY: finished
0709 13:15:50.327327 (+ 31664us) log.cc:844] Serialized 23 byte log entry
0709 13:15:50.339894 (+ 12567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.342284 (+  2390us) write_op.cc:454] Released schema lock
0709 13:15:50.343997 (+  1713us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.353097 (+  9100us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.353882 (+   785us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126583,"reported_tablets":1,"spinlock_wait_cycles":241528704,"child_traces":[["op",{"apply.queue_time_us":459552,"apply.run_cpu_time_us":2638,"apply.run_wall_time_us":178154,"num_ops":1,"prepare.queue_time_us":3381791,"prepare.run_cpu_time_us":4097,"prepare.run_wall_time_us":61051,"replication_time_us":918884,"thread_start_us":104442,"threads_started":1}]]}
I20260709 13:15:50.418038 10491 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:15:50.441280 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 280705us
I20260709 13:15:50.442878 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:50.446436 10667 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:15:50.452159 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 142369us
I20260709 13:15:50.452611 11992 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.454228 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:50.460245 10587 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:50.455880 12205 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:50.494185 12146 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:50.494858 12146 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:50.497684 11992 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.497328 12146 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.512532 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.465112 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.507542 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:50.517464 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 226019us
I20260709 13:15:50.523535 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:50.528115 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.528559 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1546) took 3153 ms. Trace:
I20260709 13:15:50.528996 10668 rpcz_store.cc:276] 0709 13:15:47.375035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.375137 (+   102us) service_pool.cc:224] Handling call
0709 13:15:47.375344 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.260740 (+1885396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.528021 (+1267281us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400183154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:50.528329 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4334562688}
I20260709 13:15:50.529898 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.530507 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.531308 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.532084 10591 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:50.532838 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 985) took 1574 ms. Trace:
I20260709 13:15:50.533200 10591 rpcz_store.cc:276] 0709 13:15:48.958649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.464318 (+1505669us) service_pool.cc:224] Handling call
0709 13:15:50.532717 (+ 68399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.534375 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:50.535449 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 283) took 1064 ms. Trace:
I20260709 13:15:50.535687 11980 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:50.535804 11409 rpcz_store.cc:276] 0709 13:15:49.470961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.471818 (+   857us) service_pool.cc:224] Handling call
0709 13:15:50.533989 (+1062171us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.535360 (+  1371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4771200}
I20260709 13:15:50.537021 11980 tablet_bootstrap.cc:492] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
W20260709 13:15:50.538679 11410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 281) took 3741 ms (client timeout 2000 ms). Trace:
W20260709 13:15:50.539242 11410 rpcz_store.cc:269] 0709 13:15:46.797580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.806037 (+  8457us) service_pool.cc:224] Handling call
0709 13:15:50.538195 (+3732158us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54005de154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:50.538458 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4821711744}
I20260709 13:15:50.517499 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:50.542724 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:50.543111 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.543581 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 284) took 1052 ms. Trace:
I20260709 13:15:50.543972 11415 rpcz_store.cc:276] 0709 13:15:49.491344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.537389 (+ 46045us) service_pool.cc:224] Handling call
0709 13:15:50.540973 (+1003584us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.543512 (+  2539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4759808}
I20260709 13:15:50.544804 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.546556 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.529003 10743 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:50.549871 12147 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.550069 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1276) took 1271 ms. Trace:
I20260709 13:15:50.550349 12147 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:50.550871 12147 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.532116 10665 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:50.554975 10669 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:50.560683 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1229) took 1102 ms. Trace:
I20260709 13:15:50.561196 10669 rpcz_store.cc:276] 0709 13:15:49.458523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.463869 (+  5346us) service_pool.cc:224] Handling call
0709 13:15:50.512095 (+1048226us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.560573 (+ 48478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8258944}
I20260709 13:15:50.561872 11990 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:50.557581 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.563057 10668 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:50.558985 12114 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.516191 12205 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:50.570880 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:50.550513 10743 rpcz_store.cc:276] 0709 13:15:49.278141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.337480 (+ 59339us) service_pool.cc:224] Handling call
0709 13:15:50.527661 (+1190181us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.549975 (+ 22314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15207808}
I20260709 13:15:50.572002 12205 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.623684 12179 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.624711 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:50.624576 12147 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.614797 11990 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:50.625427 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:50.606117 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.626825 12213 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:50.631238 11990 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:50.648604 12079 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.684s	user 0.001s	sys 0.018s
I20260709 13:15:50.649751 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.651947 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.651135 11990 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.663251 12181 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.667713 12102 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:50.657467 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:50.669739 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 267865us
I20260709 13:15:50.675199 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:50.676192 12010 consensus_meta.cc:287] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.011s
I20260709 13:15:50.676939 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.681771 12010 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.683265 11410 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:50.684104 12010 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.688222 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.689024 12114 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.689926 11411 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:50.691862 12147 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:50.649080 12079 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.659924 11980 ts_tablet_manager.cc:1403] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 5.376s	user 0.073s	sys 0.118s
I20260709 13:15:50.697149 10739 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:50.697500 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1473) took 2983 ms. Trace:
I20260709 13:15:50.698170 12131 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:15:50.700119 11995 consensus_meta.cc:287] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.026s
I20260709 13:15:50.700678 12079 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:50.701647 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 58715.9us
I20260709 13:15:50.705964 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.705979 10593 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:50.706657 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.707484 12190 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.707969 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:50.708432 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 111012us
I20260709 13:15:50.708963 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:50.709992 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 131351us
I20260709 13:15:50.710542 12010 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.711066 12165 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:50.718037 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 124568us
I20260709 13:15:50.718441 10585 rpcz_store.cc:276] 0709 13:15:47.713654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.838095 (+1124441us) service_pool.cc:224] Handling call
0709 13:15:48.838403 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.106124 (+267721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.106166 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.106220 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.106261 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.696865 (+1590604us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400299d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:50.696939 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.697159 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615199616}
I20260709 13:15:50.726174 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:50.727245 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:50.728024 10743 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:50.735353 10560 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:50.728547 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.729218 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:50.729578 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.729857 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.710567 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.731302 12165 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:50.739346 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.749094 10662 raft_consensus.cc:2368] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:50.750442 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:50.732935 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:50.754429 10736 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:50.754532 10739 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:50.754989 12109 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.634s	user 0.019s	sys 0.011s
I20260709 13:15:50.782877 10734 raft_consensus.cc:2368] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:50.746529 12165 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:50.748313 12004 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.118s	user 0.019s	sys 0.015s
I20260709 13:15:50.750697 10742 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:50.788105 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.789472 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.789584 10740 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:50.784478 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:50.785367 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.731308 11995 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.767630 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:50.791980 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1272) took 1515 ms. Trace:
I20260709 13:15:50.795404 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.812405 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.814071 11990 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.816421 11990 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:50.816644 12016 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.015s
I20260709 13:15:50.817134 12016 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.806269 12004 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.819764 10735 raft_consensus.cc:2376] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5. Re-sending same reply.
I20260709 13:15:50.820255 11415 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:50.820415 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.820760 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 78) took 1696 ms. Trace:
I20260709 13:15:50.821142 10738 rpcz_store.cc:276] 0709 13:15:49.123991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.371853 (+247862us) service_pool.cc:224] Handling call
0709 13:15:50.214238 (+842385us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:50.214416 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.304903 (+ 90487us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:50.315724 (+ 10821us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.525118 (+209394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.566236 (+ 41118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:50.582476 (+ 16240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.820411 (+237935us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b54001cd254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:50.820454 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.820592 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23563,"prepare.queue_time_us":19859,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":34872,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":38196,"spinlock_wait_cycles":225877760,"thread_start_us":131342,"threads_started":1,"wal-append.queue_time_us":47388}
I20260709 13:15:50.822436 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 59) took 1046 ms. Trace:
I20260709 13:15:50.822815 10660 rpcz_store.cc:276] 0709 13:15:49.744530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.949632 (+205102us) service_pool.cc:224] Handling call
0709 13:15:49.961254 (+ 11622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.962043 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.741197 (+779154us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5400281c50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:50.791270 (+ 50073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25967360}
I20260709 13:15:50.824144 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.824354 12004 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:50.824790 12111 consensus_meta.cc:287] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.036s	user 0.017s	sys 0.006s
I20260709 13:15:50.829495 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.830013 10588 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:50.830986 12188 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.831709 10660 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:50.836357 12007 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:50.832080 12190 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.838505 12226 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:50.839006 12226 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:50.840183 12226 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.842803 12226 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.793228 10741 rpcz_store.cc:276] 0709 13:15:49.276881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.372278 (+ 95397us) service_pool.cc:224] Handling call
0709 13:15:50.709094 (+1336816us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.791910 (+ 82816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16182016}
I20260709 13:15:50.835171 12010 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:50.846207 12010 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:50.846634 12010 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:50.847903 12010 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.831465 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 991) took 1180 ms. Trace:
I20260709 13:15:50.834139 10661 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:50.854717 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 123579us
W20260709 13:15:50.790199 10740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1281) took 1236 ms (client timeout 1574 ms). Trace:
I20260709 13:15:50.850740 10588 rpcz_store.cc:276] 0709 13:15:49.651020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.651193 (+   173us) service_pool.cc:224] Handling call
0709 13:15:49.651484 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.830468 (+1178984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.831108 (+   640us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002a8354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:50.831409 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683623808}
I20260709 13:15:50.834077 10585 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:50.856925 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:50.860909 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 122793us
I20260709 13:15:50.862769 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.849303 12010 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.865443 10664 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:50.854398 12179 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.869822 10592 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:50.801756 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 74664.1us
I20260709 13:15:50.871592 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:50.870532 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.873287 10742 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:50.873287 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:50.869730 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 136991us
I20260709 13:15:50.793771 12109 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.825220 12111 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.880363 12218 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.885119  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:50.857223 10740 rpcz_store.cc:269] 0709 13:15:49.553885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.558637 (+  4752us) service_pool.cc:224] Handling call
0709 13:15:50.710284 (+1151647us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194eee 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:50.790139 (+ 79855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6428928}
I20260709 13:15:50.885738 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.889521 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.893033 10668 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:50.893491 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:50.896471 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:50.896958 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.897073 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.887735 12004 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.900098 12121 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.900218 10590 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:50.900951 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.902333 12167 raft_consensus.cc:1064] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
W20260709 13:15:50.907238 12167 raft_consensus.cc:1068] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Unable to promote non-voter e71e2e44af1e46d8a8423ae08646bc22: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:50.898439 12213 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:50.903800 12012 consensus_meta.cc:287] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 13:15:50.903316 11980 raft_consensus.cc:359] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:50.898294 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.894631 11411 pending_rounds.cc:85] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 4
I20260709 13:15:50.917169 10585 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:50.894694 12205 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.917479 11411 pending_rounds.cc:107] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:50.917972 12205 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:50.917762 11980 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:50.918771 12205 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.910799 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.919399 11980 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:50.920825 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.922009 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:50.922149 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.922585 11980 ts_tablet_manager.cc:1434] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.200s	user 0.006s	sys 0.003s
I20260709 13:15:50.923396 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:50.910810 12218 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.911979 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.912284 11995 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:50.913151 10665 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:50.913865 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 994) took 1249 ms. Trace:
I20260709 13:15:50.914325 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:50.914680 10589 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.116s	user 0.012s	sys 0.037s
I20260709 13:15:50.915954 12111 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:50.902335 11413 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.004s
I20260709 13:15:50.916383 12165 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:50.916904 12184 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.677s	user 0.002s	sys 0.009s
I20260709 13:15:50.908941 12179 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:15:50.910549 12112 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.915s	user 0.017s	sys 0.017s
I20260709 13:15:50.943131 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:50.943342 12112 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.944939 12147 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.946271 10739 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:50.947769 12112 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:50.948189 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.948478 12179 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:50.948949 12179 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:50.948995 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:50.949523 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.950779 12179 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.937641 11413 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:50.926759 10587 rpcz_store.cc:276] 0709 13:15:49.664418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.952861 (+288443us) service_pool.cc:224] Handling call
0709 13:15:49.953193 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.463126 (+509933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.913605 (+450479us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54002cabd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:50.913794 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157489024}
I20260709 13:15:50.930493 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:50.930851 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.932348 12109 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:50.917953 11411 raft_consensus.cc:2889] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.933661 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.933615 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.935196 10589 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:50.936563 10660 raft_consensus.cc:2393] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:50.940043 10743 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:50.940590 11410 raft_consensus.cc:1217] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 13:15:50.941064 12225 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:15:50.941764 11409 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:50.966900 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.970301 10660 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:50.954604 12179 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:50.954993 12180 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.009s
I20260709 13:15:50.978147 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.978080 12180 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:50.979135 10737 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:50.980108 10736 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:50.980804 12180 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.951777 12181 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.924067 10667 raft_consensus.cc:2376] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:15:50.953300 12184 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:50.960673 10589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 993) took 1296 ms (client timeout 1520 ms). Trace:
W20260709 13:15:50.982921 10589 rpcz_store.cc:269] 0709 13:15:49.664129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.669627 (+  5498us) service_pool.cc:224] Handling call
0709 13:15:50.960566 (+1290939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.983455 10666 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:50.961885 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.935339 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:50.965792 12217 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.968505 12016 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:50.991756 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.993067 10664 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:50.969447 10668 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:50.941807 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:50.970551 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:50.956367 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:50.973212 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-456c58bcf67c4357b892184c57ce7e09 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:50.950814 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:50.978921 12230 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:15:50.917955 12164 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.004s
I20260709 13:15:50.918094 12012 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:50.980971 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:50.983211 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.964654 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:50.984756 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:50.984251 12218 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:51.095225 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-456c58bcf67c4357b892184c57ce7e09 on tablet 456c58bcf67c4357b892184c57ce7e09 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.010289 12205 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.095578 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.096429 10735 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.096761 10735 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:51.097157 11995 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:51.027263 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:51.097458 12010 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:51.097610 10735 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.098106 12010 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.098708 10735 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.100013 10660 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.100224 12010 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:51.101442 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.103505 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.104773 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.105907 10560 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.106216 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.106566 12152 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:51.097782 11995 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.106786 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.107887 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.104810 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:51.107998 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:51.098773 10666 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.083571 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.115047 10743 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:51.112335 10742 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:51.106652 12141 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.104979 12109 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:15:51.123849 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 116060us
I20260709 13:15:50.978154 11413 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.093814 12013 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.075953 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.125607 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.128252 10669 raft_consensus.cc:2393] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:51.115154 12004 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.116930 12165 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:51.118940 12010 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:51.135748 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 180095us
I20260709 13:15:51.136637 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:51.138363 10736 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:51.128211 10737 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:51.139642 12180 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:51.150175 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.142228 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:51.142596 12199 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.131780 12112 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.107318 12140 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:15:51.145409 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 210169us
I20260709 13:15:51.146868 12184 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.128842 12181 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.132025 12013 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.135986 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.140667 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.149658 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.151762 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.133366 12218 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:51.128957 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 148089us
I20260709 13:15:51.148530 12205 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:51.161568 10735 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:51.138994 12010 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:51.153815 11990 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.115438 12164 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.167193 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.165349 10560 leader_election.cc:400] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:51.175796 10560 leader_election.cc:403] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.167546 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.172348 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.171814 10742 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:51.176419 10735 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:51.155411 12181 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.158869 12013 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.152724 12112 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:51.183456 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.178653 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.186023 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:51.185940 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45360.1us
I20260709 13:15:51.194424 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:51.192086 12121 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:51.196425 12121 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:51.166831 12010 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.166548 12016 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:51.200042 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 65057.9us
W20260709 13:15:51.202621 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 66358.3us
I20260709 13:15:51.206607 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.207535 10743 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:51.176713 12218 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:51.219270 10737 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.191148 12181 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.191851 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.220642 11986 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.223829 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.187803 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44884 (request call id 241) took 1038 ms. Trace:
I20260709 13:15:51.231185 11413 rpcz_store.cc:276] 0709 13:15:50.125149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.127502 (+  2353us) service_pool.cc:224] Handling call
0709 13:15:51.152624 (+1025122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.233709 12147 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.234095 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:51.234712 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 63970.3us
I20260709 13:15:51.235260 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.236131 12197 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.236361 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.226079 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.194485 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:51.194525 12169 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:51.229095 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.224671 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.230698 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.234198 12190 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:51.171700 12140 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:15:51.202664 12016 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.192687 12112 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.240357 10741 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:51.244494 10742 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:15:51.248564 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.249732 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:51.245940 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43508.8us
W20260709 13:15:51.249817 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 79565.7us
I20260709 13:15:51.250311 12111 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:51.250597 12044 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.250783 12140 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.273408 12111 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:51.273648 12140 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.274871 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.274580 12111 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.275104 12140 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.273403 12044 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.276746 12044 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.251304 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.246672 12190 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.253831 11995 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.246129 12169 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.219434 12226 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:51.234109 12147 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:51.266083 10560 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.271124 10589 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.272298 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.272603 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:51.276854 12140 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.277189 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.283443 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.249964 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:51.279069 12233 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:15:51.285740 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.258947 12016 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.291492 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.201802 12121 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.279273 12197 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.308177 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.284008 12190 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.246479 12205 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:51.311529 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:51.311908 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70239us
W20260709 13:15:51.313041 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 84025.7us
I20260709 13:15:51.314988 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.317553 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.317901 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:51.318157 10741 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.318220 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.319347 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.319743 12190 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.320076 12152 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.320474 12152 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:51.320817 12152 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.320887 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:51.322270 12236 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:15:51.322759 12141 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.325773 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:51.327761 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 61732.8us
I20260709 13:15:51.317072 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.328831 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.334762 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.330962 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.332099 10589 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:51.332525 12226 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.354719 10736 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.355988 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.357435 11382 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.357616 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.358367 12004 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:51.358835 12004 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:51.347607 12165 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.359745 12004 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.328677 12180 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:51.361708 12109 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:51.353832 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.358716 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.364598 12209 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.365950 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.367372 10737 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:51.325009 12013 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.361644 12180 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.369539 12121 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:51.370039 12180 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.371249 12180 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.374794 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.375547 12013 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.364187 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.376693 12109 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.378038 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:51.378788 12165 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.355759 12044 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.379426 12181 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.351161 12202 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.382437 10741 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:15:51.382908 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43826.4us
I20260709 13:15:51.391036 10589 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.336280 11990 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:51.391851 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.388603 12165 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.339946 12199 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:51.395349 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:51.396153 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.345552 12197 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.398234 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.381346 12044 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.290383 12169 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.398205 10587 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:51.403517 10741 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:51.405071 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.405861 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.385987 12202 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:51.395016 11990 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.406623 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.393906 12165 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:51.389182 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 116686us
I20260709 13:15:51.400725 12199 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.414300 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.414330 10593 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:51.404742 10739 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.412609 12202 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.413192 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.404534 12164 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:51.418568 10737 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:51.424845 12228 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:51.425341 12031 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:51.425706 12031 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:51.426514 12031 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.427958 12031 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.434252 12112 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:51.434737 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.436241 12112 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.436307 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.436896 12112 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.437688 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.438390 10589 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.414019 12165 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.441699 10741 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:51.442597 10736 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.444245 12152 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.421671 12197 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:51.394371 12147 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.445156 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:51.449800 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58376.4us
I20260709 13:15:51.449838 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.423796 12190 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.389381 12218 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.422710 12007 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.412441 12010 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.452379 10738 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.437252 12112 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:51.463318 12147 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:51.469105 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.463070 10587 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:51.472545 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.472931 10592 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.453408 10741 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.450910 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.455781 12191 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.456276 10594 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:51.457340 10559 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.445022 12131 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.475905 10587 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
W20260709 13:15:51.498457 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47621.5us
I20260709 13:15:51.473090 12179 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.499675 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.505455 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.506585 10741 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.500694 12012 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.474552 12169 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:51.511385 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57400.4us
I20260709 13:15:51.514041 10743 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:51.463070 12112 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.498440 12131 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:51.517267 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.518400 10590 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.503360 12013 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.459021 12197 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:51.516563 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.529835 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.530200 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.473735 12190 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.535817 11990 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:51.537427 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.541668 10559 leader_election.cc:400] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3.
I20260709 13:15:51.531167 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:51.551607 10590 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:51.516283 12007 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:51.462502 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.555397 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.506299 12179 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:51.561062 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.519290 12131 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.561442 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.563835 10559 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.531744 12013 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:51.567588 10735 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.569602 10593 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.574519 10594 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:51.519609 12191 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.582679 10593 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:51.588892 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.593811 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.591816 10741 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.597702 10741 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:51.576215 12013 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.566335 12007 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:51.640758 10590 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.601493 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:51.588402 12226 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.643738 10593 raft_consensus.cc:2376] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3. Re-sending same reply.
I20260709 13:15:51.659883 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.592536 12197 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:51.693782 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:51.709903 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 133953us
I20260709 13:15:51.711359 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.638633 12217 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.640949 12191 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.666473 10741 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:51.725024 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.723353 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:51.756884 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 356123us
W20260709 13:15:51.664361 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 216476us
I20260709 13:15:51.689357 12141 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.703897 12152 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:51.767278 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:51.764060 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52810.1us
I20260709 13:15:51.769002 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.764359 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.764590 12007 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.764991 12164 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:51.765879 12107 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:51.773067 10741 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.756721 12044 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:51.774530 12109 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.718197 12217 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.777462 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.756667 12191 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.715276 12012 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:15:51.759187 12004 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:15:51.801878 10632 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:51.775079 12226 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.785631 12044 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:51.785377 12217 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.800071 12190 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.821458 10734 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:51.808849 12205 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.784876 12191 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.774973 12141 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.805401 11990 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:51.826138 10491 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 218) took 6486 ms. Trace:
W20260709 13:15:51.822259 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 322647us
I20260709 13:15:51.829468 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:51.832361 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.833396 10743 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:51.819916 12179 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:51.841900 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:51.821609 12010 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.828593 12226 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.825408 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.849478 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:51.830055 12190 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:51.876358 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.892115 10741 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:51.892468 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 64929.6us
I20260709 13:15:51.890333 12111 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:51.895591 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126680us
I20260709 13:15:51.897908 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.831473 10491 rpcz_store.cc:276] 0709 13:15:45.339890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.347336 (+  7446us) service_pool.cc:224] Handling call
0709 13:15:45.679203 (+331867us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b540006ff90. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f42541950b2 00007f425d10ea89 00007f425d0a6da6 00007f425d078088 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc
0709 13:15:51.826070 (+6146867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:50.715709 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:50.717893 (+  2184us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:50.717961 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:15:50.717990 (+    29us) tablet.cc:662] Decoding operations
0709 13:15:50.719541 (+  1551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:50.730729 (+ 11188us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:50.731788 (+  1059us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:50.812135 (+ 80347us) tablet.cc:701] Row locks acquired
0709 13:15:50.830520 (+ 18385us) write_op.cc:260] PREPARE: finished
0709 13:15:50.830701 (+   181us) write_op.cc:270] Start()
0709 13:15:50.830871 (+   170us) write_op.cc:276] Timestamp: P: 1783602950830632 usec, L: 0
0709 13:15:50.830928 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 13:15:50.832383 (+  1455us) log.cc:844] Serialized 530 byte log entry
0709 13:15:50.974012 (+141629us) op_driver.cc:464] REPLICATION: finished
0709 13:15:51.336152 (+362140us) write_op.cc:301] APPLY: starting
0709 13:15:51.346308 (+ 10156us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:51.394230 (+ 47922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:51.411521 (+ 17291us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:51.429336 (+ 17815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:51.429571 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:51.429638 (+    67us) write_op.cc:312] APPLY: finished
0709 13:15:51.429921 (+   283us) log.cc:844] Serialized 23 byte log entry
0709 13:15:51.430106 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.430198 (+    92us) write_op.cc:454] Released schema lock
0709 13:15:51.430251 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:51.430598 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.430630 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8546,"reported_tablets":4,"spinlock_wait_cycles":78487296,"child_traces":[["op",{"apply.queue_time_us":332765,"apply.run_cpu_time_us":2306,"apply.run_wall_time_us":114348,"num_ops":1,"prepare.queue_time_us":218857,"prepare.run_cpu_time_us":6784,"prepare.run_wall_time_us":198843,"replication_time_us":106798,"thread_start_us":236996,"threads_started":2}]]}
I20260709 13:15:51.900000 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:51.901903 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:51.902850 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 135638us
I20260709 13:15:51.904299 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:51.904987 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 72575us
I20260709 13:15:51.906093 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.899343 12218 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:51.896772 12179 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.907799 12180 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.907662 12044 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:51.908273 12241 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:15:51.908350 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.909467 12199 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.897338 12111 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:51.910631 12016 consensus_meta.cc:287] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.000s
W20260709 13:15:51.910991 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.911674 12242 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:15:51.912035 12010 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.912497 12226 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.911844 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:51.910668 10559 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.916366 12012 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.916210 12217 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.922571 12191 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.927975 12165 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:51.904671 12205 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:15:51.936539 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 129865us
W20260709 13:15:51.962761 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.895957 12190 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.936419 12179 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:51.940909 12111 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.957273 12218 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.972692 12218 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:15:51.972945 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62328.9us
I20260709 13:15:51.973354 12190 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.973519 12218 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:51.974187 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:51.974923 12218 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.975282 12140 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.975673 12140 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:51.947044 12016 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.976650 12141 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:51.976543 12140 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:51.977572 12245 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.977851 12016 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.978426 12016 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.978324 12245 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:51.979441 10489 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:15:51.980239 12199 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:51.975239 12247 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:51.947904 12180 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:51.986181 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.986519 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.993382 10735 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:51.986781 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:51.996496 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.987599 10489 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.947496 12107 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:51.971735 12179 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.987336 12140 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:52.001757 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80682.8us
W20260709 13:15:52.063026 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.036731 10635 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.566s (SENT)
I20260709 13:15:51.982319 12181 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:51.985994 12031 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
W20260709 13:15:52.040268 12121 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.003s
W20260709 13:15:52.070410 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 158622us
I20260709 13:15:51.989879 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.989763 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:51.985882 12112 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.071226 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.072019 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.079253 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:51.986857 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 222576us
I20260709 13:15:51.985226 12217 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.981889 12191 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:51.986241 12247 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.083316 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:52.072479 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 100362us
I20260709 13:15:52.070827 12012 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.093879 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:52.103663 10593 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.105168 10489 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:15:52.084782 12007 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.109625 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 68754.8us
I20260709 13:15:52.108672 10594 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.112044 10489 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.110564 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:51.975339 12249 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 13:15:52.118790 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.116099 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 141973us
I20260709 13:15:52.120843 12258 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.125564 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:52.109822 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:52.126323 10735 raft_consensus.cc:606] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:52.119705 10489 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.122303 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.121413 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.132138 10587 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.130918 10594 raft_consensus.cc:2376] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:15:52.133961 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.117373 12190 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:52.130856 12258 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.138382 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.140501 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.140703 12258 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.141225 10589 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:52.142481 12261 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:52.142813 10587 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.142937 12261 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.141180 10590 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.138833 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.149171 10738 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:52.154438 10592 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:52.143838 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 107147us
W20260709 13:15:52.149466 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.143898 12245 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:52.117372 12007 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.150943 12243 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:52.151117 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.123395 12205 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.152194 11417 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:52.152127 10591 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.137563 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:52.139055 12181 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.158022 10587 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:52.159950 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.161437 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:52.156865 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.187498 12263 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:52.191848 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 62170.3us
I20260709 13:15:52.192920 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:52.190296 12031 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.163093 12243 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.153728 12190 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.179446 12165 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:52.186731 12109 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.206339 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:52.190546 12226 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.190418 12152 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:52.210923 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49597.5us
I20260709 13:15:52.189107 12181 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.185663 12247 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:52.210629 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50917.7us
I20260709 13:15:52.214699 10587 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.214589 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.203548 10739 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:52.210500 12031 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:52.218838 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:52.179654 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69648.1us
W20260709 13:15:52.213366 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 102869us
I20260709 13:15:52.224277 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.220604 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.225389 10592 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:52.208374 12109 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.205375 12265 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.213299 12152 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.227974 10632 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:52.188393 12012 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:52.229004 12007 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:52.230433 12109 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:52.231050 12256 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:15:52.231431 12263 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.231734 12261 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:52.240037 12013 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.003s
I20260709 13:15:52.232560 11414 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.233333 12243 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.236654 12031 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:15:52.236886 12202 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.797s	user 0.003s	sys 0.004s
I20260709 13:15:52.237326 12249 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:52.276909 12181 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.284637 12249 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:52.285073 12249 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.238201 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.238502 10735 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:52.226446 10706 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:52.251464 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.232121 12259 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.222905 12112 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:52.242516 12131 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:15:52.264370 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.259785 12226 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.270560 12190 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:52.271152 12152 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.267400 12013 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.266729 12180 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.269119 12109 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.268723 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.276829 12243 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.277611 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:52.218870 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:52.282907 10632 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:52.283941 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.287760 10734 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:52.263165 12264 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:52.313344 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 105598us
I20260709 13:15:52.313860 12264 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.314399 12264 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.315229 12264 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.264345 12257 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:52.293546 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 67197.7us
I20260709 13:15:52.301476 12261 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.295195 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.302932 12169 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.288223 12140 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:15:52.308732 11410 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:52.308887 12013 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.288703 12202 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.309700 12253 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:15:52.310525 12180 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:15:52.317551 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79438us
I20260709 13:15:52.317785 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:52.290591 12165 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.288393 12259 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.317034 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.326426 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.330751 10666 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.329523 12255 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:52.331207 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.329748 12205 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.331230 10668 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:52.328573 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.333003 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.307255 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:52.331455 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.332175 10585 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.380864 10586 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:52.383701 10588 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:52.331607 12169 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.330953 10587 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.333930 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:52.355142 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.369995 12140 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:52.401142 12202 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:52.401510 12140 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.401695 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.402411 12255 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.370184 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.402802 12255 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.402910 12031 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.370834 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.380909 11415 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:52.396381 10589 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:52.397830 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:52.398797 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.399488 11409 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.399163 12169 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.403626 12255 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.434615 12255 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.434538 12180 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.431039 12250 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.431187 12259 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.376678 12044 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:15:52.404071 12205 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.404713 10632 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:52.364688 12265 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:15:52.433642 12169 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.303927 12131 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:15:52.444852 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.445540 10665 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:52.458763 10666 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:52.460840 12259 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:52.465162 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 60525.3us
W20260709 13:15:52.479022 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.468140 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:52.480676 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56369.2us
I20260709 13:15:52.482555 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.483460 12263 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.484349 12263 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:52.485852 12152 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.486114 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.486845 12263 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.488409 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.489100 12263 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.490195 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.490865 12263 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.491959 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.492874 12263 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.493830 12266 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.494196 12266 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.494468 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.494971 12266 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.496361 12266 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.437282 12249 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:52.437955 12261 consensus_queue.cc:1175] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:52.402407 12140 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.501567 12016 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.501647 12140 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.502013 12016 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.502975 12131 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.502907 12016 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.504110 12016 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.500766 11418 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.506024 10588 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:52.456660 12111 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.469158 12270 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:52.509125 12270 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:52.509505 12270 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.510304 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:52.510406 10594 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:52.511040 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 286830us
W20260709 13:15:52.514389 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.537901 12131 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:52.539163 12112 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.539529 12112 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:52.540371 12112 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.541950 12112 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.533215 12270 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.545797 12270 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.552697 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:52.502023 12249 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.510111 12111 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.514056 12263 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.515376 12190 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.563093 12181 raft_consensus.cc:1064] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
W20260709 13:15:52.563933 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69544.7us
W20260709 13:15:52.567687 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.569664 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:52.556264 12031 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.574618 12248 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:52.564960 12190 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.513463 12012 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:15:52.578251 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:52.551308 12265 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:52.579945 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.585423 12262 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:52.587810 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 67158us
W20260709 13:15:52.578645 12179 consensus_meta.cc:287] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.005s
I20260709 13:15:52.590342 12265 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:52.590709 12265 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.591543 12265 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:52.592828 12265 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.603577 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:52.605024 12205 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:52.605598 12205 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.606570 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.607097 10587 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.583214 12190 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.611675 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:52.618044 11418 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:52.621883 10587 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:52.624985 12109 raft_consensus.cc:993] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: : Instructing follower 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:15:52.625573 12109 raft_consensus.cc:1081] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Signalling peer 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:15:52.597697 12248 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.634114 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:52.636068 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.638860 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:52.639560 10738 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:52.630903 12250 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.598845 12179 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.645578 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.648300 10735 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:52.632453 12140 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:15:52.651010 12179 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.656143 12140 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:52.656522 12140 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.658538 12197 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.658897 12197 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.660714 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.665362 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:52.659678 12197 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.630400 12243 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:52.670763 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55846c170448461696e53d2649ed09d8"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:52.671489 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:52.673975 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:52.675271 10735 raft_consensus.cc:606] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:52.681720 12245 raft_consensus.cc:1064] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:15:52.690469 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:52.692253 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.695681 12012 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.700081 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.701957 11418 raft_consensus.cc:1217] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:52.702669 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.704107 12262 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.704847 12262 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.705516 12291 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:52.706024 12291 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.708252 12291 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:52.709079 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.680902 12226 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.710640 10632 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:52.662554 12140 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.711213 12152 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:52.712709 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.712836 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.714972 10588 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:52.730576 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.716786 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.700351 12294 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:52.718294 10706 consensus_peers.cc:597] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e245cc261b6415fac3d372489a49ceb. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:52.744865 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 45536.4us
I20260709 13:15:52.732455 10591 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:52.731523 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.734170 10739 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.734511 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.734751 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.730135 12121 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.735045 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.735673 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.751881 10665 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:52.735842 12044 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.730288 12152 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.737246 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.729940 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.737958 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.731606 12250 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:15:52.756738 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.738583 12253 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:52.739229 12294 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.761332 10734 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:52.761375 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.740535 12140 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.741888 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:52.742301 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.764539 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.731738 12197 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.765187 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:52.731105 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.753263 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:52.754585 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 44034.9us
I20260709 13:15:52.757463 10667 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 2: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:52.753535 10663 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:52.766295 10741 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:52.758948 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.768859 10661 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:15:52.759200 12152 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.760159 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.760738 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.764401 10662 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:52.770633 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:52.751971 12012 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.774665 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.773113 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:52.743599 12245 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.776623 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.776788 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:52.748198 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45606.8us
I20260709 13:15:52.778615 10663 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.780674 10593 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.761626 12270 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.782253 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.783880 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.782428 10593 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.783007 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.786453 10667 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:52.786288 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.764336 12294 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.789217 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.791102 10587 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.791589 10594 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.774482 12226 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:52.791030 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:52.794102 10665 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:52.778188 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.795608 10585 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:52.796789 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.797997 10667 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.790206 10593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:15:52.798552 10593 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:52.798900 10593 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.800174 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:52.801993 12296 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:15:52.784607 12012 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:52.776676 12016 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:52.794019 12226 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.794523 12264 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.810501 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:52.812804 12141 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:52.813145 12243 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.804324 12152 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.814843 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.836794 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:52.820087 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.798082 12255 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.823920 12179 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.795528 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:52.814092 12121 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:52.828372 10735 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:52.826588 12248 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:52.845988 10661 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.793830 12031 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:15:52.874488 10662 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:52.874815 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 74684.8us
I20260709 13:15:52.795122 12164 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:15:52.827255 12141 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:52.821216 12226 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.800288 12270 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:52.950210 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:52.951462 10593 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.952600 10585 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.828954 12265 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:15:52.982594 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:52.891387 12121 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:52.936638 10740 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.957676 10666 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:52.967013 10663 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:52.931247 12246 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.832188 12190 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:52.944945 12264 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.997203 12264 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.991607 12012 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:52.999236 12264 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:52.945686 12263 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:15:53.002678 10669 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.002979 12294 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.003455 10667 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:53.005492 12299 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.010368 12165 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.010824 12165 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.011806 12165 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.012192 10661 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:53.021919 10666 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.028079 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:53.029088 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 95143.8us
I20260709 13:15:53.030504 10593 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:53.032006 10661 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:15:53.032490 10661 pending_rounds.cc:85] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 2
I20260709 13:15:53.032799 10661 pending_rounds.cc:107] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:53.033118 10661 raft_consensus.cc:2889] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:53.035305 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.035158 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 258846us
W20260709 13:15:52.945894 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 135475us
I20260709 13:15:53.039672 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:53.046285 11418 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.005115 12294 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.073945 10660 raft_consensus.cc:2368] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:53.013249 12165 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:53.080895 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51008.4us
I20260709 13:15:53.081538 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.068740 12263 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.081533 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.013382 12226 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:53.087877 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.085065 10661 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 3: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:53.075951 12264 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.066994 12169 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:15:53.167493 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 86021.9us
W20260709 13:15:53.141680 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65605.1us
W20260709 13:15:53.136420 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50581.3us
I20260709 13:15:53.069023 12141 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.155072 12261 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.148365 12264 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.200532 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.170336 12164 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.199594 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.088323 12121 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.148865 12246 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:53.198592 12031 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:53.216027 12121 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.217026 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.209389 12164 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.218276 12140 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.219677 12190 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.224694 12264 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:53.226037 12251 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:53.202507 12299 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:15:53.167085 12263 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.230264 10664 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:53.232669 12031 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:53.233923 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:53.219702 12226 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.239430 10740 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:53.258229 11412 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.258870 12031 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.251714 12169 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.242347 10668 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:53.243264 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.266994 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.268078 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.267829 12181 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.247496 12141 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.268824 12311 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:53.285799 12263 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.288823 12169 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.290139 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:53.291124 12291 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.291200 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:53.292393 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.274421 12031 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:53.295230 11418 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:53.296124 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:53.285154 12164 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.298763 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.300202 12264 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.300814 12299 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:53.301280 12299 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:53.294798 12031 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.302105 12299 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.303465 12031 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:53.295063 12197 consensus_meta.cc:287] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.529s	user 0.002s	sys 0.007s
I20260709 13:15:53.305441 12263 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.305962 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:53.307303 11411 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:53.308852 10668 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.311307 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.293668 12311 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.315457 12311 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.316999 10590 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:53.317193 10664 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:53.320205 10664 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:53.321472 10661 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:53.323865 10586 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:53.324153 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.319161 12263 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:53.326175 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.326938 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.327741 10667 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.330768 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.330276 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.295192 12291 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:53.332403 10664 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.332881 10669 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:53.337131 11412 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:53.340775 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:53.341583 12299 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.342232 12299 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:53.343287 12299 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.347162 11413 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.347837 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 246) took 1313 ms. Trace:
I20260709 13:15:53.348201 11413 rpcz_store.cc:276] 0709 13:15:52.034741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.039911 (+  5170us) service_pool.cc:224] Handling call
0709 13:15:52.647173 (+607262us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194eee 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:53.346844 (+699671us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194f8c 00007f4254194ef6 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:53.346963 (+   119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:53.347580 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.347764 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53346688}
I20260709 13:15:53.350999 12109 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.351449 12109 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.352253 12109 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.354552 12291 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.355809 12291 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.356137 10667 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.359066 10662 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:53.366411 12266 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.366876 12266 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:53.367893 12266 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.382855 10664 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.388017 10661 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:53.387364 12310 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.125s	user 0.002s	sys 0.002s
I20260709 13:15:53.380113 12266 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.378859 12109 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.394035 11990 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.394549 11990 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.394102 12248 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.395392 11990 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.401635 11990 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.405561 12205 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.405963 12205 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:53.406828 12205 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.408056 12205 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:53.419616 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.420996 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.421294 11409 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:53.422509 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:53.425469 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.429117 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.429956 10661 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.434966 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.436889 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.438999 10593 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:53.439767 10559 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.429111 12248 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.443699 12248 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.444175 10592 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.444670 12248 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.446503 10588 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:53.446604 10662 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.448094 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.449048 10590 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:53.450618 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.451164 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.452245 10664 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:53.422824 12179 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:15:53.452875 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.454258 10585 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.454342 10586 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.456856 10660 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.456851 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:53.457801 10585 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.458288 10591 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:53.459534 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.459898 10666 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:53.461506 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.466655 10594 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:53.467288 10664 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:53.446250 12181 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.482858 10735 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:15:53.483991 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.484162 10738 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:53.451088 12111 raft_consensus.cc:2764] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:15:53.486017 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62365us
I20260709 13:15:53.486411 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:53.486739 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.488804 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:53.460630 12164 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.459910 12245 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.489092 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.456933 12044 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.460758 12311 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.491449 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.494153 12131 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.459578 12266 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.493144 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:53.492063 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:53.450413 11990 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:15:53.508839 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.510735 10588 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.510946 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:53.460520 12313 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:53.511682 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.512231 10735 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:15:53.512530 10559 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.514508 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.515528 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.517112 10741 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:53.518349 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.519001 10660 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:53.519670 10742 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:53.509095 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.520460 10664 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:15:53.524375 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.508025 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:53.525225 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.525923 10668 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:53.526530 12291 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.526600 12255 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:53.527143 12255 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:53.526628 12266 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.529446 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.536950 10743 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.538200 10742 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:53.538924 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.499141 10661 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:53.506655 12251 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.508773 11413 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:53.565748 10741 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.494417 12250 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:15:53.488036 12299 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:15:53.508188 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:53.570750 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.567770 12131 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.573348 10741 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:53.561589 12247 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.574064 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:53.576105 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69677.9us
I20260709 13:15:53.577750 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:53.563723 12111 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.529448 12165 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:53.507283 12044 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.527961 12255 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:53.580169 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58267us
I20260709 13:15:53.596580 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:53.507747 12311 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.506832 12245 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.496336 12164 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.488390 12181 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.583580 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:53.585934 10585 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:53.580560 12291 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.572969 12179 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.572064 12251 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:53.594982 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.582713 12270 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.609822 10594 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:53.597002 10588 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
W20260709 13:15:53.593436 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.584118 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.610075 10585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:15:53.610908 10588 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:53.611377 10585 raft_consensus.cc:606] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:53.611865 10585 raft_consensus.cc:614] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:53.581868 12266 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.613220 12251 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.606637 12165 consensus_queue.cc:1243] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:53.613838 12044 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.614105 12111 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:53.614950 11990 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.587956 12226 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:15:53.608204 12291 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.615849 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:53.616324 12291 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.616559 10661 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:15:53.616672 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:53.617296 11409 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.617869 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:53.618701 12121 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.619055 12121 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.619355 12121 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.611361 12270 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.621819 12270 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.622076 12217 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.622550 12217 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.625705 12217 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:53.626232 10734 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:53.626755 12131 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.627918 12031 raft_consensus.cc:993] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:15:53.628347 12031 raft_consensus.cc:1081] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:15:53.630352 10585 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.630522 12181 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.631202 12121 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:53.631587 10585 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:53.631784 10740 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.632117 10740 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.634409 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:53.634902 10661 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.635010 12311 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.636618 12245 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:53.638814 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:53.639832 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:53.640312 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:53.640837 10586 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.641710 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:53.642587 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:53.643199 11418 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:53.613891 10588 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:53.648700 11418 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:53.613907 10594 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:53.630617 10589 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:53.651993 10661 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:15:53.647361 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:53.662071 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:53.662920 11418 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:53.665740 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:53.615798 12226 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.664760 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.676101 10591 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:53.670766 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.662760 12121 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:53.672272 12031 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.673178 12164 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:53.673369 12325 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:15:53.674297 12312 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:53.678073 10743 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:53.632813 10740 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.683319 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.684018 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:53.685966 10491 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 3 to 4, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 4 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.741170 10593 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:53.693864 12031 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.681083 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:15:53.753479 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 72495.9us
I20260709 13:15:53.669271 11990 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.656610 12315 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.698482 12247 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:53.694940 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.700098 12270 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.674957 12226 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:53.682610 12299 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.774600 12299 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.774974 12299 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.651321 12262 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.702358 12265 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.710836 10586 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:15:53.718489 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.779516 10588 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7. Re-sending same reply.
W20260709 13:15:53.687469 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 75536.7us
I20260709 13:15:53.711330 12264 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:15:53.711689 12181 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:53.701414 12190 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:53.759426 12164 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:53.674724 12197 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:15:53.761158 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.765841 10743 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:53.776280 10585 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:53.762216 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 78259.5us
W20260709 13:15:53.780264 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 107289us
I20260709 13:15:53.842900 12329 ts_tablet_manager.cc:933] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:53.757414 12312 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:53.782141 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:53.791496 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.760492 12111 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.856812 12111 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.857267 12111 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.856858 12312 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.755899 12031 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:53.865262 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83188.8us
I20260709 13:15:53.833994 10593 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:53.739101 12327 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:15:53.776033 12306 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:53.713495 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:53.760802 12258 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:53.839860 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.869926 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.854000 10736 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:53.795200 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:53.871405 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
W20260709 13:15:53.861545 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 347050us
I20260709 13:15:53.792374 12291 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.794513 12265 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.874869 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.878891 10743 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:53.927078 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53670.8us
W20260709 13:15:53.932253 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57501.2us
W20260709 13:15:53.935060 12331 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:53.934554 12191 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.938423 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.861683 12179 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.949975 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.950248 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:53.938195 11990 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.954668 12109 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.948796 12169 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:53.839565 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:53.956470 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 122279us
I20260709 13:15:53.938364 12131 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.957962 12131 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:53.938719 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 234772us
W20260709 13:15:53.959487 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 83088.5us
I20260709 13:15:53.873214 12247 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.964069 10743 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:53.961220 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.979069 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:53.979803 10738 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
W20260709 13:15:53.982220 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.005134 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52325us
I20260709 13:15:54.005899 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:53.960803 12202 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:53.878015 12259 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:15:53.926560 12266 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:15:53.861908 12226 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.968118 12253 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:54.065002 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.067900 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:54.068663 10738 raft_consensus.cc:606] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:54.069087 10738 raft_consensus.cc:614] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:54.003422 12247 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:53.951718 12191 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:53.962090 12306 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
W20260709 13:15:54.074717 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 226871us
I20260709 13:15:53.948499 12258 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:54.041488 12202 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:53.963748 12179 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:54.085860 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 244734us
I20260709 13:15:54.066461 12253 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:54.090744 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.079293 12007 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.082531 11411 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:54.086869 12270 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.116312 10741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:33266
W20260709 13:15:54.120520 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 166169us
I20260709 13:15:54.089927 12253 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.121850 10741 raft_consensus.cc:606] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:54.083781 12181 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:15:54.085565 12190 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:15:54.095381 12315 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.142177 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 200968us
I20260709 13:15:54.154244 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:54.156527 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:54.158097 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:54.160678 10594 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:54.116708 12329 tablet_copy_client.cc:323] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:15:54.164968 10586 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:54.126928 12180 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:15:54.166126 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50083.6us
I20260709 13:15:54.167095 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:54.165000 10589 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:54.153658 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:54.168902 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 163074us
I20260709 13:15:54.154383 12291 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.194909 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:54.153827 12315 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.145059 12270 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:15:54.162930 12197 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.136320 11990 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:54.156417 12248 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:54.200141 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:54.198555 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.206284 10559 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.198074 12112 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.198625 11413 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:15:54.208596 12337 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:54.208472 12112 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:54.209065 12336 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:15:54.210325 12330 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:15:54.210687 12112 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.210819 10740 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.211990 12181 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:54.212604 12007 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.176704 11412 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:54.140800 12247 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.199954 10739 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:54.200416 12265 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.160640 12202 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.206578 12312 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.236369 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.204142 12266 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:15:54.247020 11409 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.000s
I20260709 13:15:54.247313 12111 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.206136 12291 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:15:54.241460 12112 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.259660 11409 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:15:54.225087 12343 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:15:54.242779 11990 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.267519 11418 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:54.252724 12191 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.252516 12315 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:54.260938 12259 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.278139 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.260432 12251 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.308043 12353 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:15:54.267036 12270 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.263200 12180 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:15:54.321795 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44126.3us
I20260709 13:15:54.323947 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.279696 12181 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:54.276916 12112 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.322976 12259 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.332103 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.332667 12352 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.332914 12360 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.333595 12351 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.338359 12352 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.342733 12352 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.338369 12141 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:54.344996 12141 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:54.327018 12270 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:54.331598 12313 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:54.317269 12251 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:54.352438 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 152369us
I20260709 13:15:54.358898 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.358165 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.345837 12141 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:54.439429 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.460716 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.461553 10668 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:54.353132 10739 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:15:54.469396 10737 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:54.346748 12313 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:54.465158 10661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55846c170448461696e53d2649ed09d8"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35992
I20260709 13:15:54.470830 10661 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:54.471194 10661 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.465999 10660 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:54.358127 12315 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.476420 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.477038 10669 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
W20260709 13:15:54.504856 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 146027us
I20260709 13:15:54.505977 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.467433 12266 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.470309 12141 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.465159 12343 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:54.533600 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.533548 10740 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:54.538720 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1338) took 1074 ms. Trace:
I20260709 13:15:54.539078 10740 rpcz_store.cc:276] 0709 13:15:53.463960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.466583 (+  2623us) service_pool.cc:224] Handling call
0709 13:15:53.631676 (+165093us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400239ea0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f4257230dc0 00007f42572bce18 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6
0709 13:15:54.210437 (+578761us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5400239ea0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f425722ea1d 00007f42572151a4 00007f4257297447 00007f42572affe7 00007f42572b17de 00007f42572bd27c 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591
0709 13:15:54.538669 (+328232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207118464}
I20260709 13:15:54.528810 10661 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.345286 12253 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.543998 10559 leader_election.cc:400] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:54.560850 10559 leader_election.cc:403] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.473538 12111 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:54.550936 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.560413 10661 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.563055 12335 raft_consensus.cc:2764] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:54.564131 12366 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.565303 12363 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:15:54.566176 12354 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:15:54.566267 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.568403 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:54.568563 12007 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4.
I20260709 13:15:54.563548 12347 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.477716 12112 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:54.585434 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.556500 12152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:15:54.592283 12366 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.555716 12247 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.545881 12266 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.591475 10669 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:54.483790 12315 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.598372 12353 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:54.604534 12357 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:15:54.606848 12347 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.634101 12366 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.634900 12359 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.566870 12259 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.590108 12265 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:54.593065 12248 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.641490 12368 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.643131 12253 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.647336 12270 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.664554 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:54.599891 12111 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.655650 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.666546 10587 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:54.656147 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:54.657720 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.663266 10669 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:54.650940 10591 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:54.668147 10661 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:54.662616 12359 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.671073 12111 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.672227 12359 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.673430 10592 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:54.673075 12111 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.666409 10660 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:54.581423 12343 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.674373 12368 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.665697 11990 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.654268 12353 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.692075 12253 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:54.689663 12352 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.693531 12266 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.669091 12248 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:54.679997 12031 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.742s	user 0.005s	sys 0.005s
I20260709 13:15:54.698345 12353 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.702913 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.720856 10591 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:54.721920 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:54.722573 10591 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.579519 12313 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.725977 12313 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.663425 12265 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:54.729722 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.715790 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:54.717407 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:54.718657 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:54.731235 10738 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:54.731500 10740 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:54.735749 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.698833 12197 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:54.734664 12299 consensus_meta.cc:287] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.000s
I20260709 13:15:54.721177 12251 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.745158 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:54.738876 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 77579.1us
I20260709 13:15:54.729705 12031 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.750267 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:54.751053 10734 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:54.758080 12375 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.758724 12375 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.762107 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 8e245cc261b6415fac3d372489a49ceb from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:54.752148 12202 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.762701 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 8e245cc261b6415fac3d372489a49ceb from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-8e245cc261b6415fac3d372489a49ceb
I20260709 13:15:54.762992 12202 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.749836 12246 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.714759 12253 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.739801 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:54.770555 10740 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:54.771731 12375 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.774350 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.775449 12311 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:54.775931 12311 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.744932 12347 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.780450 10742 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:54.777732 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.764489 12246 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.788902 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.776378 12311 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.747426 12299 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.812706 10591 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:54.779830 10739 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:54.790141 12373 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:15:54.823058 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.824879 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.825147 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.826828 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.801774 11990 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:54.820292 12343 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.791489 12368 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:54.811930 10635 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.509s (SENT) [suppressed 106 similar messages]
I20260709 13:15:54.793289 12372 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:54.808920 12248 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.776396 10753 tablet_copy_source_session.cc:215] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:54.792452 12366 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:15:54.823747 12315 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.836413 12382 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:54.868125 12382 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.868212 10491 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 4, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 4 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.870491 12382 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:54.869912 10491 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 4 to 5, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 5 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.828339 12376 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.885684 12376 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.886158 12376 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.829479 11990 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.829789 12368 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:15:54.878839 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1545) took 1357 ms. Trace:
I20260709 13:15:54.890192 10585 rpcz_store.cc:276] 0709 13:15:53.521674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.632254 (+110580us) service_pool.cc:224] Handling call
0709 13:15:53.632481 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:53.847548 (+215067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.878564 (+1031016us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400169c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:54.878771 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330322816}
I20260709 13:15:54.879088 12253 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.830703 12390 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.902522 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.898036 10593 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:54.848291 12375 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:54.907014 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76190.3us
I20260709 13:15:54.900540 11990 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.910405 12202 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.832229 12372 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:54.910054 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 98160.9us
I20260709 13:15:54.915539 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.915860 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.916308 10669 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:54.916651 10661 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:54.866173 12248 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.919776 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.922189 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.922956 10593 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:54.923609 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.924363 10669 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:54.930490 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:54.912487 12265 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.937040 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.917454 12375 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:54.938525 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.917747 12372 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.938571 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:54.940019 10660 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:54.933599 12263 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.946308 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.917794 12390 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.951316 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:54.951937 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.927030 12248 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.937633 12366 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:54.935388 12246 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.941459 11412 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 1 LEARNER]: Advancing to term 2
I20260709 13:15:54.941131 12031 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:54.955787 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:54.956539 10593 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.959113 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:54.959553 10669 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.967119 10668 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:54.953668 12265 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:54.949246 12263 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:54.964869 12378 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:54.956636 12385 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.969997 12385 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.970381 12263 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:54.955463 12377 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.976145 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:54.955497 12392 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:54.963356 12243 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.992024 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:54.992080 10585 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:54.990410 12246 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.971756 12265 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:54.987788 12351 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.974758 12388 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.964918 12375 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.960917 12366 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:54.982493 12299 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:54.970383 12385 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.992741 12263 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.994300 12243 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.990758 12353 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:54.998428 12246 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.005304 12247 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.977097 12377 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:54.996107 12373 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.005405 10593 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:55.001008 12265 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.015647 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.001943 12259 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.032212 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.032740 10738 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:55.004681 12368 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.028748 10585 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:55.030180 12329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e245cc261b6415fac3d372489a49ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.011214 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:15:55.051365 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.035972 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.012665 12243 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:55.019227 12312 consensus_meta.cc:287] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.004s
I20260709 13:15:55.014806 12202 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.018028 12373 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.018695 12377 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.031294 12031 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.062597 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.063164 10738 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:55.063829 12109 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.054533 11413 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.065533 12031 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.015750 12263 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.001171 12392 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.017103 12353 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.070441 12109 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.006876 12351 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.010013 12394 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:15:55.075198 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.062135 12373 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.050632 12259 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.079334 10669 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:15:55.062665 12312 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.080449 10738 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:55.076982 12390 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.054411 12368 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.064167 12202 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.015257 12388 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.086436 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.078797 12382 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.085265 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.090246 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.091869 12343 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:55.088769 12299 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.093719 12202 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.098060 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.098717 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.103588 10662 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:55.104362 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.104548 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.105147 10668 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:55.105367 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.105458 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.105983 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.106045 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.106518 12263 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.107194 10668 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:55.107479 10664 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:55.107995 10668 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:55.108680 10664 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:55.104552 10666 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:55.102800 12264 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.099596 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.100103 10665 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:55.101727 12205 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.118227 12351 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.118391 12205 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.118933 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.119558 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:55.110580 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.089098 12258 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:55.121227 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.121182 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.125080 10593 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:55.123534 12109 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.126667 12190 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:55.127017 12152 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:55.127446 12152 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.127213 12190 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.127794 12152 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.097007 12382 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.110138 12299 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:55.129410 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.129665 12382 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.130206 12299 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.129277 12190 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.131006 12265 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.131770 12353 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.109974 12264 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.131942 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.132349 12366 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.133092 10667 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:15:55.133378 12265 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.101940 12386 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:55.119972 12262 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:55.102802 12343 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.134743 12386 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.136204 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.135916 12386 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.133637 12264 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.134799 12259 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.113000 12393 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.134155 12262 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.140936 12246 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.141934 12388 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.143603 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.143846 12368 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.144304 10660 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:55.146705 12248 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.148468 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.150141 10660 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.152297 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.153678 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.102232 10739 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:55.158789 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.155512 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:55.156533  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:15:55.209180 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56975.5us
I20260709 13:15:55.212239 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.212622 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:55.217905 10661 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.159369 11415 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:55.208882 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:55.149149 12393 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:55.214246 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58779.5us
I20260709 13:15:55.219187 10660 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:55.222204 10734 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.226262 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.126014 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.228543 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.228619 12205 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.213943 12265 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:55.231139 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.231323 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.210781 12181 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:55.229543 12392 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.213492 12248 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.234737 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.236454 10736 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.236745 10736 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.225265 12393 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.239600 10735 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:55.226955 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.227175 12368 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:55.251569 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.240250 10736 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.252775 10738 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:55.253422 10736 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.241557 12190 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.258409 12190 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.217183 11990 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.265341 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.235610 12265 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.239259 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.240476 12246 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.276095 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.277241 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:55.279515 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:55.282778 12403 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:15:55.283047 12190 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.269477 12247 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.250272 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.250269 12181 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:55.284456 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.285567 11417 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:55.286473 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.241200 12248 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:55.305153 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1057) took 1093 ms. Trace:
I20260709 13:15:55.305473 12255 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.305820 10589 rpcz_store.cc:276] 0709 13:15:54.212130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.212265 (+   135us) service_pool.cc:224] Handling call
0709 13:15:54.212568 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.212869 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.212897 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.213279 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.154414 (+941135us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b180028f960. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:15:55.218664 (+ 64250us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.218704 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.218762 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.287293 (+ 68531us) raft_consensus.cc:1685] finished
0709 13:15:55.287325 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.305061 (+ 17736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17486,"raft.queue_time_us":433,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":11191680,"thread_start_us":64096,"threads_started":1,"wal-append.queue_time_us":1013165}
I20260709 13:15:55.307823 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.283675 12247 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:55.239126 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 124223us
I20260709 13:15:55.308454 10589 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:55.318104 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.320122 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.322029 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.316162 12248 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.325796 12247 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.326638 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.327575 10589 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:55.329268 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.285183 12246 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.335165 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.281297 12265 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.261477 11414 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:55.342762 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.260927 12368 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.339896 10661 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:55.340914 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.343943 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:55.338821 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.308337 10739 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:55.319680 11410 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:55.278740 12311 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:55.347975 12401 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:15:55.342698 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.348869 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.337389 12246 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.346832 11417 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:55.354470 10591 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:55.346469 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.250020 12262 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:55.367833 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 143777us
I20260709 13:15:55.359210 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.355993 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.363097 12181 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.364799 10662 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:55.365562 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.366593 12152 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.366734 11413 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:55.342379 12343 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.356596 12109 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:55.387629 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:55.370898 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.371856 10593 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:55.362530 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.356575 12388 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.387820 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.369148 10738 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:55.389169 10591 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:55.390350 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:55.364897 11990 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.392835 12368 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.394233 12311 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.394872 12152 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.395222 12243 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.399207 10736 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:55.409261 12359 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:55.372455 10739 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:55.404961 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.453862 10591 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:15:55.408656 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.364967 12376 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.372223 12270 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.460919 10585 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:55.438885 12247 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.444644 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.403165 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.464589 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.464715 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.465142 10591 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.465807 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.467788 10593 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.388741 12366 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.438259 12262 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.471107 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.469707 12393 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.479909 10591 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:15:55.480777 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 77720.6us
I20260709 13:15:55.481740 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.404315 12388 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.449976 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.404912 12353 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:55.411346 12197 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:15:55.463745 12247 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.476163 12366 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.476351 12359 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.458827 12373 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.490254 12152 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.502113 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.491017 12388 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.493486 12311 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.470618 12377 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.499917 11411 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:55.495247 12164 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:55.504680 11412 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.006s
I20260709 13:15:55.476193 12270 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.497713 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.498746 12366 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.497530 12247 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.513650 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.504076 12353 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:55.516021 10706 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.503228 12152 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:55.508028 12197 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:55.509770 12164 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.520430 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:55.522413 12248 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:55.523229 12409 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:15:55.522845 12353 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.526116 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1056) took 1358 ms. Trace:
I20260709 13:15:55.509965 12311 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.544128 12311 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.518208 12382 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:55.545554 12179 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.549762 12243 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.550006 12393 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.521880 12385 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.551676 12377 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.519305 12152 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.553727 10734 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:15:55.521379 12372 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:15:55.528026 11412 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:55.522210 12164 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.558509 12372 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.559866 10743 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:55.526708 10594 rpcz_store.cc:276] 0709 13:15:54.167451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.169883 (+  2432us) service_pool.cc:224] Handling call
0709 13:15:54.198255 (+ 28372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.200318 (+  2063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.200350 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.203803 (+  3453us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.361907 (+1158104us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b18003af9c0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:15:55.438258 (+ 76351us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.438313 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.438396 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.525616 (+ 87220us) raft_consensus.cc:1685] finished
0709 13:15:55.525642 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.526017 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5190,"raft.queue_time_us":7163,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":18046,"spinlock_wait_cycles":18722688,"thread_start_us":76141,"threads_started":1,"wal-append.queue_time_us":1265581}
I20260709 13:15:55.516518 12376 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.520565 12386 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:55.533589 12359 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.542150 12373 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.553020 12385 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.561583 12248 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.569974 12386 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.575235 12386 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:55.576915 12328 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.738s	user 0.006s	sys 0.008s
I20260709 13:15:55.581264 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 88) took 2286 ms. Trace:
I20260709 13:15:55.581630 10663 rpcz_store.cc:276] 0709 13:15:53.295217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.295373 (+   156us) service_pool.cc:224] Handling call
0709 13:15:53.295612 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.393456 (+ 97844us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:53.439416 (+ 45960us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.605256 (+165840us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.605651 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.605841 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:53.606717 (+   876us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.606918 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.626053 (+ 19135us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800055720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc522 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:15:54.329998 (+703945us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400181354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:54.330067 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.576428 (+1246361us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:15:55.581073 (+  4645us) raft_consensus.cc:1685] finished
0709 13:15:55.581095 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.581211 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52187,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":3509,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":17059,"spinlock_wait_cycles":235986560,"thread_start_us":157068,"threads_started":1,"wal-append.queue_time_us":310570}
I20260709 13:15:55.584301 10489 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 195) took 7722 ms. Trace:
I20260709 13:15:55.561262 12372 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.571520 12265 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.588994  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:55.590010 12372 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.589901 10491 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:15:55.591917 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.594832 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 259) took 1731 ms. Trace:
I20260709 13:15:55.595191 11418 rpcz_store.cc:276] 0709 13:15:53.864096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.864338 (+   242us) service_pool.cc:224] Handling call
0709 13:15:54.267293 (+402955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.267883 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.594677 (+1326794us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540011f150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:55.594788 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925497216}
I20260709 13:15:55.595706 12366 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.598729 12246 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.605908 12262 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:55.609186 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.608179 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:55.616993 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.617725 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.619127 10588 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.581096 12164 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.577126 12247 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.621526 10740 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.623246 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:55.624293 10593 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:55.625638 12390 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:55.625972 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.626297 12390 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:55.626947 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.628206 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.630404 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.584674 10489 rpcz_store.cc:276] 0709 13:15:47.861490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.861662 (+   172us) service_pool.cc:224] Handling call
0709 13:15:48.809362 (+947700us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:15:55.584245 (+6774883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.301415 (+     0us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b540041b828. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d6759e1 00007f425d67464c 00007f425ad03adc 00007f425acef0a6 00007f425aceed58 00007f425acf39f1 00007f425acf39a9 00007f425acf3939 00007f425acf3901 00007f425acf2b2d 000000000038f354
0709 13:15:52.301502 (+    87us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.302069 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.302116 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:15:52.302129 (+    13us) tablet.cc:662] Decoding operations
0709 13:15:52.302784 (+   655us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.302835 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.302864 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:52.369023 (+ 66159us) tablet.cc:701] Row locks acquired
0709 13:15:52.373199 (+  4176us) write_op.cc:260] PREPARE: finished
0709 13:15:52.425122 (+ 51923us) write_op.cc:270] Start()
0709 13:15:52.461211 (+ 36089us) write_op.cc:276] Timestamp: P: 1783602952413876 usec, L: 0
0709 13:15:52.461240 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.461838 (+   598us) log.cc:844] Serialized 2049 byte log entry
0709 13:15:52.754848 (+293010us) op_driver.cc:464] REPLICATION: finished
0709 13:15:52.756327 (+  1479us) write_op.cc:301] APPLY: starting
0709 13:15:52.756388 (+    61us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:52.776370 (+ 19982us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:52.777023 (+   653us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:53.340202 (+563179us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5c0009648c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d4ab331 00007f425d4ab221 00007f425d4a5f6c 00007f425ac0630b 00007f425ac05fd3 00007f425ad04e34 00007f425acf097c 00007f425acf4d61 00007f425acf4d19 00007f425acf4ca9 00007f425acf4c71
0709 13:15:53.340644 (+   442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:53.340830 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:53.340880 (+    50us) write_op.cc:312] APPLY: finished
0709 13:15:53.341098 (+   218us) log.cc:844] Serialized 47 byte log entry
0709 13:15:53.353857 (+ 12759us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.353949 (+    92us) write_op.cc:454] Released schema lock
0709 13:15:53.353994 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:53.370108 (+ 16114us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.370141 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3729,"reported_tablets":12,"spinlock_wait_cycles":1883295488,"child_traces":[["op",{"apply.queue_time_us":1229,"apply.run_cpu_time_us":17180,"apply.run_wall_time_us":613726,"num_ops":5,"prepare.queue_time_us":97472,"prepare.run_cpu_time_us":40387,"prepare.run_wall_time_us":301278,"raft.queue_time_us":95723,"raft.run_cpu_time_us":1574,"raft.run_wall_time_us":1574,"replication_time_us":293427,"spinlock_wait_cycles":35623424,"thread_start_us":239314,"threads_started":4,"wal-append.queue_time_us":134593,"wal-append.run_cpu_time_us":28116,"wal-append.run_wall_time_us":1748979}]]}
I20260709 13:15:55.584686 12388 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.659461 10740 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:55.631959 12392 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:55.661990 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.662928 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.664927 10740 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.666145 10588 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:55.634262 12262 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.681898 12329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44884 (request call id 258) took 2247 ms. Trace:
I20260709 13:15:55.682288 12329 rpcz_store.cc:276] 0709 13:15:53.438789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.447009 (+  8220us) service_pool.cc:224] Handling call
0709 13:15:53.854726 (+407717us) ts_tablet_manager.cc:934] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
0709 13:15:54.998898 (+1144172us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:15:55.540258 (+541360us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:55.540362 (+   104us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:15:55.681128 (+140766us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:15:55.681411 (+   283us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:55.681760 (+   349us) ts_tablet_manager.cc:989] Replica registered.
0709 13:15:55.681811 (+    51us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":46090,"tablet-copy.queue_time_us":266177,"thread_start_us":322473,"threads_started":2}
I20260709 13:15:55.683182 10740 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:55.684381 12262 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.631312 12202 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:55.687719 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.687969 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.688282 10740 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:55.683660 12329 tablet_copy_client.cc:806] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.690002 12329 tablet_copy_client.cc:670] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.690891 12246 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.693765 12247 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.694020 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.695200 12164 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.663961 12392 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:55.697366 12392 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.697506 12386 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.696064 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:55.696287 12270 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:55.704191 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 78159.2us
I20260709 13:15:55.705348 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:55.706521 12246 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:55.706622 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:55.706930 12246 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.707273 12246 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.707608 12402 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.708114 12402 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.708532 12402 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.702757 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.664222 12366 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.717684 10740 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:55.676523 12348 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.720999 12377 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:55.722164 12376 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.722527 12377 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:55.715991 12374 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:55.717382 12247 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:55.720490 12348 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:55.724841 12377 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.722736 12152 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.775460 12152 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.785789 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.787426 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.788703 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:55.775525 12422 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:15:55.745544 12366 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.798454 10743 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.762766 12374 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:55.808588 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:55.773254 12226 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.725009 12376 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.817425 12386 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.818222 12376 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.819067 12031 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.809217 12366 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:55.819794 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.763919 12247 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.832561 12366 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.833199 12427 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.833930 12427 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.834853 12402 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.836606 12427 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.837196 11416 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:55.837805 12246 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.839900 12246 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.822410 12385 raft_consensus.cc:993] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: : Instructing follower e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:55.845196 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1061) took 1147 ms. Trace:
I20260709 13:15:55.845708 10587 rpcz_store.cc:276] 0709 13:15:54.697854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.699256 (+  1402us) service_pool.cc:224] Handling call
0709 13:15:54.699496 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.748671 (+ 49175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.748702 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.761978 (+ 13276us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.782351 (+1020373us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b180038a220. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:15:55.808134 (+ 25783us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.808189 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.808278 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.831938 (+ 23660us) raft_consensus.cc:1685] finished
0709 13:15:55.831956 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.845114 (+ 13158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53047,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":16332,"spinlock_wait_cycles":6903168,"thread_start_us":71532,"threads_started":2,"wal-append.queue_time_us":1066593}
I20260709 13:15:55.822556 12376 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:55.830798 12348 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.850533 12348 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:55.844035 12423 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:55.855654 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.856081 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.856750 10589 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.837131 12377 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.855329 12432 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:55.851887 12366 raft_consensus.cc:1081] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Signalling peer e71e2e44af1e46d8a8423ae08646bc22 to start an election
I20260709 13:15:55.868391 10589 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:55.859586 12402 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:55.869762 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1348) took 1707 ms. Trace:
I20260709 13:15:55.871173 10743 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:55.872818 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.873479 10587 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:55.873972 10587 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:15:55.858785 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 730396us
I20260709 13:15:55.872278 10737 rpcz_store.cc:276] 0709 13:15:54.161921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.243876 (+ 81955us) service_pool.cc:224] Handling call
0709 13:15:54.469099 (+225223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.469882 (+   783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.869593 (+1399711us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540014b750. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:55.869713 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517100928}
I20260709 13:15:55.855504 12376 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.872869 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.878856 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.880659 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.881244 10743 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.881654 12247 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:55.884102 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.885838 12329 tablet_copy_client.cc:538] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:55.886343 12392 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.887502 10594 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:55.857993 12374 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.885098 12350 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:55.874897 10587 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:55.916843 10587 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.917287 11418 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:55.887804 12360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.017s	sys 0.012s
I20260709 13:15:55.920450 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.921016 10591 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.921804 10743 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:15:55.925500 11418 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:15:55.920158 12360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.017s	sys 0.012s
I20260709 13:15:55.926206 12377 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.918668 12247 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:55.932161 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.934010 10587 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:15:55.937165 10591 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:15:55.931392 12246 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:15:55.922760 12350 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:55.942541 12392 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.942680 12376 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.943949 11382 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.945343 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:55.942613 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.948158 10587 pending_rounds.cc:85] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 2
I20260709 13:15:55.948526 10743 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:55.921607 12427 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:55.930325 12360 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:55.953188 10588 raft_consensus.cc:2368] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:55.950490 12247 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:55.952316 12426 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:15:55.953534 10587 pending_rounds.cc:107] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:15:55.957082 10587 raft_consensus.cc:2889] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.958379 12334 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:55.958634 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1345) took 2020 ms. Trace:
I20260709 13:15:55.958776 12334 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:55.959056 10742 rpcz_store.cc:276] 0709 13:15:53.938660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.939467 (+   807us) service_pool.cc:224] Handling call
0709 13:15:53.939773 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.781445 (+841672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.958424 (+1176979us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54001ccd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:55.958583 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932753664}
W20260709 13:15:55.959836 12435 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:15:55.955118 12427 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:55.961066 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:55.961889 10742 raft_consensus.cc:2368] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:55.962512 10737 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:55.962512 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.964282 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:55.960260 12245 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.970988 10742 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.969738 11382 leader_election.cc:400] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:55.956833 12392 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:55.974593 12440 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.973382 11382 leader_election.cc:403] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.974678 12245 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:55.978044 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.988051 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:55.991593 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1059) took 1301 ms. Trace:
I20260709 13:15:55.976212 10743 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:55.977770 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:55.954936 12350 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:55.999130 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:55.964085 12427 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:56.107723 10587 raft_consensus.cc:2368] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:55.995808 10592 rpcz_store.cc:276] 0709 13:15:54.690045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.690491 (+   446us) service_pool.cc:224] Handling call
0709 13:15:54.699191 (+  8700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.739724 (+ 40533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.739756 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.740355 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.783224 (+1042869us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b180038a2e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:15:55.825592 (+ 42368us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:55.825637 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.825700 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.982594 (+156894us) raft_consensus.cc:1685] finished
0709 13:15:55.982612 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.991535 (+  8923us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45680,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3017,"spinlock_wait_cycles":8822912,"thread_start_us":82405,"threads_started":2,"wal-append.queue_time_us":1131239}
I20260709 13:15:55.956722 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.137771 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.109594 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 114) took 1372 ms. Trace:
I20260709 13:15:56.138187 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.167721 10663 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:15:56.138571 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.138996 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.170356 12416 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.171128 12416 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.172962 10661 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:56.173862 12416 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:55.982177 12408 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.164889 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:56.177546 10588 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:55.970316 12226 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:56.175155 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 189285us
W20260709 13:15:56.131589 12439 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:15:56.167057 10741 rpcz_store.cc:276] 0709 13:15:54.736829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.736971 (+   142us) service_pool.cc:224] Handling call
0709 13:15:55.958184 (+1221213us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:55.996112 (+ 37928us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194e9c 00007f4254194a5b 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:55.996327 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.996534 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.996569 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.109200 (+112631us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:56.109274 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.109384 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.109521 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13745792}
I20260709 13:15:56.194375 10743 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.134507 10593 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.180096 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.185796 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.198359 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.199637 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.186618 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.201385 10664 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.201059 10669 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.190331 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.208030 10662 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.979941 12255 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.191395 10665 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.132380 12392 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:56.210855 10668 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:56.164654 12299 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.222234 12299 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.223265 10741 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.224824 12299 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:56.225790 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.229763 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.233695 10741 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:56.174783 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:56.232826 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.239306 10668 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.992762 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:56.178512 12246 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:56.211957 12426 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:56.176498 12348 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:56.235304 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.242254 10743 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:56.253425 10738 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.256498 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.179764 12181 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.257512 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.233290 12169 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.245471 10669 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.262993 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:15:56.175097 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 205513us
I20260709 13:15:56.268752 12342 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:15:56.239558 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 284995us
I20260709 13:15:56.226446 12255 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.258657 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.181092 12247 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.260725 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.235435 12226 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:56.270673 10669 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:56.254889 10668 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.246132 10664 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:56.247978 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:56.248344 12438 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:56.280418 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:56.236720 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.283442 10666 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.195358 12408 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.286392 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.294303 10668 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.261958 12348 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.287132 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:56.260592 12181 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.255522 12426 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.268420 12299 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.289439 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:56.339303 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49923.5us
I20260709 13:15:56.340708 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.290194 10665 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.279863 12432 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.274845 12440 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.295774 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.286358 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.284884 12366 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.267764 12169 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.293926 12376 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:15:56.336417 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49321.7us
I20260709 13:15:56.305176 10668 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:15:56.375993 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1009) took 1155 ms (client timeout 1520 ms). Trace:
I20260709 13:15:56.376781 10737 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:56.380482 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.377393 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 100) took 1278 ms. Trace:
I20260709 13:15:56.378417 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1011) took 1157 ms. Trace:
I20260709 13:15:56.381986 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.382951 10668 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:56.299612 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.287681 12377 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:56.380343 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:56.380414 10734 rpcz_store.cc:269] 0709 13:15:55.220744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.225979 (+  5235us) service_pool.cc:224] Handling call
0709 13:15:56.375775 (+1149796us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540014c154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:56.375916 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750852352}
I20260709 13:15:56.395116 10665 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.395938 10662 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:56.396991 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.384008 10664 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.297876 12270 raft_consensus.cc:2764] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:56.386449 10666 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.381660 10667 rpcz_store.cc:276] 0709 13:15:55.099291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.099395 (+   104us) service_pool.cc:224] Handling call
0709 13:15:56.377221 (+1277826us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54003b3154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:56.377343 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45192960}
I20260709 13:15:56.403508 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.397257 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.384897 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.287822 12342 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.399986 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.403580 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.389139 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:56.457497 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 68453.6us
I20260709 13:15:56.458420 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:56.407436 10664 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:15:56.398236 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 105160us
I20260709 13:15:56.459877 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.378744 12329 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
W20260709 13:15:56.463433 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 48165.4us
I20260709 13:15:56.460610 12190 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.344786 12343 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.473344 10669 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:56.379247 12179 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.377179 12408 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.288627 12392 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.399641 12259 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.472532 12315 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.991814 12360 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.342876 12416 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.481974 12179 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.374460 12426 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.479624 12343 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.381075 12432 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.456149 12342 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.399464 12376 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:56.486570 12375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.376s	user 0.055s	sys 0.068s
I20260709 13:15:56.501971 12255 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:56.492017 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 215078us
I20260709 13:15:56.474929 12226 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.484644 12258 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:56.502964 12341 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.493964 12408 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.498497 12299 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.529861 12416 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:56.400472 12366 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.409531 12377 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.507234 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.487718 12386 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.489813 12388 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:56.293728 12438 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:56.486291 12441 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.473285 12440 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.526666 12343 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:56.533885 12375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.055s	sys 0.068s
W20260709 13:15:56.553534 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 95225.6us
I20260709 13:15:56.577513 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:56.495893 12327 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:56.532650 12342 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.579229 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.582858 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:56.584203 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.585279 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:15:56.555014 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 83811.9us
I20260709 13:15:56.506258 12179 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:56.556644 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 95256.6us
I20260709 13:15:56.554448 12258 consensus_queue.cc:1243] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:56.556392 12341 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.587081 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.556264 12408 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:56.574582 12442 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:15:56.557195 12299 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.598651 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.605131 12441 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.605810 12441 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.608456 12441 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:56.613131 12443 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:15:56.615217 12438 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.637696 12416 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.583312 12348 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:56.589457 12388 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.593395 12385 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.594406 12341 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.648742 10589 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.661204 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:56.645475 10559 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.601804 12312 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.651865 10590 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:56.593888 12315 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.664568 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.650712 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:56.677089 10587 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.679508  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.662720 10663 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:56.672065 10590 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:56.673240 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:56.674288 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:56.684801 10594 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:15:56.687644 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:56.686757 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:56.648111 12181 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:56.641045 12449 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.691996 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:56.748428 10588 raft_consensus.cc:2368] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:15:56.660951 11413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6"
dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:44884
I20260709 13:15:56.670496 12348 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.699136 10590 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.655601 12375 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.688582 11417 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:56.672551 12438 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.610126 12258 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 13:15:56.752351 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 153779us
I20260709 13:15:56.601442 11381 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:56.682312 12388 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.761556 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 179598us
I20260709 13:15:56.763057 10590 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.688089 12385 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.688251 12312 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.766144 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:15:56.771507 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 107027us
I20260709 13:15:56.777918 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:56.778296 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:56.778661 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:56.749145 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:56.783478 12315 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.784080 12468 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.784353 10590 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:56.755134 12181 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.786118 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:56.790512 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:56.792951 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 205971us
I20260709 13:15:56.794288 10587 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:56.797722 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:56.793658 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:56.776306 12441 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.777284 12264 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:56.771780 12432 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:56.787379 12452 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:56.788655 12438 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:56.804375 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.806849 12468 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.806900 12464 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.807723 12468 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.808627 12468 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.766875 12375 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.810837 12375 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.811272 12465 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.788270 12376 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:56.792869 12181 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.791913 12392 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:56.812431 12386 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.823022 12386 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.823907 12386 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.799710 12457 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:56.777091 12388 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.797209 12366 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:56.835109  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.817976 12465 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:56.812305 12438 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:56.836733 12438 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.837157 12465 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.850971 12348 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.852066 12348 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.776984 12334 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.854974 12334 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.855396 12179 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.842048 12190 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.857995 10666 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:15:56.802802 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 213674us
I20260709 13:15:56.820129 12181 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.826305 12377 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.833666 12327 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.826928 12392 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:56.893718 10663 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.841342 12385 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.812562 12264 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.878548 12366 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:56.929486 10663 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
W20260709 13:15:56.932651 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 139043us
I20260709 13:15:56.887605 12392 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.933881 10632 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.937204 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.937340 10734 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:15:56.937891 10736 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:56.938263 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.834563 12315 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.818950 12452 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.940523 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.925582 12366 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.940725 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.942507 10736 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:56.943068 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.846463 12312 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.842913 12457 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.933598 12468 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.944434 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:56.924615 12459 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.946233 12179 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:56.927327 12449 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:56.933118 12440 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.956995 10736 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:56.958766 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:56.923959 12426 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:56.944128 12453 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.948683 12366 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:56.980131 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 1.0305e+06us
I20260709 13:15:56.983345 10589 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:56.960352 12416 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:56.963169 12459 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:56.954276 12468 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:56.990497 11413 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:56.988499 12264 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:56.986510 12476 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.994393 12350 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:57.013655 10741 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:56.977684 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:56.999841 12388 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.009660 11413 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:57.019845 11379 leader_election.cc:400] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5.
I20260709 13:15:57.024339 10632 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:57.004619 12416 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.025260 10632 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:57.025576 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.026288 10736 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:57.027022 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.027669 10736 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:57.029330 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:57.013453 12452 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.023072 12438 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.033638 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.038414 10589 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
I20260709 13:15:57.039165 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.039916 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.035326 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.035772 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.036989 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:57.041512 10738 raft_consensus.cc:606] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:57.041905 10738 raft_consensus.cc:614] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.042593 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:57.044806 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:57.045531 10738 raft_consensus.cc:606] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:57.045931 10738 raft_consensus.cc:614] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.017961 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.000168 12475 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:15:57.051513 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.023639 12476 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:57.028261 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.066912 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.069715 10588 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.030481 12250 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.071375 10589 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.020143 12459 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.076731 12265 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:57.076999 12474 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:57.049451 12179 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.065482 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:57.037853 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 71521.7us
I20260709 13:15:57.082321 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.032002 12190 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:57.020479 12350 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.009853 12449 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.074020 11414 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:57.086505 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:57.088824 10738 raft_consensus.cc:606] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:57.089234 10738 raft_consensus.cc:614] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.052552 12453 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:57.094039 12264 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.094636 12179 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:57.095041 12179 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.095252 12467 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:57.095357 12179 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.095733 12467 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:57.097646 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:57.082321 12457 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.096581 12467 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.102613 10738 raft_consensus.cc:606] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:57.104389 10738 raft_consensus.cc:614] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:57.107293 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.107431 12416 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.108469 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:57.107993 11413 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:57.110050 12342 consensus_meta.cc:287] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.514s	user 0.004s	sys 0.005s
I20260709 13:15:57.110380 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.111550 11415 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 7. Ops: []
I20260709 13:15:57.113142 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.114180 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.113567 12392 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.114745 10661 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 1.
I20260709 13:15:57.115552 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.112973 10559 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:57.122498 12452 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.122888 12452 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:57.123241 12452 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.124601 10667 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:57.125355 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.125869 10667 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:57.119609 10559 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:57.128845 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:57.114763 12467 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.113521 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.105983 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:57.129987 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.130646 10667 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:15:57.127722 12265 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.131265 12265 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.133176 12265 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.133805 12468 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:57.105520 12426 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.123603 12392 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:57.130085 12477 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:57.124161 11410 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:57.127734 12475 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.116501 12476 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.168020 12179 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.166782 10736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:15:57.182286 10736 raft_consensus.cc:606] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:57.135061 12470 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.110432 12342 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:57.180203 11416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 312) took 1388 ms (client timeout 1586 ms). Trace:
I20260709 13:15:57.167264 12360 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.192198 12350 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:57.192337 12360 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:57.179090 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.192766 12360 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.181418 12482 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:15:57.184080 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:57.176445 12440 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.173897 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:57.194494  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:57.195601 10667 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:15:57.191191 11416 rpcz_store.cc:269] 0709 13:15:55.791796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.791960 (+   164us) service_pool.cc:224] Handling call
0709 13:15:57.179991 (+1388031us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b540043f8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.180152 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58476800}
W20260709 13:15:57.198750 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.200294 10665 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:15:57.202968 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.190675 12438 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.134558 12341 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.179401 12366 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.197871 12353 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:57.209348 12179 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.211571 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.211932 10743 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:57.202270 12334 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:57.209817 12342 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.196254 12440 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.215982 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:57.217837 10667 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.210417 12353 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:57.213230 12334 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.225385 12299 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.223093 12440 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.223536 11413 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.180959 12475 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.278957 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 213) took 1172 ms. Trace:
I20260709 13:15:57.279605 12475 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:57.279484 11410 rpcz_store.cc:276] 0709 13:15:56.106781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.134275 (+ 27494us) service_pool.cc:224] Handling call
0709 13:15:57.023374 (+889099us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:57.278713 (+255339us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5400556ed4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.278874 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109801600}
I20260709 13:15:57.283072 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:57.284096 10667 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:57.285867 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:57.287684 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:57.288538 12438 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:57.288599 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.289194 12438 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:57.289551 10592 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:57.274685 12181 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.290346 12438 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.290880 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:57.291389 12343 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.711s	user 0.002s	sys 0.008s
I20260709 13:15:57.291791 12343 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.292279 12181 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.292644 12226 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.293022 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:57.293113 12226 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.293613 10667 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:57.295478 12226 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.237470 12334 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.198421 12470 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.301661 12343 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.298559 12299 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:57.296892 12452 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.306517 10667 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:15:57.307207 12299 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.325465 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 282902us
I20260709 13:15:57.328617 10661 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:57.322335 12343 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.323258 12299 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:57.331377 10635 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:57.332495 10635 leader_election.cc:403] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.336477 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:57.301028 12353 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.339104 10667 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:15:57.349962 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.351665 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.352391 10736 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.336011 12341 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.356601 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:57.356840 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:57.331099 12366 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:57.358537 10734 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:15:57.357641 12459 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:57.331771 12181 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:15:57.361752 12327 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:57.345831 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:57.366250 12327 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.366600 12327 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:57.361042 10667 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:57.332336 12343 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.367825 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1694) took 1182 ms. Trace:
I20260709 13:15:57.368165 10667 rpcz_store.cc:276] 0709 13:15:56.185030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.360600 (+1175570us) service_pool.cc:224] Handling call
0709 13:15:57.360901 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.367608 (+  6707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.367777 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.369024 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.369923 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1696) took 1177 ms. Trace:
I20260709 13:15:57.370253 10667 rpcz_store.cc:276] 0709 13:15:56.192983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.369213 (+1176230us) service_pool.cc:224] Handling call
0709 13:15:57.369514 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.369658 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.369681 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.369717 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:57.369743 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.369798 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.369879 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.370869 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.371366 10734 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.371723 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1701) took 1131 ms. Trace:
I20260709 13:15:57.372053 10667 rpcz_store.cc:276] 0709 13:15:56.240344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.371054 (+1130710us) service_pool.cc:224] Handling call
0709 13:15:57.371303 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.371442 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.371466 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.371514 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:57.371541 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.371588 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.371679 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.374404 12452 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.376003 12470 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.376380 12427 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.377530 12427 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:57.378438 10740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1358) took 1790 ms (client timeout 1990 ms). Trace:
I20260709 13:15:57.364362 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:57.361089 12353 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.610082 10734 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:57.611212 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.611800 10734 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
W20260709 13:15:57.612668 10587 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.005s	sys 0.013s
W20260709 13:15:57.388098 10740 rpcz_store.cc:269] 0709 13:15:55.587664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.689011 (+101347us) service_pool.cc:224] Handling call
0709 13:15:57.378271 (+1689260us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540014cb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.378388 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41392896}
I20260709 13:15:57.365109 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:57.615756 10590 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.373217 10667 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.616663 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1325) took 1353 ms. Trace:
I20260709 13:15:57.616997 10667 rpcz_store.cc:276] 0709 13:15:56.263261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.372824 (+1109563us) service_pool.cc:224] Handling call
0709 13:15:57.373074 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.616420 (+243346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.616616 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:57.478641 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.613533 10736 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:57.379920 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:57.618323 10592 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.612741 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.619457 10734 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:57.618430 10587 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.005s	sys 0.013s
W20260709 13:15:57.621765 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.633739 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.377983 12169 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.653957 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.664651 10740 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:15:57.654724 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 290413us
I20260709 13:15:57.663475 10734 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:57.614825 12343 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.679754 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.680716 10589 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:57.645452 12226 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.669699 12451 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:57.691996 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:57.688676 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:57.674464 12306 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.674701 12488 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.683149 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:57.707677 10667 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:57.717796 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1326) took 1433 ms. Trace:
I20260709 13:15:57.718186 10667 rpcz_store.cc:276] 0709 13:15:56.284608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.706925 (+1422317us) service_pool.cc:224] Handling call
0709 13:15:57.707279 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.717494 (+ 10215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.717735 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.671852 12169 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:15:57.719863 12501 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.373s	user 0.000s	sys 0.000s
W20260709 13:15:57.712291 12360 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.519s	user 0.002s	sys 0.007s
I20260709 13:15:57.687026 12226 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.716732 12306 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:57.739413 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 349151us
I20260709 13:15:57.745107 10590 raft_consensus.cc:2410] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:57.746495 10590 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.750437 12366 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.750939 12366 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.752436 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1580) took 2144 ms. Trace:
I20260709 13:15:57.753000 12366 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:57.755028 10594 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:57.754812 10734 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.757535 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.758208 10734 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:57.760216 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.763114 10734 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:57.765443 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1700) took 1529 ms. Trace:
I20260709 13:15:57.765889 10666 rpcz_store.cc:276] 0709 13:15:56.236043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.506919 (+270876us) service_pool.cc:224] Handling call
0709 13:15:57.765227 (+1258308us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540012f054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.765373 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690824960}
I20260709 13:15:57.776187 12366 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.776764 12366 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.780431 12475 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:57.780966 12475 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.783210 12475 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.791927 10632 leader_election.cc:400] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:57.792371 10632 leader_election.cc:403] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:57.752899 10593 rpcz_store.cc:276] 0709 13:15:55.607791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.629124 (+ 21333us) service_pool.cc:224] Handling call
0709 13:15:57.752208 (+2123084us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54001e50d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.752335 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157969664}
I20260709 13:15:57.828892  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:57.823748 10632 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:57.836623 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:57.842263 12217 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.842518 12226 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.842880 11410 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:57.842772 12217 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.848500 12327 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.850214 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1682) took 1668 ms. Trace:
I20260709 13:15:57.867398 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 268) took 2171 ms. Trace:
I20260709 13:15:57.869307 11418 rpcz_store.cc:276] 0709 13:15:55.695722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.695860 (+   138us) service_pool.cc:224] Handling call
0709 13:15:57.867243 (+2171383us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540017c5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.867342 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437579008}
I20260709 13:15:57.871079 10660 rpcz_store.cc:276] 0709 13:15:56.181516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.187483 (+  5967us) service_pool.cc:224] Handling call
0709 13:15:57.112089 (+924606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.112246 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.112269 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.112304 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:57.112330 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.112381 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.850037 (+737656us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54003aacd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:57.850137 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125589248}
I20260709 13:15:57.820175 12247 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.885165 10660 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.845112 12217 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.884379 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:57.732333 12360 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.721482 12488 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:57.831001 12499 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:15:57.888597 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1329) took 1596 ms. Trace:
I20260709 13:15:57.893301 10660 rpcz_store.cc:276] 0709 13:15:56.292478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.884512 (+1592034us) service_pool.cc:224] Handling call
0709 13:15:57.884926 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.888362 (+  3436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.888545 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.851892 12245 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.830875 12181 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.894762 10660 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:57.926504 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1333) took 1629 ms. Trace:
I20260709 13:15:57.853638 12408 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.926832 10660 rpcz_store.cc:276] 0709 13:15:56.297068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.894293 (+1597225us) service_pool.cc:224] Handling call
0709 13:15:57.894600 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.926250 (+ 31650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.926434 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.867837 12169 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.935259 12181 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.937793 12327 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.939270 10660 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.939985 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 106) took 1262 ms. Trace:
I20260709 13:15:57.940335 10660 rpcz_store.cc:276] 0709 13:15:56.677539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.938731 (+1261192us) service_pool.cc:224] Handling call
0709 13:15:57.939068 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.939702 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.939913 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.943092 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 109) took 1264 ms. Trace:
I20260709 13:15:57.943617 10660 rpcz_store.cc:276] 0709 13:15:56.678272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.941276 (+1263004us) service_pool.cc:224] Handling call
0709 13:15:57.942492 (+  1216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.942694 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.942731 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.942786 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:57.942831 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.942900 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.943034 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.944972 10592 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:57.941406 12169 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:57.946789 12169 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.947252 12334 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.000s
I20260709 13:15:57.947642 12334 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:57.938542 12181 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.951375 12360 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.953866 12334 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.958370 12169 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:57.960551 12169 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:57.894701 12502 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.971015 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:57.972257 11411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 209) took 1985 ms (client timeout 1933 ms). Trace:
I20260709 13:15:57.982816 10664 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:57.983687 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 112) took 1233 ms. Trace:
I20260709 13:15:57.984097 10664 rpcz_store.cc:276] 0709 13:15:56.750514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.982044 (+1231530us) service_pool.cc:224] Handling call
0709 13:15:57.982518 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.983369 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.983620 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.991608 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.992873 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:57.993496 10736 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:57.941746 12366 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:57.993929 10736 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:57.993398 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:15:57.995078 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.980973 12259 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:58.011188 12466 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:58.017293 12466 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.019411 12466 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:58.004689 12366 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.020550 12366 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.022953 12366 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:58.010025 10736 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.024466 10736 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:15:58.032732 10736 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:15:57.826359 12264 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:15:58.035043 10740 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:58.036805 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.040637 10740 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:57.804232 12495 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:57.972756 11411 rpcz_store.cc:269] 0709 13:15:55.986846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.108393 (+121547us) service_pool.cc:224] Handling call
0709 13:15:57.970761 (+1862368us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:57.972165 (+  1404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23232384}
I20260709 13:15:57.899374 12247 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.011715 12259 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:58.052510 12247 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:58.052999 12299 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 13:15:58.053133 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1360) took 2464 ms. Trace:
I20260709 13:15:58.056311 10737 rpcz_store.cc:276] 0709 13:15:55.588322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.966502 (+378180us) service_pool.cc:224] Handling call
0709 13:15:56.376605 (+410103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.381159 (+  4554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.052890 (+1671731us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540014c150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.053047 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942668032}
I20260709 13:15:58.065881 11382 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:58.061024 12255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.481s	user 0.007s	sys 0.026s
I20260709 13:15:58.059149 12299 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.095315 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:15:58.085988 12255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.508s	user 0.007s	sys 0.026s
I20260709 13:15:58.121783 12255 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:58.122440 12255 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.123453 12255 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.124704 12255 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:58.091441 12440 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.004s
I20260709 13:15:58.125682 12440 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.128338 12440 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.094125 12476 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:58.130239 12476 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.132789 12476 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:58.099750 12121 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:58.048720 12495 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.133723 12121 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:58.101871 12369 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:58.135236 12369 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.135582 12369 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.096840 12259 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.137476 12329 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:15:58.137980 12259 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.138414 12329 tablet_bootstrap.cc:492] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:15:58.139149 12329 ts_tablet_manager.cc:1403] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 1.761s	user 0.033s	sys 0.091s
W20260709 13:15:58.116145 12427 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.002s
I20260709 13:15:58.140435 12360 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.141028 12360 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.120009 12488 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:58.134895 12121 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.118747 12299 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:58.142297 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 372170us
I20260709 13:15:58.134992 12495 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:58.163578 12445 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:58.163126 12518 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:15:58.187497 12246 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:58.190577 12329 raft_consensus.cc:359] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:58.193243 12329 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:15:58.194242 12329 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:58.196709 12329 ts_tablet_manager.cc:1434] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.001s
W20260709 13:15:58.198701 10586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1566) took 2895 ms (client timeout 2232 ms). Trace:
W20260709 13:15:58.199203 10586 rpcz_store.cc:269] 0709 13:15:55.304000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.321674 (+ 17674us) service_pool.cc:224] Handling call
0709 13:15:58.198448 (+2876774us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003ff7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.198606 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3804534528}
W20260709 13:15:58.201241 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1334) took 1903 ms (client timeout 1984 ms). Trace:
W20260709 13:15:58.201719 10669 rpcz_store.cc:269] 0709 13:15:56.297377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.384668 (+ 87291us) service_pool.cc:224] Handling call
0709 13:15:58.201009 (+1816341us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b54000c4754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.201164 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154951040}
I20260709 13:15:58.203318 10669 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.203965 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1337) took 1368 ms. Trace:
I20260709 13:15:58.204329 10669 rpcz_store.cc:276] 0709 13:15:56.835910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.202605 (+1366695us) service_pool.cc:224] Handling call
0709 13:15:58.202929 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.203688 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.203908 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.206086 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1028) took 1266 ms. Trace:
I20260709 13:15:58.206537 10743 rpcz_store.cc:276] 0709 13:15:56.940067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.944245 (+  4178us) service_pool.cc:224] Handling call
0709 13:15:58.205880 (+1261635us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54003309d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.206020 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603487616}
W20260709 13:15:58.192220 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 107) took 1514 ms (client timeout 1691 ms). Trace:
W20260709 13:15:58.223321 10663 rpcz_store.cc:269] 0709 13:15:56.677831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.686354 (+  8523us) service_pool.cc:224] Handling call
0709 13:15:58.192007 (+1505653us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003b3154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.192139 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469890304}
I20260709 13:15:58.226356 10663 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.227137 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1339) took 1380 ms. Trace:
I20260709 13:15:58.227685 10663 rpcz_store.cc:276] 0709 13:15:56.846529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.225800 (+1379271us) service_pool.cc:224] Handling call
0709 13:15:58.226151 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.226867 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.227077 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.231194 10669 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.232189 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1338) took 1388 ms. Trace:
I20260709 13:15:58.232623 10669 rpcz_store.cc:276] 0709 13:15:56.843340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.205128 (+1361788us) service_pool.cc:224] Handling call
0709 13:15:58.230984 (+ 25856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.231929 (+   945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.232130 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.234521 10669 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:58.236765 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1345) took 1315 ms. Trace:
I20260709 13:15:58.237421 10669 rpcz_store.cc:276] 0709 13:15:56.921191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.233550 (+1312359us) service_pool.cc:224] Handling call
0709 13:15:58.234136 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.236403 (+  2267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.236708 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:58.246356 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 175228us
I20260709 13:15:58.229504 12466 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:58.252156 12518 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.252540 12518 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:58.253376 12518 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.254482 12518 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.236171 12369 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:58.296639 11417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 316) took 1281 ms. Trace:
I20260709 13:15:58.297060 11417 rpcz_store.cc:276] 0709 13:15:57.014824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.015112 (+   288us) service_pool.cc:224] Handling call
0709 13:15:57.847014 (+831902us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:15:57.847174 (+   160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.847490 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.847514 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.848411 (+   897us) log.cc:844] Serialized 548 byte log entry
0709 13:15:58.169732 (+321321us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:58.169785 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.169870 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.296337 (+126467us) raft_consensus.cc:1685] finished
0709 13:15:58.296355 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.296581 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5992192,"thread_start_us":321038,"threads_started":1,"wal-append.queue_time_us":397627}
I20260709 13:15:58.251365 12466 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:58.302208 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.337020 12525 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:58.345620 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1343) took 1448 ms. Trace:
I20260709 13:15:58.346194 10663 rpcz_store.cc:276] 0709 13:15:56.896863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.228571 (+1331708us) service_pool.cc:224] Handling call
0709 13:15:58.228860 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.229094 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:58.340673 (+111579us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.345242 (+  4569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.345296 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.345361 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.345432 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.345564 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114394,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"thread_start_us":97389,"threads_started":2,"wal-append.queue_time_us":4573}
W20260709 13:15:58.378367 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.614827 12259 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.615398 12259 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.617934 12259 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:58.618040 10587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.043s	sys 0.073s
W20260709 13:15:58.618506 10587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.044s	sys 0.073s
I20260709 13:15:58.619187 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1089) took 1536 ms. Trace:
I20260709 13:15:58.619539 10587 rpcz_store.cc:276] 0709 13:15:57.083007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.084763 (+  1756us) service_pool.cc:224] Handling call
0709 13:15:57.085005 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.085183 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:57.620564 (+535381us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.618909 (+998345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.618946 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:58.618971 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.619017 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.619140 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21772,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":123,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1530699,"threads_started":2,"wal-append.queue_time_us":548873}
W20260709 13:15:58.647053 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 810433us
I20260709 13:15:58.649305 12453 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.649541 10632 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.650830 12453 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.651247 12453 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.651238 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.652570 12190 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.652330 12453 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.653386 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.653788 12415 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.657796 12415 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:58.657967 12453 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.658242 12415 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.666035 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:58.667186 12415 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.668193 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.669342 12415 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.671238 12415 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:58.671617 12415 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.679294 12415 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.682443 12190 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.684103 12456 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.685528 12456 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:58.686827 12456 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:58.687021 12415 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.683770 12190 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.688460 12369 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:58.688989 12415 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:58.680119 12465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.840s	user 0.012s	sys 0.002s
W20260709 13:15:58.689527 12465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.013s	sys 0.002s
I20260709 13:15:56.381815 10735 rpcz_store.cc:276] 0709 13:15:55.221142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.266842 (+ 45700us) service_pool.cc:224] Handling call
0709 13:15:55.291618 (+ 24776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.308014 (+ 16396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.308046 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.319379 (+ 11333us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.382078 (+ 62699us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.382136 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.378023 (+995887us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b540014d554. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:56.378069 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.378114 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:56.378127 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.378358 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9674,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":5699,"spinlock_wait_cycles":36738816,"thread_start_us":57249,"threads_started":1,"wal-append.queue_time_us":65104,"wal-append.run_cpu_time_us":1153,"wal-append.run_wall_time_us":1001186}
I20260709 13:15:58.691725 12456 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.692638 12456 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.696556 10590 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:15:58.696908 10590 pending_rounds.cc:85] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 2
I20260709 13:15:58.697130 10590 pending_rounds.cc:107] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:15:58.697376 10590 raft_consensus.cc:2889] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:58.698346 12495 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:58.699395 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:58.699654 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.008s	sys 0.020s
W20260709 13:15:58.700217 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.008s	sys 0.020s
I20260709 13:15:58.700143 12495 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.702353 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.703166 10587 raft_consensus.cc:2393] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 2: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:15:58.705010 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.705576 10587 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.705863 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:58.706036 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1348) took 1711 ms (client timeout 2181 ms). Trace:
I20260709 13:15:58.706508 10586 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 1.
W20260709 13:15:58.706367 10661 rpcz_store.cc:269] 0709 13:15:56.994359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.115321 (+120962us) service_pool.cc:224] Handling call
0709 13:15:58.705869 (+1590548us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400322b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.705985 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488699776}
I20260709 13:15:58.712008 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.713372 10587 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:15:58.717092 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.717459 12450 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:58.717877 12450 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:58.717854 10587 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.718359 12450 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.722016 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.722560 10592 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:58.722695 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 475508us
I20260709 13:15:58.724855 12450 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.726787 12450 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:58.731727 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.732421 12518 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:58.733039 12466 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:58.732862 12518 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:58.734684 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.734805 12518 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.736338 12518 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.738756 12518 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.741173 12518 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:15:58.734820 10592 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:15:58.737643 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.742169 10593 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.744802 10668 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:15:58.745813 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.746397 10662 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:58.747730 12415 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.748988 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.750447 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.750989 10668 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
W20260709 13:15:58.751164 10559 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.006s	sys 0.010s
W20260709 13:15:58.751523 10559 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.010s
W20260709 13:15:58.751794 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 772895us
I20260709 13:15:58.753156 10663 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.753285 10666 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.753589 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.753698 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:58.754067 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.754321 10661 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.754247 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.755036 10668 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:58.748150 12415 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.757366 12415 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.757797 12306 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:58.758623 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.758852 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.759320 10669 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:58.759948 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:58.761453 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.761991 10735 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:58.765618 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.766829 10587 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:58.767051 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.768353 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.769814 10736 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:58.770678 10663 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:15:58.770953 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.771479 10737 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.773101 12007 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:58.773635 12007 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:58.774259 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.774628 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.774919 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.775516 12007 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:58.777580 12427 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:58.778045 12427 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.779896 12427 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.781134 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:15:58.781147 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.781737 11413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.012s	sys 0.016s
W20260709 13:15:58.781980 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.782080 11413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.012s	sys 0.016s
W20260709 13:15:58.782536 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.782902 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 218) took 1442 ms. Trace:
W20260709 13:15:58.783077 10560 connection.cc:256] RPC call timeout handler was delayed by -1.391014364000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 13:15:58.783429 12415 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:58.784219 12415 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.783299 11413 rpcz_store.cc:276] 0709 13:15:57.340008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.346151 (+  6143us) service_pool.cc:224] Handling call
0709 13:15:57.362539 (+ 16388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.362813 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:57.683892 (+321079us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.782443 (+1098551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.782505 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:58.782563 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.782668 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.782844 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":532236,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":49759,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":1384834,"threads_started":3,"wal-append.queue_time_us":498170}
I20260709 13:15:58.784888 12427 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:58.785017 12415 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.786178 10664 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:58.786785 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1336) took 1953 ms. Trace:
I20260709 13:15:58.786953 12427 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.787140 10664 rpcz_store.cc:276] 0709 13:15:56.833782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.985256 (+1151474us) service_pool.cc:224] Handling call
0709 13:15:58.785999 (+800743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.786566 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.786732 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.787907 12007 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.788491 12251 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.789019 12251 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.788259 12007 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:58.791285 12251 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.791115 12007 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.792395 12007 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.796043 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:58.770695 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.798638 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.799671 10591 raft_consensus.cc:2410] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:15:58.800905 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.809172 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:58.811950 12510 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.850s	user 0.006s	sys 0.000s
I20260709 13:15:58.812777 10585 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.813390 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.814400 10736 raft_consensus.cc:2410] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:15:58.814685 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1081) took 1779 ms. Trace:
I20260709 13:15:58.815028 10585 rpcz_store.cc:276] 0709 13:15:57.035138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.040725 (+  5587us) service_pool.cc:224] Handling call
0709 13:15:57.040998 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.813157 (+1772159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.814475 (+  1318us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001bfb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:58.814636 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4074342016}
I20260709 13:15:58.769240 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.819316 12402 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:58.821251 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.822160 12350 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:58.823305 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.824105 12350 raft_consensus.cc:2764] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Leader election decision vote started in defunct term 6: won
I20260709 13:15:58.824366 12374 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:58.826646 10709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.015s
W20260709 13:15:58.827009 10709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.008s	sys 0.015s
I20260709 13:15:58.827859 12528 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.828270 12528 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.829265 12374 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.830156 12247 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:58.830646 12247 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:58.831492 10743 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:58.831393 12247 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.830188 12528 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:58.832566 10743 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.832782 12247 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.834906 10736 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:58.835937 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.836431 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.836983 10742 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:58.837792 10737 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:15:58.838094 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:58.838608 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1027) took 1898 ms (client timeout 1660 ms). Trace:
I20260709 13:15:58.838754 10742 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:58.839033 10741 rpcz_store.cc:269] 0709 13:15:56.939820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.940492 (+   672us) service_pool.cc:224] Handling call
0709 13:15:58.838451 (+1897959us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400193054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:58.838550 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159029632}
W20260709 13:15:58.842622 12202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.003s	sys 0.014s
W20260709 13:15:58.842924 12202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.004s	sys 0.015s
I20260709 13:15:58.844154 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.844254 10743 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 6. Ops: [4.5-4.5]
I20260709 13:15:58.847084 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.847884 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.847988 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.848959 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.856266 10587 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:58.856557 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 111) took 2165 ms. Trace:
I20260709 13:15:58.857007 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.857188 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.853856 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.861133 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.865787 10736 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:58.865727 10585 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:15:58.866614 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.866715 12353 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.867456 12353 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.867743 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.868558 12259 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:58.868892 12259 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:58.868989 10736 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.842450 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.855177 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.856024 10593 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:15:58.879323 10591 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:58.880157 10667 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.851980 12416 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:58.881031 10742 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.881198 12416 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.882175 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1328) took 2590 ms. Trace:
I20260709 13:15:58.882351 12181 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:58.882586 10667 rpcz_store.cc:276] 0709 13:15:56.292197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.722182 (+1429985us) service_pool.cc:224] Handling call
0709 13:15:57.722503 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.880511 (+1158008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.881961 (+  1450us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540012f554. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:58.882125 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661693312}
I20260709 13:15:58.882117 12416 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.882853 12181 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:58.857725 10743 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:58.888041 12181 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:58.890306 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:15:58.890823 12513 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.652s	user 0.002s	sys 0.002s
I20260709 13:15:58.903434 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:58.856915 10660 rpcz_store.cc:276] 0709 13:15:56.690890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.945141 (+1254251us) service_pool.cc:224] Handling call
0709 13:15:57.945520 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:57.969602 (+ 24082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.969635 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:57.970215 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.700634 (+730419us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:58.700889 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.701083 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.856197 (+155114us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5400281c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:58.856240 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.856283 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:58.856371 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.856510 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":27075,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":22547,"spinlock_wait_cycles":52573952,"thread_start_us":730040,"threads_started":1,"wal-append.queue_time_us":326370}
I20260709 13:15:58.845142 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.904542 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:58.860529 10661 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:58.845690 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:58.860827 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:58.905946 10737 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:58.869542 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.869684 12259 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.854017 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:58.871285 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.910878 12259 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.873634 12350 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:58.874109 12255 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.001s
I20260709 13:15:58.912209 10662 raft_consensus.cc:2410] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:58.874339 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:58.874511 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:15:58.876021 12246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.011s	sys 0.024s
W20260709 13:15:58.915833 12246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.024s
I20260709 13:15:58.916378 12246 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.916649 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.882066 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.918193 11417 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:58.918713 12121 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:58.919240 12121 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.919574 12121 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.910838 10592 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:15:58.923987 11418 raft_consensus.cc:1217] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Deduplicated request from leader. Original: 1.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:15:58.861661 12247 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.907217 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:58.907421 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:58.907784 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:58.909931 12517 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.700s	user 0.005s	sys 0.000s
I20260709 13:15:58.910175 12205 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:58.916728 12246 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:58.877616 10587 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.928661 11379 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
W20260709 13:15:58.936921 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54926.3us
I20260709 13:15:58.952416 11379 leader_election.cc:403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.937448 12255 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:58.937471 12202 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:58.938166 12408 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:58.938529 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.925781 12353 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:58.940434 12181 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.956146 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:58.940845 12007 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:58.952648 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:15:58.960963 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.949306 12246 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.972539 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:15:58.952980 12205 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:58.954854 12518 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.974749 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:58.995234 10735 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:58.995663 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:58.998317 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:58.975960 12553 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:58.955948 12202 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:58.999585 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:58.999470 12202 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.000577 12202 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.000717 12306 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.001096 12306 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.001470 12306 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.004674 12503 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.335s	user 0.003s	sys 0.001s
I20260709 13:15:58.973557 12385 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:59.007045 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:59.007833 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1047) took 1243 ms. Trace:
I20260709 13:15:59.008199 10734 rpcz_store.cc:276] 0709 13:15:57.764582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.765115 (+   533us) service_pool.cc:224] Handling call
0709 13:15:57.765463 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.765823 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.765849 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.766394 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.061827 (+295433us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.061853 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.061899 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.909510 (+847611us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:15:58.994814 (+ 85304us) raft_consensus.cc:1685] finished
0709 13:15:58.994836 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.007774 (+ 12938us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":83,"spinlock_wait_cycles":28562176,"thread_start_us":295064,"threads_started":1,"wal-append.queue_time_us":443527}
I20260709 13:15:59.000604 12205 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.010470 12488 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:59.010958 12488 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:58.979228 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.013811 10593 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:15:58.959136 12255 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:59.015323 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:58.972052 12181 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.977680 12270 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:58.972227 12408 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:59.019819 12408 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.017931 12181 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.021449 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.026257 12255 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:59.026952 10665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1323) took 2820 ms (client timeout 2161 ms). Trace:
W20260709 13:15:59.027300 10665 rpcz_store.cc:269] 0709 13:15:56.206906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.396692 (+189786us) service_pool.cc:224] Handling call
0709 13:15:59.026759 (+2630067us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54002d9e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:59.026868 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842401536}
I20260709 13:15:58.981252 12121 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:58.982577 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.035549 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.036643 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:58.961469 12264 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.983997 12247 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:59.037755 12247 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.032783 12475 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:59.038565 12247 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.039765 12247 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.974187 12353 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.042737 12353 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:58.984704 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.986919 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:58.974598 12251 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:58.994073 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.016583 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.017084 12549 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.018743 12456 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:59.056586 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62571.7us
W20260709 13:15:59.033510 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.057304 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:59.048565 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.059001 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.049422 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51136.1us
I20260709 13:15:59.012995 12488 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.051972 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:59.052538 12007 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.061203 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.061846 12263 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.062234 12495 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.062480 12353 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:59.063303 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:59.065764 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.079567 10734 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:15:59.079790 10665 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:15:59.067773 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.080605 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.081100 10662 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.063953 12007 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.073364 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.073802 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.086371 10663 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:59.074672 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:15:59.059340 10557 connection.cc:256] RPC call timeout handler was delayed by -1.7874426229998335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:15:59.087611 10557 connection.cc:256] RPC call timeout handler was delayed by -1.3346159549998902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:15:59.076089 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:59.089035 10740 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:59.054203 12440 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.054251 12553 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:59.081418 10669 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:15:59.052757 12466 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:59.081755 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.111419 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.070364 10667 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:59.082559 12169 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.055189 12246 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.056842 12456 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:59.082619 12353 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:59.083356 10741 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:59.054587 12259 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:15:59.083742 12534 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.085532 12543 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:59.090181 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.121745 12270 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.093434 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.156473 10660 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.095075 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.157801 10668 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:15:59.157974 12518 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:15:59.158906 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.159679 10668 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:15:59.064318 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-8e245cc261b6415fac3d372489a49ceb received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:59.102981 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.124157 10662 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:15:59.160624 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:15:59.078439 12416 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.127662 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.056664 12549 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:59.078588 12264 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:15:59.140625 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.189806 10666 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.190762 10667 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:59.142719 12169 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.144939 12456 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.144708 12560 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.145532 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.097718 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:15:59.148744 10665 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.091861 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.151201 12217 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:59.151906 12007 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.207881 12007 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.129662 12466 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.146206 12353 consensus_queue.cc:1243] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:59.080856 12495 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.188913 10668 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:59.191766 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.220041 11418 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:15:59.192207 12549 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:59.200466 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 90497.6us
I20260709 13:15:59.222551 11381 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
W20260709 13:15:59.222772 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 161655us
I20260709 13:15:59.226408 10666 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:15:59.194664 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 94348.3us
I20260709 13:15:59.191175 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-8e245cc261b6415fac3d372489a49ceb on tablet 8e245cc261b6415fac3d372489a49ceb with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:59.152604 12259 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.141987 12440 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:15:59.210402 10665 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:15:59.218024 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.015s	sys 0.009s
I20260709 13:15:59.227509 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:59.282912 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55598.7us
I20260709 13:15:59.227527 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.159394 12534 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.302990 12251 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.303580 12518 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:59.304220 12534 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.305843 10664 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.272861 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:15:59.234745 12538 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.373s	user 0.001s	sys 0.001s
I20260709 13:15:59.216444 12553 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.195094 12416 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.195075 12264 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.270481 12460 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:15:59.278337 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1094) took 2059 ms. Trace:
I20260709 13:15:59.196568 12560 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:15:59.300426 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.205010 10660 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
W20260709 13:15:59.303884 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.016s	sys 0.009s
I20260709 13:15:59.273156 12466 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:59.312183 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:59.312697 12169 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.312885 12553 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.315124 12415 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.316473 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:15:59.224114 12555 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:15:59.270916 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:15:59.321514 11418 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:59.320531 10590 rpcz_store.cc:276] 0709 13:15:57.219057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.748929 (+529872us) service_pool.cc:224] Handling call
0709 13:15:57.749180 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.697946 (+948766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.278111 (+580165us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54002a8354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:59.278285 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177990912}
W20260709 13:15:59.330365 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.23504e+06us
I20260709 13:15:59.310017 12270 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.338943 10738 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:59.310034 12246 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:15:59.345265 10708 connection.cc:256] RPC call timeout handler was delayed by -1.0804226109999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:15:59.353559 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 265196us
W20260709 13:15:59.354104 10708 connection.cc:256] RPC call timeout handler was delayed by -1.0732226110001193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:15:59.340165 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 288263us
I20260709 13:15:59.360193 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.331835 12560 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.333377 12563 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.374152 12563 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:59.374545 12563 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.354612 12251 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:59.354322 12270 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.380709 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.381575 12270 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.329615 12460 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:59.365645 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800243620 after lost signal to thread 9492
I20260709 13:15:59.366631 12518 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:59.388935 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.367064 12416 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.367383 12495 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.363066 12571 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:59.370479 12466 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.363694 12475 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:15:59.371747 12553 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:59.413561 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800317ca0 after lost signal to thread 10526
W20260709 13:15:59.414726 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08000da760 after lost signal to thread 10618
W20260709 13:15:59.414973 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08000da740 after lost signal to thread 10619
I20260709 13:15:59.193922  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:59.417009 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.417183 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 271) took 2774 ms. Trace:
I20260709 13:15:59.417531 11415 rpcz_store.cc:276] 0709 13:15:56.642772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.642910 (+   138us) service_pool.cc:224] Handling call
0709 13:15:56.643297 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.111914 (+468617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.416955 (+2305041us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400033754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:15:59.417106 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076470656}
I20260709 13:15:59.418124 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.418622 12556 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.418967 12556 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:59.419080 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.419732 12556 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.420509 10588 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.416250 10491 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 113) took 6621 ms. Trace:
I20260709 13:15:59.421864 10491 rpcz_store.cc:276] 0709 13:15:52.813740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.813988 (+   248us) service_pool.cc:224] Handling call
0709 13:15:59.416196 (+6602208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:55.776264 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:55.776989 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:55.777032 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:15:55.777058 (+    26us) tablet.cc:662] Decoding operations
0709 13:15:55.777814 (+   756us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:55.777912 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:55.777952 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:15:55.778455 (+   503us) tablet.cc:701] Row locks acquired
0709 13:15:55.778625 (+   170us) write_op.cc:260] PREPARE: finished
0709 13:15:55.778930 (+   305us) write_op.cc:270] Start()
0709 13:15:55.779125 (+   195us) write_op.cc:276] Timestamp: P: 1783602955778860 usec, L: 0
0709 13:15:55.779166 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:15:55.837764 (+ 58598us) log.cc:844] Serialized 1723 byte log entry
0709 13:15:56.503839 (+666075us) op_driver.cc:464] REPLICATION: finished
0709 13:15:56.788462 (+284623us) write_op.cc:301] APPLY: starting
0709 13:15:56.794414 (+  5952us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:56.805273 (+ 10859us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:56.827061 (+ 21788us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:56.837051 (+  9990us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:56.837224 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:15:56.837271 (+    47us) write_op.cc:312] APPLY: finished
0709 13:15:56.837504 (+   233us) log.cc:844] Serialized 41 byte log entry
0709 13:15:56.837650 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.837737 (+    87us) write_op.cc:454] Released schema lock
0709 13:15:56.837778 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:56.838105 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.838132 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2532568,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":260355,"apply.run_cpu_time_us":2229,"apply.run_wall_time_us":62433,"num_ops":4,"prepare.queue_time_us":181153,"prepare.run_cpu_time_us":27822,"prepare.run_wall_time_us":144002,"raft.queue_time_us":281266,"raft.run_cpu_time_us":21564,"raft.run_wall_time_us":101663,"replication_time_us":724505,"thread_start_us":473726,"threads_started":4,"wal-append.queue_time_us":119051,"wal-append.run_cpu_time_us":34735,"wal-append.run_wall_time_us":1980976}]]}
I20260709 13:15:59.386880 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.465051 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.466037 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.341843 12202 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:59.388429 10593 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:15:59.390035 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.391888 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:59.468318 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.468609 10585 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.468005 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:59.470000 10593 raft_consensus.cc:2376] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:15:59.470547 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.470947 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.471680 10593 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:15:59.471968 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.472630 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.339947 10739 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:59.394081 10594 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.473731 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.370047 12264 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.398686 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.474550 10590 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:59.342180 12415 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.482689 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:59.397233 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 320373us
I20260709 13:15:59.403671 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.405721 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.398138 12466 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:59.426918 10741 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:15:59.427986 12460 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:15:59.421116 10588 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.420989 12556 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.435493 12416 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.394784 12181 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:15:59.445994 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08000df200 after lost signal to thread 10693
I20260709 13:15:59.447645 12306 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.449064 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.449378 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.394953 12427 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:15:59.451965 12121 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.386675 11416 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:15:59.455701 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:59.463843 10664 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:59.466684 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.475781 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:59.478348 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:59.474387 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.409191 11414 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:15:59.498121 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.499931 10585 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:15:59.502837 10588 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.510699 10588 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.433204 12456 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:15:59.504101 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:15:59.504427 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1c80 after lost signal to thread 10767
W20260709 13:15:59.501509 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 97946.5us
I20260709 13:15:59.516810 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:15:59.517104 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080017cb60 after lost signal to thread 11442
I20260709 13:15:59.505877 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.510600 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.510936 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.517309 10591 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.518185 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.519169 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:15:59.519802 10592 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.518409 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.504453 11409 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:15:59.514341 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.514499 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.522485 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.522672 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.523030 10587 raft_consensus.cc:2376] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5. Re-sending same reply.
I20260709 13:15:59.500375 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.523816 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:15:59.524135 10593 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:15:59.525794 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:59.508947 10594 raft_consensus.cc:2410] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:59.517482 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080036e1a0 after lost signal to thread 11443
I20260709 13:15:59.523383 10585 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
W20260709 13:15:59.527561 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080025d0c0 after lost signal to thread 12400
I20260709 13:15:59.527918 10587 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:15:59.528080 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800379320 after lost signal to thread 12459
I20260709 13:15:59.528286 10587 pending_rounds.cc:85] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 1
W20260709 13:15:59.528539 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080039f0e0 after lost signal to thread 12477
W20260709 13:15:59.528812 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7b20 after lost signal to thread 12480
W20260709 13:15:59.529079 10690 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9d20 after lost signal to thread 12491
W20260709 13:15:59.529515 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800277580 after lost signal to thread 12511
W20260709 13:15:59.505272 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56286.7us
I20260709 13:15:59.530122 10557 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.530294 10585 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.531587 10585 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.532640 10585 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.532691 10591 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:15:59.534042 10585 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:59.534144 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:59.504204 12466 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.534814 10669 raft_consensus.cc:2368] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5.
I20260709 13:15:59.535928 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:15:59.504642 12247 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.461548 12563 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.509436 12007 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.537243 10585 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:59.528555 10587 pending_rounds.cc:107] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:59.541666 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.542063 10587 raft_consensus.cc:2889] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.527935 10592 raft_consensus.cc:2410] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:59.537268 10706 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:59.541615 10585 pending_rounds.cc:85] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 2
I20260709 13:15:59.541676 12495 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.544824 12495 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:15:59.550180 10585 pending_rounds.cc:107] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:59.550973 10585 raft_consensus.cc:2889] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.549170 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.550164 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.553745 10585 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:15:59.560654 10585 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.541726 12385 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:59.539690 12534 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.543221 12247 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.509171 12549 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.517015 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.582813 10588 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:59.548110 12562 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:59.567117 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 207005us
I20260709 13:15:59.624114 10588 pending_rounds.cc:85] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 2
I20260709 13:15:59.625285 12247 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.542302 12460 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:15:59.625487 12259 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.551717 12557 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.553355 12475 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:59.626210 10589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.058s	sys 0.072s
W20260709 13:15:59.780833 10589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.059s	sys 0.072s
I20260709 13:15:59.781476 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1092) took 2591 ms. Trace:
W20260709 13:15:59.626345 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 109404us
I20260709 13:15:59.782593 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:59.628753 10588 pending_rounds.cc:107] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:59.783282 10588 raft_consensus.cc:2889] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.561968 12450 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.624984 12534 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:15:59.787804 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 218188us
I20260709 13:15:59.790481 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:59.791129 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:59.545153 12495 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.573182 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:15:59.553303 12169 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:59.623548 12566 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:59.570922 12190 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:59.785307 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 156940us
I20260709 13:15:59.781817 10589 rpcz_store.cc:276] 0709 13:15:57.190407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.710863 (+520456us) service_pool.cc:224] Handling call
0709 13:15:57.729349 (+ 18486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.729566 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:57.806793 (+ 77227us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.923967 (+1117174us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b180030e620. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:15:59.781154 (+857187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.781199 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:59.781242 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.781304 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.781425 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76885,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3115,"raft.queue_time_us":21006,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":40582528,"thread_start_us":856875,"threads_started":2,"wal-append.queue_time_us":1146991}
I20260709 13:15:59.786944 11410 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:15:59.794431 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 221331us
I20260709 13:15:59.571869 12568 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.782051 12562 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:15:59.800558 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.787539 12550 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.793787 12534 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.796108 12465 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.796370 12169 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:59.817348 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.801975 12385 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.799475 12502 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.824092 12456 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.826418 12416 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.820123 12169 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.812997 12475 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:15:59.830411 12415 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:15:59.831032 12306 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.796797 12559 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:59.837965 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 267271us
I20260709 13:15:59.851169 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.830010 12465 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.822788 12385 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:15:59.839800 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44538.8us
I20260709 13:15:59.814150 12427 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:59.855645 12465 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:59.857239 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.857965 12465 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.858400 12465 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.859269 12465 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.860975 12385 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.861116 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1107) took 1144 ms. Trace:
I20260709 13:15:59.861553 10586 rpcz_store.cc:276] 0709 13:15:58.717079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.719974 (+  2895us) service_pool.cc:224] Handling call
0709 13:15:58.720260 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.720582 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.720608 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.721029 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.747167 (+ 26138us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:58.747202 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.747263 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.860334 (+1113071us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b2400168b48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420afb0 00007f4256e81488 00007f4256e81be8 00007f4256e59398 00007f4256e5476a 00007f4256e53bb6
0709 13:15:59.860868 (+   534us) raft_consensus.cc:1685] finished
0709 13:15:59.860886 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.861061 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":998,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":2513326464,"thread_start_us":25801,"threads_started":1,"wal-append.queue_time_us":24809}
I20260709 13:15:59.863704 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.866294 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:15:59.844802 12567 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:15:59.839133 12502 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.852298 12450 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:59.850634 12512 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.668s	user 0.007s	sys 0.004s
W20260709 13:15:59.893497 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.896014 12415 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.818691 12576 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:15:59.850835 12559 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.852864 12583 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.932127 10660 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:59.858407 12181 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:15:59.925518 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 134458us
I20260709 13:15:59.925851 10664 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.926723 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.937685 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:15:59.937865 10665 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:15:59.938875 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.939519 10665 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.901859 12502 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.864781 12460 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.929773 10667 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:59.946280 12584 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.931099 10666 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.919924 12563 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.950242 10661 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.846505 12416 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:15:59.900267 12427 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:59.917097 12402 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:59.944615 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:15:59.919101 12259 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.914186 12564 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.944186 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.968106 10664 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.968305 10665 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:15:59.933940 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.932585 12559 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.931821 12450 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:15:59.950784 10667 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:59.928468 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64840.9us
I20260709 13:15:59.961270 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:59.978153 10559 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:15:59.949054 12460 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:15:59.969797 10664 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.012877 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:15:59.924058 12415 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:15:59.975399 11413 consensus_meta.cc:287] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.001s
I20260709 13:15:59.956094 12549 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.953846 12581 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.033586 11413 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:00.034204 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 320) took 1048 ms. Trace:
I20260709 13:15:59.990973 10665 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:00.034576 11413 rpcz_store.cc:276] 0709 13:15:58.985875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.064674 (+ 78799us) service_pool.cc:224] Handling call
0709 13:16:00.034142 (+969468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.035797 11415 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:00.036188 12549 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:00.037225 12549 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.037636 12549 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.979619 12564 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:00.038066 12450 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.038602 12549 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.040046 12549 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.040457 12385 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.979130 12247 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:15:59.917598 12562 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.018915 10740 pending_rounds.cc:85] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:16:00.042348 10740 pending_rounds.cc:107] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:16:00.042683 10740 raft_consensus.cc:2889] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.043284 12247 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.017951 10736 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:00.044467 12560 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.000s
I20260709 13:16:00.044943 10590 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.044808 12560 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.047128 12560 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.003178 10661 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.027426 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.002462 12585 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:59.950543 12475 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.026582 12476 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.026746 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.050372 12476 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.029925 10734 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:00.031945 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:15:59.962553 12427 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:15:59.978025 12587 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.033855 12581 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.038269 12564 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.049413 12585 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.052829 10737 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.969206 12259 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.060545 12259 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.061851 12416 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:15:59.919552 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 119058us
I20260709 13:16:00.063447 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:15:59.981441 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:15:59.980309 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:00.060613 12581 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:15:59.998265 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 282) took 1082 ms. Trace:
I20260709 13:16:00.025396 12460 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.065261 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.005865 12576 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.987943 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:15:59.991643 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 321) took 1005 ms. Trace:
I20260709 13:16:00.049412 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.096567 10661 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:00.071918 12579 log.cc:927] Time spent T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:16:00.094684 10737 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:00.055625 10665 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:00.072119 12575 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:16:00.104768 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.055198 12589 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.103914 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.105806 10737 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:16:00.110627 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 130393us
I20260709 13:16:00.111753 10665 raft_consensus.cc:2368] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:16:00.112926 11413 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:00.114212 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:00.112946 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:00.120342 11381 leader_election.cc:400] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:16:00.121239 11381 leader_election.cc:403] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:00.122040 12562 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.122153 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.124097 10665 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:16:00.107007 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.129268 10667 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:00.130178 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:00.089586 12584 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:00.106750 12564 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.136716 10661 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:00.162163 12415 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.155144 12476 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.110493 12560 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:00.121073 12576 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:00.134876 12385 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.096303 11409 rpcz_store.cc:276] 0709 13:15:58.986128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.999337 (+ 13209us) service_pool.cc:224] Handling call
0709 13:15:59.991422 (+992085us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400426b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:59.991572 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729072896}
I20260709 13:16:00.086658 11410 rpcz_store.cc:276] 0709 13:15:58.915542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.942142 (+ 26600us) service_pool.cc:224] Handling call
0709 13:15:59.449261 (+507119us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194eee 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:15:59.998015 (+548754us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b540065e5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:15:59.998191 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139272192}
I20260709 13:16:00.134229 12598 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.174101 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:00.163662 10739 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:00.119287 12589 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.153633 12591 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:00.178992 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56506.9us
I20260709 13:16:00.174450 12476 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:00.159787 12440 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:00.186786 12560 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.150765 12427 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.177793 12247 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:00.186795 12466 consensus_meta.cc:287] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.002s
I20260709 13:16:00.202435 12466 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.189296 12360 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.189174 12562 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:16:00.200763 12502 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.216252 12534 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.217518 12385 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.218559 12534 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.216825 10660 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:00.218940 12385 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.219625 10666 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.189103 12169 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:00.241005 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 177627us
I20260709 13:16:00.241910 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:00.137012 12585 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.194597 12584 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:00.247432 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:00.198173 12475 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:00.198052 12476 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:00.226044 12495 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.270360 12502 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.277693 10668 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.246065 12576 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.300676 11416 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:16:00.305176 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57829.3us
W20260709 13:16:00.277182 12556 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.005s
I20260709 13:16:00.271505 12466 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.307286 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:00.279045 12495 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.275537 12169 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.302287 12598 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.272579 12460 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.270920 12601 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:16:00.305923 12600 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:00.313943 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:00.308386 12589 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:00.316608 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 136350us
I20260709 13:16:00.309091 12584 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:00.316022 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 139185us
I20260709 13:16:00.331046 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:00.310534 12598 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:00.323751 10632 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.68:35619 timed out after 1.622s (SENT) [suppressed 16 similar messages]
I20260709 13:16:00.310756 11411 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:00.336411 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:00.315799 12600 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.316355 12475 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.330857 12169 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:00.330614 12584 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:00.336261 12476 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:00.336764 12589 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.356817 12589 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:00.330255 12576 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:00.349242 12476 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:00.350209 12605 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.350456 12598 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.335908 12466 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:16:00.339612 12604 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:16:00.367334 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 43648.4us
I20260709 13:16:00.337867 12571 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.370978 10664 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:00.348635 12584 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.357231 12589 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.382840 12466 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:00.383267 12466 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.384123 12466 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.374987 12353 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.386023 12559 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.386564 12353 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.389053 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:00.389585 12495 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:00.385385 12476 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.390111 12604 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.390328 12559 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.390555 12593 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:00.391027 12593 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.391839 12593 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.393266 12593 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.360493 12605 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.390053 12495 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.397222 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:00.359938 12475 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:00.390704 12604 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.359012 12169 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.405834 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:00.394893 12460 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.396072 12466 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.408999 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:00.409338 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69988.3us
I20260709 13:16:00.409822 11418 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:00.410111 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:00.420491 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:00.421248 11418 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:00.402110 12605 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.433983 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:00.402179 12571 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.432538 10632 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:00.403517 12353 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:00.438158 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 101638us
I20260709 13:16:00.407953 12247 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.439992 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:00.431928 12601 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.433493 12568 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:00.429869 12556 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:00.445231 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:00.431653 12583 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:00.438177 12502 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.441488 12460 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:00.451680 11410 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:00.449656 12604 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.452713 12495 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.448076 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:00.453285 12415 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:00.454038 12613 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:00.392902 12600 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.457638 12556 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.458158 12475 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.450250 12247 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.458904 12568 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.462872 12583 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.479813 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.492257 10593 raft_consensus.cc:2368] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:16:00.492447 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.480660 10586 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:00.493588 10586 pending_rounds.cc:85] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 1
I20260709 13:16:00.493863 10586 pending_rounds.cc:107] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:00.494120 10586 raft_consensus.cc:2889] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.494144 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:00.461840 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56102.8us
I20260709 13:16:00.495929 10592 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:00.496268 10593 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:00.464509 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.470255 12601 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.470717 12415 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.467344 12576 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:00.493024 10587 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:00.482671 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.484972 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.450856 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:00.498375 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.497370 10664 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:00.503088 10668 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:00.503324 10591 raft_consensus.cc:2410] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:00.505270 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 54502us
I20260709 13:16:00.506735 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:00.508315 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.510968 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.472466 12460 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.507946 12557 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.475348 12600 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.486414 12598 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.498050 12622 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:00.516115 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.516705 10668 raft_consensus.cc:2393] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:00.489470 12556 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.487676 12353 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:00.518489 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.505290 12564 raft_consensus.cc:476] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:00.501353 12415 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.520831 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.522862 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.524232 10664 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.527624 10594 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:00.481549 12475 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:00.515904 12502 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:16:00.514370 12576 consensus_queue.cc:1243] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:00.531682 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.479625 12589 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.519768 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:00.513253 12557 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.538529 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.538728 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.515985 12408 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.516258 12255 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.518066 12622 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.544317 10594 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.545907 11410 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:00.546182 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:00.536628 12601 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.546725 10591 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.547004 12601 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:00.548724 12547 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.595s	user 0.007s	sys 0.000s
I20260709 13:16:00.526093 12353 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.549975 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.551015 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.551304 12557 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.551729 10666 raft_consensus.cc:2410] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:00.552016 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 325) took 1109 ms. Trace:
I20260709 13:16:00.552127 12408 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.552369 11415 rpcz_store.cc:276] 0709 13:15:59.442565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.442668 (+   103us) service_pool.cc:224] Handling call
0709 13:16:00.035506 (+592838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.036148 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.551852 (+515704us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400028fd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:00.551969 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362745728}
I20260709 13:16:00.549935 12559 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.553915 12374 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:00.554318 12408 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.554436 12374 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.555038 12255 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:00.555526 12255 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.556520 12374 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:00.558204 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.559926 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.560765 10740 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:00.563668 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.482203 12247 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.559386 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.565513 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.567025 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.581737 10591 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:00.539450 12528 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.588574 10734 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:00.589763 10737 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.590778 10664 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:00.591848 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.592347 11379 leader_election.cc:400] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6.
I20260709 13:16:00.592824 10664 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:00.586499 12601 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.600494 10668 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:00.601099 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:00.480829 12571 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.601876 10591 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:00.604420 10668 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:00.473503 12621 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:16:00.549489 12565 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:00.608086 10664 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:00.553941 12559 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.605142 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:00.482975 12568 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.634686 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:00.598129 12528 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.637174 12450 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:16:00.614192 12353 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.598014 12605 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.607228 12416 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:16:00.607602 12591 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:00.615005 12408 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:00.608372 12495 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:00.621681 12622 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:00.618796 12581 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:16:00.657850 12616 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:16:00.672842 12559 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.607241 12460 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:00.670030 12584 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:00.682451 12580 log.cc:927] Time spent T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.782s	user 0.002s	sys 0.002s
I20260709 13:16:00.680022 12589 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.686968 12582 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:00.687357 12582 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.687392 12584 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:00.680787 12605 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.688169 12582 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.688906 12582 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.693672 12601 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:00.694069 12601 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.694824 12601 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.695294 12583 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.696031 12601 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.696204 12586 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.696663 12586 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:00.698979 12604 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.699347 12622 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.566504 10587 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:00.747627 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 122) took 1285 ms. Trace:
W20260709 13:16:00.757644 11414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 222) took 1841 ms (client timeout 1622 ms). Trace:
W20260709 13:16:00.758590 11414 rpcz_store.cc:269] 0709 13:15:58.916063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.942282 (+ 26219us) service_pool.cc:224] Handling call
0709 13:16:00.757071 (+1814789us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400556ed4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:00.757295 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424418560}
I20260709 13:16:00.736291 10665 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:00.736831 10593 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:00.741495 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:00.742905 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:00.744387 10735 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:00.784358 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.786013 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:00.748122 10663 rpcz_store.cc:276] 0709 13:15:59.462551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.462682 (+   131us) service_pool.cc:224] Handling call
0709 13:15:59.476980 (+ 14298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.544580 (+ 67600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.544610 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.545039 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.790262 (+245223us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:59.790302 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.244391 (+454089us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54003b3154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:00.244454 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.681913 (+437459us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:00.747124 (+ 65211us) raft_consensus.cc:1685] finished
0709 13:16:00.747169 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.747409 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40843,"raft.queue_time_us":37796,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8686,"spinlock_wait_cycles":88222848,"thread_start_us":244908,"threads_started":1,"wal-append.queue_time_us":300839}
I20260709 13:16:00.788002 10665 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:00.791730 12528 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:00.766803 10735 pending_rounds.cc:85] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 1
I20260709 13:16:00.800112 10594 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:00.797955 10735 pending_rounds.cc:107] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:00.810788 10735 raft_consensus.cc:2889] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.697484 12586 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.824712 12586 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.829823 12571 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:00.835729 10740 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.835099 12571 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.843869 12571 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.844643 12633 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.848591 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.845289 12571 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.832772 10489 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:00.844679 12181 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.884133 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:00.878850 12181 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:00.845558 12633 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.892275 10489 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:00.894081 12585 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.894994 12585 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.896004 10489 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:00.897468 10559 leader_election.cc:336] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.984s (SENT)
W20260709 13:16:00.901473 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 143095us
I20260709 13:16:00.908128 10740 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:00.908555 12353 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:00.912990 11411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 322) took 1926 ms (client timeout 1931 ms). Trace:
W20260709 13:16:00.913516 11411 rpcz_store.cc:269] 0709 13:15:58.986366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.987610 (+1001244us) service_pool.cc:224] Handling call
0709 13:16:00.912573 (+924963us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54005181d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:00.912738 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487992576}
I20260709 13:16:00.890493 12360 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.941885 12360 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:00.930142 12181 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:00.939532 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.014s	sys 0.004s
W20260709 13:16:00.940049 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 500834us
W20260709 13:16:00.940496 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 257060us
I20260709 13:16:00.907678 12565 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:00.969540 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:00.975021 11416 raft_consensus.cc:2376] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6. Re-sending same reply.
I20260709 13:16:00.975540 12633 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.969605 12255 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.971604 12181 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.972179 12585 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:00.972666 12415 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:00.974115 12565 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.004225 12565 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:00.967504 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:01.005712 12415 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.006557 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:01.006601 12415 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:00.976162 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1359) took 1879 ms (client timeout 1984 ms). Trace:
I20260709 13:16:00.984652 10738 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:00.976318 10662 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:00.990635 12202 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:00.991954 12557 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.001499 12205 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.003288 12534 raft_consensus.cc:1064] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:16:01.003539 12585 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.012250 12588 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.844s	user 0.000s	sys 0.003s
I20260709 13:16:01.012962 12647 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:00.976318 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:00.977389 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.015s	sys 0.004s
W20260709 13:16:01.007630 10669 rpcz_store.cc:269] 0709 13:15:59.096228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.111174 (+ 14946us) service_pool.cc:224] Handling call
0709 13:16:00.975747 (+1864573us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54000c4754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:00.975968 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941766912}
I20260709 13:16:01.026467 10660 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:01.004074 12550 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.026772 12465 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.027549 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:01.027108 12202 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.015877 12415 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:01.044600 12636 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.045154 12636 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.045553 12636 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.045929 12465 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:01.042021 12550 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.046871 12202 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.049108 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:01.049549 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.050055 10738 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
W20260709 13:16:01.050428 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.050603 10738 pending_rounds.cc:85] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:01.050978 10738 pending_rounds.cc:107] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:01.043690 11417 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8. Re-sending same reply.
I20260709 13:16:01.051275 10738 raft_consensus.cc:2889] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.052520 12622 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.053184 12622 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.053658 12643 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.054418 12643 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.055176 12604 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.056216 12646 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.056526 12643 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.056949 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.056834 12646 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.059139 12646 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.060161 12415 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.005367 12565 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.062083 12565 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.062582 12465 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.063014 12622 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.063313 12465 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:01.063912 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.063905 12465 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:01.064106 12647 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.066427 12647 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.066959 12571 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.067260 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.067512 12571 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:01.046667 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 121505us
I20260709 13:16:01.040700 12587 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.070269 12587 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.066097 12465 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.074806 10594 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:01.075558 12557 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.076648 10587 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:01.042649 12585 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.073145 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.077527 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.073984 12255 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.078779 12255 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.079396 10592 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.079785 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:01.077999 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.080775 12360 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.082513 12585 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.055830 12604 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:01.084146 12169 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.084488 12604 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.074540 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.050024 10593 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:01.087327 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:01.087915 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1400) took 1863 ms (client timeout 1977 ms). Trace:
W20260709 13:16:01.088366 10741 rpcz_store.cc:269] 0709 13:15:59.224557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.224699 (+   142us) service_pool.cc:224] Handling call
0709 13:16:01.087590 (+1862891us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54001581d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:01.087724 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197902720}
I20260709 13:16:01.085688 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.088582 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:01.089905 12502 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:01.090581 12502 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:01.090885 12557 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:01.091749 12557 consensus_queue.cc:1243] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:01.091686 12502 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.092607 12475 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.093420 12475 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.098055 12440 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:16:01.117729 12553 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.099215 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.118469 10591 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:01.124568 12525 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:01.124955 12525 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.125088 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:01.125387 12525 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.125488 12553 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.124321 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:01.057106 12643 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:01.138314 10586 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:01.137328 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:01.141906 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.142647 10591 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:01.125691 11413 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.145912 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:01.148120 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:01.148902 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 75056.1us
I20260709 13:16:01.149206 12571 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.149945 12633 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:01.150424 12643 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.150849 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:01.195948 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:01.131922 12528 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:01.152917 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1613) took 1716 ms. Trace:
I20260709 13:16:01.155678 12559 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.156005 12255 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.156759 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1361) took 2060 ms. Trace:
I20260709 13:16:01.156925 12475 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:01.159042 10489 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:01.156991 12576 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:16:01.208112 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51417.2us
I20260709 13:16:01.135602 12205 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.195453 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:01.148976 12601 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.127406 12604 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:01.201474 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.201545 10590 rpcz_store.cc:276] 0709 13:15:59.436413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.529949 (+ 93536us) service_pool.cc:224] Handling call
0709 13:15:59.530229 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.045306 (+515077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.152457 (+1107151us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54002c8dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:01.152740 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183294976}
I20260709 13:16:01.204965 10662 rpcz_store.cc:276] 0709 13:15:59.096794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.160932 (+ 64138us) service_pool.cc:224] Handling call
0709 13:16:00.975948 (+1815016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.026624 (+ 50676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.156573 (+129949us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000c4750. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:01.156708 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4173259136}
I20260709 13:16:01.211530 11409 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.211704 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:01.211942 12651 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:01.212774 10489 catalog_manager.cc:5697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 5, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.214464 12205 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.215977 12528 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.216463 12450 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:01.216581 12604 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.216900 12450 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:01.217727 12604 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.218727 12604 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.219107 10741 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.221181 12550 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:01.218184 12528 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.214648 10489 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 2, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:01.211453 12654 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:01.096431 12534 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.231622 12553 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.236330 12636 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.237440 12601 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.252589 12643 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.253883 12601 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.256691 10585 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:01.256985 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.257640 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 109681us
I20260709 13:16:01.258685 10706 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.261541 12622 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:01.261718 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 65918.3us
I20260709 13:16:01.262274 12622 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.262817 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:01.262923 12622 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:01.265828 10592 pending_rounds.cc:85] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 2
I20260709 13:16:01.265908 12587 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.266249 10592 pending_rounds.cc:107] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:01.266372 12587 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.266510 10592 raft_consensus.cc:2889] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.267360 12587 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.268699 12587 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.269711 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.272719 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.273874 12247 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:01.274241 12007 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:01.274921 12007 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:01.277841 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:01.279197 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54376.6us
I20260709 13:16:01.278412 11418 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:01.228943 12181 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.296342 10489 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.300262 10741 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.300599 10741 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.221799 12476 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:16:01.276224 12007 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.280006 12559 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.343876 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.350236 11418 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:01.351591 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.352159 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:01.351651 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49464.8us
I20260709 13:16:01.351958 12427 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:01.358908 10737 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:16:01.317986 12181 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.362618 10741 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:01.372623 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.390130 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.398240 12562 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.402792 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.396134 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:01.407318 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 69692.2us
I20260709 13:16:01.411172 10742 raft_consensus.cc:2410] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:01.414585 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.407379 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.409355 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:01.415984 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 50410.2us
I20260709 13:16:01.431335 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.431604 10741 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:01.434864 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.340847 12450 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.374071 12647 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:01.439618 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.441011 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.455574 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.456228 10740 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:16:01.453177 10738 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:01.461951 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.423725 12576 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.455431 12415 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:01.470126 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.474303 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.462688 12565 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.482185 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:01.426777 12202 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:16:01.423913 12562 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.489431 10742 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:01.491930 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.472568 12450 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:01.490164 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 71555.1us
I20260709 13:16:01.480130 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.485146 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.486208 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.443653 12528 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:01.497328 10594 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.500769 12549 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:01.501062 12562 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.501561 12416 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.501364 12549 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:01.502701 10585 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.503456 12549 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.490629 12181 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.515223 12604 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.466480 12495 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.176s
I20260709 13:16:01.495241 10735 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:16:01.519272 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 55788.2us
W20260709 13:16:01.532863 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 140906us
I20260709 13:16:01.490792 12559 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.481364 12565 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.524250 10591 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:01.517426 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:01.515792 12624 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.538515 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:01.559065 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 90638us
I20260709 13:16:01.522132 12476 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.521411 12604 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.538326 12560 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.569972 12562 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.592984 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:01.572252 12560 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.606335 10588 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:01.586146 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:01.609724 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:01.615099 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.616565 12669 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:01.610100 12585 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.618691 10590 raft_consensus.cc:1217] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:16:01.619241 10590 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:01.619719 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.621830 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:01.622831 12562 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.623402 12664 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:01.623324 12562 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:01.624086 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.624352 12502 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:01.624933 12502 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:01.625442 12660 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.190s	user 0.000s	sys 0.002s
I20260709 13:16:01.628201 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.628638 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.629206 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:01.629485 12658 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:16:01.629559 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.629781 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.630295 10740 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:01.630568 10735 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:01.631253 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.631486 10737 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:01.632476 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.618764 12568 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.636015 12568 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.636404 12568 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.630450 12465 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:01.638002 12465 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:01.639066 12465 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.641569 12605 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:01.641745 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 174037us
I20260709 13:16:01.641968 12605 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.642339 12605 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.583425 12587 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:01.622757 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:01.538223 12633 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:01.670867 12633 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.671232 12633 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:01.672120 12633 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.607533 12549 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:16:01.656361 10594 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:01.674839 10591 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:01.674733 12353 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:01.677387 12525 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:16:01.677800 12525 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.679272 11411 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:01.611665 12560 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.648795 12587 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:01.683525 10742 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:01.685191 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62497.3us
I20260709 13:16:01.659071 10667 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:01.659844 12610 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.663070 12604 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.664326 10736 raft_consensus.cc:2393] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:01.580152 12624 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:01.666152 12565 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.689487 10660 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:01.637163 12576 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.707818 10741 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:16:01.708261 10741 pending_rounds.cc:85] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:16:01.735592 10741 pending_rounds.cc:107] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:16:01.735845 10741 raft_consensus.cc:2889] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.737097 10738 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:01.738727 10742 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:01.739174 10742 pending_rounds.cc:85] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:01.739431 10742 pending_rounds.cc:107] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:01.739697 10742 raft_consensus.cc:2889] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.684314 12587 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.696321 12559 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.743505 12565 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.744849 12671 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:01.746143 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.731426 12633 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:01.747004 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.748914 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.751894 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:01.751832 10734 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:01.756974 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 113260us
W20260709 13:16:01.761133 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.754329 11409 consensus_meta.cc:287] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 13:16:01.750169 12559 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:01.775547 10661 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.772621 10738 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:01.755249 12622 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:16:01.781489 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:01.777954 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 249699us
I20260709 13:16:01.740828 12549 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.770496 12604 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.792311 10667 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:01.780313 12559 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.772451 11409 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:01.816826 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.768185 12565 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.759123 12610 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.836738 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.844266 10741 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:01.847436 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.851681 12562 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.853562 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.854468 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.856536 12565 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.857607 10660 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.859212 12636 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.860330 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.860944 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:01.864507 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.846436 11413 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:01.821681 12549 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.863839 10660 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:01.868086 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.875660 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.883270 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.876652 12574 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:01.872499 12636 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:01.891388 10665 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:01.891664 12636 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.892333 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:01.886883 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.888859 12683 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.891415 10667 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:01.893348 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.898845 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:01.909706 10741 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:01.896942 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:01.903928 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.910706 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.904194 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.907336 10665 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:01.912211 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.893705 12636 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.914103 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.916168 12587 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.905977 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.904022 12683 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.928659 10742 raft_consensus.cc:2393] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:01.928846 11417 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:01.930534 12549 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.931872 10741 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:01.932294 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:01.933075 12427 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:01.933374 12685 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:01.933806 12585 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.932337 12565 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.934122 12685 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.907778 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.936537 12427 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.936908 12427 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:01.937440 10667 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:01.937847 12427 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:01.938333 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.939015 12427 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.939352 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.939921 10667 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:01.941066 10667 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:01.919152 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.968374 10736 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:01.919276 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.893730 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.882346 12624 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:01.973238 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.925745 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:01.903311 10662 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:16:01.946128 12685 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.946529 12402 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.948591 12683 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:01.949673 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.895964 12610 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:01.893288 12560 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.983911 10734 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:01.953126 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:01.954254 12525 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:01.954710 12568 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:01.957199 12440 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:01.958634 12549 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:01.959901 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.960508 10660 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:01.961050 10559 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:01.966166 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:01.969681 10661 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:01.989857 10737 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:02.001643 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:02.003521 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.985124 12560 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.008950 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.009097 10667 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:02.012368 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.018674 10586 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:02.016841 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.000825 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:02.015667 10665 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:02.014914 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:01.904278 12007 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:16:02.021037 12553 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:01.981205 12402 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:02.022186 12440 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:02.022717 10588 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:02.021246 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:01.970959 12604 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:16:02.026751 12553 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:02.033080 10736 raft_consensus.cc:2410] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:02.030508 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:02.034219 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:01.964735 12559 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.036568 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.069393 10738 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:01.978335 12574 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:16:02.070305 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.966744 12605 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.071236 12534 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.071947 12534 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.073298 12605 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.074891 12534 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.075817 12559 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:02.022586 12646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.010s
W20260709 13:16:02.078147 12646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.012s
I20260709 13:16:02.067392 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:02.023051 12565 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:02.004855 11409 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:02.086221 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:02.028579 12360 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:02.039084 12525 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:02.094846 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.096887 10660 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:02.097198 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.097815 12259 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.101274 10736 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:02.111649 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:02.113099 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:02.101617 12571 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.083433 12565 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:02.032495 12585 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:02.102859 10741 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:02.124670 10741 pending_rounds.cc:85] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:02.124913 10741 pending_rounds.cc:107] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:02.125134 10741 raft_consensus.cc:2889] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.103629 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.083031 12007 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.115068 10734 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:02.101919 12553 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.125865 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.082121 12633 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:02.133082 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.135974 10586 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:02.083273 12560 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:02.139580 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.106027 12502 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.141115 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.117556 12571 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.145817 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.146441 10740 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:02.146360 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.049561 12440 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.102816 12360 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.156790 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.154887 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.132128 12007 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.160967 10589 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 3: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:02.158367 10742 raft_consensus.cc:2376] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4. Re-sending same reply.
I20260709 13:16:02.162744 10734 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:02.164182 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.164610 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.114485 12525 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.124234 12610 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:02.171825 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.155224 12571 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:02.182502 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.172652 10593 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:02.162473 12007 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.161201 12587 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.176895 12586 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.196190 10734 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.116528 12402 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.147588 12259 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:16:02.210626 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46105.5us
I20260709 13:16:02.176874 12604 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.228089 12360 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:02.232820 10738 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:02.233201 10738 pending_rounds.cc:85] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:02.233443 10738 pending_rounds.cc:107] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:02.233680 10738 raft_consensus.cc:2889] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.219707 12568 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.241488 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.207649 12587 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:02.247169 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 108945us
I20260709 13:16:02.225179 12604 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.247877 12576 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.260550 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.221449 12565 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.264544 10741 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:02.264338 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.266693 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.267165 10736 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:02.248100 12402 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.270463 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.274228 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:02.276292 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:02.276973 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:02.277500 10663 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.277612 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:02.282074 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:02.282603 10664 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:02.281224 12690 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:16:02.283833 10742 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:02.285538 10742 pending_rounds.cc:85] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:02.285801 10742 pending_rounds.cc:107] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:02.286171 10742 raft_consensus.cc:2889] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.289870 12450 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:02.295092 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.294210 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.304735 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.305397 12604 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:02.305827 12495 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:02.306427 12525 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:02.305486 12415 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.308552 12550 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.296747 12565 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.314808 12415 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.315431 12705 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:02.315963 12705 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:02.319940 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.316841 12705 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.325599 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.328785 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.328866 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:02.333678 12450 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:02.332729 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71966.5us
I20260709 13:16:02.337160 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.337914 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.317487 12495 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:02.341102 10739 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:02.341305 12416 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.340729 10740 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:02.349972 12601 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.356567 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.357491 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.358037 10742 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.359200 12636 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:02.362314 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:02.364318 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.365110 10742 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:02.365515 12570 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.377022 10663 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:02.379503 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.385916 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.389984 10585 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:02.390765 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53680.8us
I20260709 13:16:02.391705 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.397508 10585 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:02.345219 12571 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.406149 10590 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:02.377336 12576 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:02.420614 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.417214 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.421475 10586 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.375192 12684 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.425562 12007 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.427848 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.401196 12604 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.402165 12601 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.375497 12416 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:02.425969 12576 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.421027 12495 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.420275 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.429783 12705 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:02.473948 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46205.2us
W20260709 13:16:02.490483 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 111080us
I20260709 13:16:02.493347 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.490445 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.470757 10739 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.441342 12604 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:02.499004 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80142.3us
I20260709 13:16:02.472627 12708 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.471479 12570 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:02.491243 12415 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.502089 12601 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.517596 12205 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.525786 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:02.526993 12694 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.330s	user 0.000s	sys 0.002s
I20260709 13:16:02.527947 11411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 237) took 1404 ms. Trace:
I20260709 13:16:02.528311 11409 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:02.528383 11411 rpcz_store.cc:276] 0709 13:16:01.123093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.123887 (+   794us) service_pool.cc:224] Handling call
0709 13:16:01.124235 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.679786 (+555551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.527670 (+847884us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54005de154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:02.527858 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275880192}
I20260709 13:16:02.539527 10706 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.547194 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:02.549015 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:02.549811 12450 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:02.549790 12007 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.544648 12353 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.566030 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.576479 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.553460 12708 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.577402 12643 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.557997 12571 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.552639 12705 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:02.590354 12576 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:02.604660 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:02.605590 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56639.3us
I20260709 13:16:02.605619 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.577590 12586 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:02.607867 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.608429 10742 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.609691 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.574725 12353 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.589756 12708 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:02.607004 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.619058 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.607957 12007 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.605183 12450 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:02.610766 12719 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.630055 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:02.631228 10742 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:02.633380 12427 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:02.635425 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58996.4us
I20260709 13:16:02.636227 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.635164 12427 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:02.619843 12565 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:02.638190 10560 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.638634 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.623404 12604 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:02.661937 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.663169 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:02.664821 12586 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.665656 12601 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.666399 12601 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.596511 12570 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.667299 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.635995 12007 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.670586 10592 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:02.670938 10592 pending_rounds.cc:85] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 4
I20260709 13:16:02.670986 12353 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:02.671272 10592 pending_rounds.cc:107] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:02.671587 10592 raft_consensus.cc:2917] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:02.637578 12427 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.672207 10592 raft_consensus.cc:2889] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.674152 11411 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:02.674602 11411 pending_rounds.cc:85] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 4
I20260709 13:16:02.674865 11411 pending_rounds.cc:107] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:02.675146 11411 raft_consensus.cc:2917] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:02.675096 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.675750 11411 raft_consensus.cc:2889] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.671489 12007 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:02.678558 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.684783 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:02.639958 12565 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:02.660497 12719 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:02.635547 12605 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:16:02.718386 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 111399us
I20260709 13:16:02.666772 12601 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.711424 12550 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.719671 12565 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:02.731274 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 95102.9us
I20260709 13:16:02.734647 10668 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:16:02.734869 12711 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:16:02.732842 12416 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:16:02.735774 12725 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:02.637583 12708 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.723255 12601 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.741005 10560 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.741425 10586 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.737478 12684 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:02.752599 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.744076 12450 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.759449 12715 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:02.759680 12460 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.759881 12715 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:02.752228 12718 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:02.774188 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.749681 12717 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:16:02.788327 12734 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:02.733613 12727 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:02.762013 12550 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.823225 10739 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:02.827082 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.762481 12684 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.816032 12571 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:02.780508 12719 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.760915 12715 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.882637 12715 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.819022 12007 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.798936 12605 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:02.894920 12675 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:02.898335 12675 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:02.899210 12675 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.900153 12675 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.831073 12416 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:16:02.902971 12684 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:02.903424 12713 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:16:02.904985 12643 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:02.887214 12571 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.905982 12643 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:02.909209 12643 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.910006 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:02.888826 12353 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.914381 12353 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.914978 12353 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:02.916736 12587 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:02.889159 12427 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:02.950946 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:02.954171 10665 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:02.934765 12587 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:02.946571 12643 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.969691 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.970458 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.971120 10738 raft_consensus.cc:2376] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6. Re-sending same reply.
I20260709 13:16:02.971325 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.972764 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:02.976677 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:02.982429 10706 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:02.964610 12402 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.003993 10706 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:03.019913 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:03.019819 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.019987 10735 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:03.039281 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 361748us
I20260709 13:16:03.053195 12604 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.068204 12604 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.070914 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:02.964972 12587 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:03.093189 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.094954 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 91086.8us
W20260709 13:16:03.095615 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 268619us
W20260709 13:16:03.095453 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54669.5us
I20260709 13:16:03.097370 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.098064 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:03.005182 12733 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.177688 10743 raft_consensus.cc:2410] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.186873 12518 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.058187 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.187469 10591 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:03.200734 10734 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:03.137806 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.052949 12460 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:03.294919 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.295121 10587 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:03.131722 12402 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.131556 12586 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:03.233095 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 171086us
I20260709 13:16:03.131279 12205 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.309916 10588 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:03.133875 12719 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
W20260709 13:16:03.315778 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 215879us
I20260709 13:16:03.316735 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.322664 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:03.175326 12705 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 13:16:03.187448 12518 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.310601 12402 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.334036 12402 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.334642 12730 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.335307 12518 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:03.337836 12746 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:16:03.341260 12495 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.001s
I20260709 13:16:03.341758 12495 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.325573 12749 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:03.343912 12749 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:03.310992 12576 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.325095 12601 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.009s
I20260709 13:16:03.311151 10739 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:03.316411 12205 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.329752 12731 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.330319 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 337) took 1918 ms. Trace:
I20260709 13:16:03.345309 12749 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:03.399760 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77159.2us
I20260709 13:16:03.402323 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.364392 12604 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.397004 12518 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.398190 12205 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:03.415037 12565 consensus_meta.cc:287] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.003s
W20260709 13:16:03.420387 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.415352 12259 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.418500 12565 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.422888 12739 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:03.422444 12259 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.423405 12739 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:03.424288 12565 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.406744 12450 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:03.424845 12259 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.431475 10592 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:03.411082 12495 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.439708 12495 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.440110 12495 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.396571 12601 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:03.446121 11417 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.446488 10734 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:16:03.447044 12601 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.425099 12450 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.449522 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.449824 12450 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.450083 11415 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:03.450934 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.452556 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.433379 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.433589 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.394834 12576 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.437245 12402 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.437891 12587 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.428850 12518 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:03.438944 12715 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.556s	user 0.016s	sys 0.001s
I20260709 13:16:03.402524 11413 rpcz_store.cc:276] 0709 13:16:01.411535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.423818 (+ 12283us) service_pool.cc:224] Handling call
0709 13:16:01.823131 (+399313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:01.874989 (+ 51858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.310473 (+1435484us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400028fd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:03.324807 (+ 14334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799372544}
I20260709 13:16:03.471828 12624 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:03.472002 12643 consensus_meta.cc:287] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.503s	user 0.003s	sys 0.003s
I20260709 13:16:03.472285 12624 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:03.472785 10741 raft_consensus.cc:2410] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.454226 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:03.429773 12550 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:16:03.473898 10632 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.474292 12550 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.476089 12502 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.480089 12719 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.480706 12715 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.481141 12169 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.481956 12715 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.432118 12565 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.482290 12715 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:03.482539 12565 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.483800 12402 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.484408 12353 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.484603 12565 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.484987 11409 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:03.468806 12518 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.468350 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:03.483873 12576 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.486668 11417 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:03.487946 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:03.490677 10557 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.492861 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:03.424381 12739 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:03.496006 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:03.495364 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 398057us
I20260709 13:16:03.496197 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.500738 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.488407 12550 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.492861 12259 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.509117 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.510557 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.495867 12353 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:03.491425 12601 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:16:03.510576 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.494199 12745 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:03.502046 12719 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.494545 12565 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:03.501803 12576 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.484731 12715 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.506078 12750 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.522696 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.494254 12181 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:03.523986 10736 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:03.524824 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.513406 12353 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.527184 10742 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:03.473186 12624 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:03.527529 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53986.1us
I20260709 13:16:03.509564 12646 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:03.530063 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.511024 12259 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.517792 12565 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.535910 12565 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.529807 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:03.534150 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.511853 12550 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.524194 12587 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.567292 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:03.571594 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.573705 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.526172 12763 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.538379 12259 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.531982 12353 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.568239 12719 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.603533 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.609146 10742 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:03.607441 10591 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:03.608546 12576 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:03.611196 12576 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.570539 12450 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:03.612608 12771 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.613051 12771 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.613970 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.614530 10742 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:03.615021 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.615268 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:03.574182 12749 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:03.534821 12750 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.616816 12749 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.617435 12747 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:03.617837 12747 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:03.618264 12750 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.572597 12549 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.575481 12587 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.618631 12747 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.538971 12518 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.569556 12759 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.567523 12647 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.569003 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:03.574548 12705 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.538533 12643 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:03.576642 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.604764 12568 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.620222 12765 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:16:03.615054 12771 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.613210 12576 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.632941 12747 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:03.644754 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 90943.1us
I20260709 13:16:03.620486 12745 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.631258 12549 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:03.658121 12550 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.658142 12549 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.632428 12647 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:03.636099 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.643859 12759 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:03.655346 12646 raft_consensus.cc:1064] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:16:03.632390 12518 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.664453 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.631953 12763 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:03.667264 12550 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.669854 12550 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.661494 12450 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:16:03.668707 12756 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:16:03.671757 12550 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.673548 12518 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.668936 12759 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:03.664366 12696 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.487s	user 0.002s	sys 0.015s
I20260709 13:16:03.661757 10739 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:03.645800 11413 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:16:03.666941 12646 raft_consensus.cc:1068] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Unable to promote non-voter e71e2e44af1e46d8a8423ae08646bc22: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:03.700117 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.681358 12647 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.685706 12502 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.700699 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:03.701160 12647 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.701362 10740 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:03.702248 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:03.695019 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.689682 12731 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:16:03.645308 12568 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.636916 12705 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.708683 12568 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.663898 12205 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.705446 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.709933 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.714125 11417 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:03.715327 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:03.715960 12205 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.662081 12587 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.716593 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:03.718286 10669 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:03.718300 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.639222 12495 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.709585 12705 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:03.691771 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.722662 10660 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:03.724777 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.725306 10664 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:16:03.726112 12255 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.726459 12450 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.726583 12255 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.727008 12450 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.728648 12255 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:03.729286 12760 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:16:03.730221 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:03.721017 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.734616 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.736342 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:03.767295 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:03.767673 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.767910 10663 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.768286 10666 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:03.766700 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.770462 10667 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:03.716027 12568 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:03.772488 10662 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:03.773495 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:03.776172 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.770545 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:03.778519 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.778703 11381 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:03.781111 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.781880 10661 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:03.766264 12771 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.677286 12259 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.749348 12605 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.788512 10669 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:03.774916 12568 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.806231 12568 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.807195 10737 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:03.799649 10663 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:03.792279 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.805557 12762 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.731518 12565 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:03.814204 12568 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.915975 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.843319 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:03.950645 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 107393us
I20260709 13:16:03.951848 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.790874 12502 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.953847 12502 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.846865 12759 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.955093 12568 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.913097 12460 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.814960 12587 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:03.955976 12502 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.843976 12528 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.956931 12528 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.785102 12675 raft_consensus.cc:2771] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: Leader pre-election decision while not in active config. Result: Term 7: won. RaftConfig: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:03.957660 12528 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.792553 12601 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.956077 12460 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.956148 12759 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.958873 12601 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:03.960847 12601 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.948807 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:03.962396 10588 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:03.963992 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:03.964686 10740 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.966542 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:03.945209 10666 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:16:03.969434 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.804658 12605 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.842989 12705 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.814845 12450 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.946513 12719 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.953127 12259 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:03.950335 12731 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.972623 12733 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.976723 12502 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.995240 12502 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:03.995594 12502 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.979755 12622 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:03.995986 10668 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:03.996274 12622 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.998963 12622 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:04.000051 12440 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.975652 12771 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.001672 12771 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.002087 12759 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:04.002734 12751 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.551s	user 0.002s	sys 0.000s
I20260709 13:16:04.003489 12460 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:04.004202 12722 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.283s	user 0.010s	sys 0.009s
I20260709 13:16:04.008951 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.843538 12604 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 13:16:04.009550 11417 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:03.965518 12762 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.010810 12731 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.012641 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:04.012804 12646 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.020102 10740 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.026016 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:03.984597 12605 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:04.043155 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.956401 12587 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.051484 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.052884 10666 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:04.013535 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.056424 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:03.991094 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.012674 12762 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.024967 12559 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:04.061439 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 87634us
I20260709 13:16:04.015260 12646 consensus_queue.cc:1243] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:04.062958 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.064502 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.065861 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.066421 10587 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:04.013258 12731 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:03.985361 12255 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:16:03.990679 12576 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.117380 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:04.118688 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.086179 12565 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.052562 12771 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:04.126992 12789 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:16:03.994779 12719 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:03.989565 12705 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:04.119515 12556 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.129137 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:04.129595 10590 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:04.056197 11411 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.130237 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:04.065608 12559 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.145270 12622 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:04.145480 12559 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.145721 12622 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:04.145798 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:04.146221 12622 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.146943 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.147898 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.150619 12587 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:04.150874 10736 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:04.152462 12528 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.068934 11413 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:16:04.134270 12783 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:16:04.139716 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53079.1us
W20260709 13:16:04.144737 12353 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.001s
I20260709 13:16:04.156399 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:04.158349 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.159040 10740 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:04.159571 11381 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.160796 12771 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.161401 12353 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.163550 12353 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.164403 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1111) took 1189 ms. Trace:
I20260709 13:16:04.164927 10741 rpcz_store.cc:276] 0709 13:16:02.975400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.975555 (+   155us) service_pool.cc:224] Handling call
0709 13:16:04.164164 (+1188609us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002bf554. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:04.164324 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038384768}
I20260709 13:16:04.167312 12719 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.133841 12731 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.167980 12731 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.169771 12528 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.169953 12731 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.170835 10669 raft_consensus.cc:2410] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:04.172775 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.172897 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.177309 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:04.158198 12604 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.187084 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.187479 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.188023 11417 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.139824 12502 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.193977 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.194216 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.193984 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.192159 10585 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:16:04.198658 10594 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:04.198524 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:04.199690 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.182817 12568 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:04.167125 12559 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.182925 12771 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:04.203483 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:04.204727 10589 raft_consensus.cc:2368] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7.
I20260709 13:16:04.185434 12604 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:04.205829 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:04.206956 12528 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:04.207257 12675 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:04.204792 12587 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.213999 10660 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:04.198297 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.218484 10586 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:04.155174 12556 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.226334 12559 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.232203 12736 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:04.236217 12622 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:04.238554 12754 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.788s	user 0.000s	sys 0.001s
I20260709 13:16:04.239688 12793 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.254299 12793 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:04.254701 12793 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.255730 11413 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:04.256289 12752 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.817s	user 0.000s	sys 0.003s
W20260709 13:16:04.240103 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52338.5us
I20260709 13:16:04.257743 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:04.258424 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1115) took 1281 ms. Trace:
I20260709 13:16:04.258757 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:04.259161 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1766) took 1643 ms. Trace:
I20260709 13:16:04.258772 10743 rpcz_store.cc:276] 0709 13:16:02.977655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.977866 (+   211us) service_pool.cc:224] Handling call
0709 13:16:04.258243 (+1280377us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54004100d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:04.258369 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242675968}
I20260709 13:16:04.259706 12622 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.260265 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:04.260443 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 118176us
W20260709 13:16:04.262542 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.262976 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.265198 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.214565 12604 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.272414 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.242661 11417 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:04.250403 12576 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:04.250844 12502 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.251555 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.251977 10668 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:04.291906 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.252112 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.252221 12750 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.295460 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.252976 10666 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:04.295750 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:04.220384 12675 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:04.223963 11412 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.268471 12792 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.269207 12747 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:04.260296 12622 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.259737 10665 rpcz_store.cc:276] 0709 13:16:02.615277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.615378 (+   101us) service_pool.cc:224] Handling call
0709 13:16:02.631957 (+ 16579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.954697 (+322740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.258946 (+1304249us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:04.259103 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740241664}
I20260709 13:16:04.292850 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.292927 10663 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.206704 12568 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.289978 11418 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:04.295512 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.252660 12771 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:04.299247 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 149838us
I20260709 13:16:04.301064 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.317405 10594 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:04.301764 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:04.303485 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.304332 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.318058 10742 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.318470 10737 raft_consensus.cc:2410] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:04.305074 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.301764 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.319564 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.320315 10666 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:04.289804 12576 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:04.302495 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 99087us
I20260709 13:16:04.298211 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.313066 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:04.310230 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.315671 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.316316 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.319020 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.297922 12601 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:04.300242 12759 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.326614 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.324827 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:04.332154 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:04.332799 10741 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.303599 12559 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:04.309700 12565 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:04.300875 12255 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:04.329586 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:04.305719 12460 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.305899 12719 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.322671 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:04.335155 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.335160 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.337790 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.303227 12440 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:04.297679 12762 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.340909 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.300392 12647 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:04.341374 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.358832 10665 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.347921 10742 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:04.348371 10741 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.325548 12587 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.355247 10666 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:04.356181 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 154679us
I20260709 13:16:04.362498 10663 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.334301 12622 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.327316 12549 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.330696 12771 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:04.354766 10667 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:04.300688 12750 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.363262 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.356498 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.374562 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:04.357177 12502 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.377247 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.377807 10667 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.364632 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.370620 12568 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.373656 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.375118 11417 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.361181 12440 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.383569 12440 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.385432 12556 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.362032 12762 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.389997 12771 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.391690 11411 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:04.393518 10735 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:04.334654 12601 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.375687 10663 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.379675 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.343863 12255 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:04.401831 11417 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.362144 12460 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:04.404655 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106511us
I20260709 13:16:04.407323 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:04.407632 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:04.408169 10668 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.352329 12565 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.348922 12559 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.413244 11379 leader_election.cc:400] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7.
W20260709 13:16:04.411724 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 90342.8us
I20260709 13:16:04.413655 11379 leader_election.cc:403] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.414312 10559 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:04.416608 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.393801 12755 raft_consensus.cc:2764] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:04.369279 12587 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.394285 12549 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:04.455041 12549 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.455416 12549 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.434988 10663 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.412865 12568 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:04.458876 10667 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:04.441577 12460 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.411689 12255 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.418689 12622 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:04.442579 12528 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:04.442745 12553 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.444211 10665 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.427395 12440 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:04.447177 12559 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.451958 12605 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.368320 12675 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.432816 12556 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7.
I20260709 13:16:04.369589 12576 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.411612 12732 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:04.472385 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.473047 10665 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:04.461169 12568 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.461684 12750 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.466259 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:04.467139 10668 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:04.468152 10667 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:04.461184 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 96611.8us
I20260709 13:16:04.477979 10559 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.481732 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:04.482547 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:04.492933 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62614.1us
I20260709 13:16:04.494379 12771 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.505378 12793 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:04.506289 12753 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.068s	user 0.003s	sys 0.000s
I20260709 13:16:04.507402 12571 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.507531 12793 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:04.508302 10740 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.495519 12797 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:04.468883 12528 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.482416 12568 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.514753 12605 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.489851 12732 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:04.472571 12622 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:04.526248 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48342.5us
I20260709 13:16:04.527045 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:04.513715 12797 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.536643 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:04.502925 12750 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:04.542807 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.526316 12353 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.538679 12797 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.543603 12771 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:04.561239 12771 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:04.561875 12771 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.561614 12732 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:04.559684 12528 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:04.561065 11412 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:04.565913 12565 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:04.580361 12601 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.557700 12604 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:04.590013 12810 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:04.590790 12427 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:04.590860 12802 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:16:04.591976 12764 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.068s	user 0.002s	sys 0.000s
I20260709 13:16:04.592943 12716 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:04.593714 12565 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.554157 12353 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:04.596489 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53771.8us
I20260709 13:16:04.585218 12814 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:04.614261 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 118704us
I20260709 13:16:04.614347 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.618712 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:04.619362 10739 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:04.615351 10734 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.622766 12622 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:04.624176 10734 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:04.605719 12716 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:04.624727 10742 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:16:04.613055 12601 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.625689 12601 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:04.626364 12813 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:04.603322 12809 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:16:04.660732 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1184) took 1938 ms. Trace:
I20260709 13:16:05.029803 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:04.658812 10589 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:04.635763 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 93555.9us
W20260709 13:16:04.730190 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.632452 10736 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:04.991662 12549 consensus_meta.cc:287] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
W20260709 13:16:05.061700 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.029927 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 423484us
W20260709 13:16:04.758522 12816 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:16:05.043193 11417 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:05.041211 10592 rpcz_store.cc:276] 0709 13:16:02.722609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.724478 (+  1869us) service_pool.cc:224] Handling call
0709 13:16:02.724849 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.431886 (+707037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.660507 (+1228621us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400169c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:04.660678 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611483520}
I20260709 13:16:04.613706 12814 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.064149 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.651019 10585 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:04.630309 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:04.656366 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 173878us
I20260709 13:16:04.629469 10590 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:05.042397 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.057171 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:04.756608 12708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.938s	user 0.008s	sys 0.027s
I20260709 13:16:04.627799 11412 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:04.777915 12782 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.767s	user 0.004s	sys 0.000s
I20260709 13:16:05.076061 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:04.996191 12255 consensus_meta.cc:287] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:16:05.077500 10594 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:04.659168 12806 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:05.082170 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:05.083916 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.062027 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.950510 12818 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:04.692946 12528 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.102923 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45875.1us
I20260709 13:16:05.116951 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.117478 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:04.759018 12719 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.963356 12604 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.112017 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:04.995496 12771 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:05.113270 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51318.2us
I20260709 13:16:05.079416 12814 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.117774 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:05.002045 12797 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.136952 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:05.141074 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57208.2us
I20260709 13:16:05.142294 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:04.797865 12736 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:03.422420  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:05.099375 12708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.281s	user 0.010s	sys 0.032s
I20260709 13:16:04.997515 12568 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:05.106247 12440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.019s
I20260709 13:16:05.114295 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:05.163897 11417 raft_consensus.cc:2410] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:05.164237 10585 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:05.129725 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:05.098976 12559 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:05.115792 11415 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:05.145694 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:05.070111 12549 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.158114 10594 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:05.116015 12804 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.007s	sys 0.021s
W20260709 13:16:05.126979 11411 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.020s
I20260709 13:16:04.632099 12716 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.127310 12601 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.111675 12255 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.123303 12829 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:05.137253 12416 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.163892 12440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.003s	sys 0.019s
I20260709 13:16:05.212581 12518 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:05.203183 10736 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:05.213178 12821 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:05.204506 10585 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:05.214387 12518 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:05.214802 12518 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:05.214608 12416 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.215394 12587 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:05.215575 12518 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.216622 12416 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.216797 12518 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.222461 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1669) took 1717 ms. Trace:
I20260709 13:16:05.222645 12549 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.223443 12549 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:05.172165 12804 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.022s
I20260709 13:16:05.224102 12549 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.155429 12571 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.120311 12806 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.164033 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:05.171270 11411 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.020s
I20260709 13:16:05.122912 12528 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.222932 10591 rpcz_store.cc:276] 0709 13:16:03.505407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.505523 (+   116us) service_pool.cc:224] Handling call
0709 13:16:03.505814 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.610002 (+104188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.222180 (+1612178us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540020e754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:05.222392 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232780032}
I20260709 13:16:05.225219 10663 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:05.226009 12255 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.226476 10594 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.165426 12810 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.206058 10593 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:05.150810 12736 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:05.120909 12818 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.252967 12255 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:05.210367 12829 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:05.260326 12675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.026s	sys 0.016s
I20260709 13:16:05.265872 10594 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:05.265798 12736 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.249650 12416 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:05.247201 12647 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:05.316824 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 143) took 1582 ms. Trace:
I20260709 13:16:05.315408 12747 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:05.253011 12823 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.268918 12818 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:05.317502 12675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.027s	sys 0.016s
I20260709 13:16:05.323046 10660 rpcz_store.cc:276] 0709 13:16:03.734553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.984839 (+250286us) service_pool.cc:224] Handling call
0709 13:16:03.987434 (+  2595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.216562 (+229128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.316584 (+1100022us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540041fd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:05.316767 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516693760}
I20260709 13:16:05.302296 12829 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:05.322165 12259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.025s
W20260709 13:16:05.323321 12721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.871s	user 0.025s	sys 0.021s
I20260709 13:16:05.289422 12255 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.391269 12736 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.336220 12601 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:05.417973 12721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.963s	user 0.028s	sys 0.021s
I20260709 13:16:05.418184 12604 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:05.411190 12259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.008s	sys 0.028s
I20260709 13:16:05.337325 12587 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:05.465610 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 320022us
I20260709 13:16:05.468320 12797 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.326968 12416 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.426720 12708 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.338899 12747 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.491669 12528 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:05.494653 11418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 297) took 1431 ms (client timeout 1831 ms). Trace:
I20260709 13:16:05.337033 12647 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.465425 12559 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.526227 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.466004 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:05.527081 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 402615us
I20260709 13:16:05.336769 12549 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.468562 12771 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.530107 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1147) took 1153 ms. Trace:
I20260709 13:16:05.569077 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:05.467249 12823 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 13:16:05.556964 11418 rpcz_store.cc:269] 0709 13:16:04.063716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.063863 (+   147us) service_pool.cc:224] Handling call
0709 13:16:05.494438 (+1430575us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54005dd754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:05.494574 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362433792}
I20260709 13:16:05.530699 12733 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.486295 12604 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.481281 12601 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.545193 12587 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.630771 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.598620 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1672) took 1994 ms. Trace:
I20260709 13:16:05.599502 12762 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:05.602453 12839 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:16:05.603207 12835 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:16:05.605275 12716 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.648710 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.555982 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:05.617511 10740 rpcz_store.cc:276] 0709 13:16:04.361357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.374776 (+ 13419us) service_pool.cc:224] Handling call
0709 13:16:04.404018 (+ 29242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.508706 (+104688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.514781 (+1006075us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001cd754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:05.514990 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239365376}
I20260709 13:16:05.612296 12495 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.616956 10736 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:05.591156 12828 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:05.625351 12729 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.557353 12708 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.597034 12747 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.632957 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.631875 10588 rpcz_store.cc:276] 0709 13:16:03.604238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.604446 (+   208us) service_pool.cc:224] Handling call
0709 13:16:03.632531 (+ 28085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.962928 (+330397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.598396 (+1635468us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540020ec54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:05.598566 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757864320}
W20260709 13:16:05.634603 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 108466us
I20260709 13:16:05.676517 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.635510 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:05.679447 10739 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.640802 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:05.641841 10585 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.650578 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:05.651835 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.628891 11411 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:05.688546 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.594326 12806 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.631319 12733 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:05.664407 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.665143 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.665696 12847 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:16:05.667210 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.692651 10737 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:05.642318 12721 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:05.643322 12846 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:05.718187 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:05.618973 12568 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.737609 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:05.738379 10661 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.692866 12804 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:05.687655 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:05.741569 12834 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:16:05.615968 12559 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.652213 12259 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:05.702227 12831 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:05.714231 12460 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:05.674757 10740 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.716488 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:05.693519 12838 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:16:05.656028 12565 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:05.729841 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:05.731664 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 111549us
I20260709 13:16:05.739557 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:05.654584 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.696646 12255 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:05.745617 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58081.5us
I20260709 13:16:05.722883 12587 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.678745 12848 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:16:05.746917 12719 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:05.751519 10739 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:05.728504 12353 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.734313 12846 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.677668 12729 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.778532 10737 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.752671 12604 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:05.778565 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 124106us
I20260709 13:16:05.747112 12842 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:05.780619 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.800302 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.800469 10632 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.801741 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.765092 10661 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:05.785593 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.803541 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.805408 12790 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:05.806063 12790 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.808570 12790 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.803619 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.756520 12847 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:05.786386 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.790592 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.790809 10660 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:05.752637 12850 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:05.749744 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.826647 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.779106 12259 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.779714 10664 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:05.813419 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.786480 10665 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.831091 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.833875 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:05.834400 10661 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.836102 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.833624 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:05.840699 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.797570 12747 raft_consensus.cc:2764] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:16:05.817745 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.819222 10668 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:05.752895 12804 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.820881 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:05.851042 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:05.778264 12416 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:05.826972 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.779863 12647 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.826121 12721 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:05.851873 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.853631 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:05.828002 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.855626 10668 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:05.789724 12755 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:05.833647 12675 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:05.833065 12843 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.830022 12556 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.794390 12571 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:16:05.874543 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.859948 10662 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:05.833578 12495 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:05.851300 12715 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.862118 10661 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:05.837769 12850 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:05.811314 12719 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.867484 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:05.913089 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 45692.3us
I20260709 13:16:05.869213 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.816310 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.849653 12848 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:05.783672 12460 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.903627 10585 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:05.905597 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.864279 12647 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:05.907562 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.791481 12853 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 13:16:05.915772 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 99700.5us
I20260709 13:16:05.905474 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:05.924444 12851 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:16:05.921664 10740 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:05.925331 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:05.830780 12847 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.919679 12601 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.919884 12568 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:05.918430 12846 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.929359 12729 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.925900 12259 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.931298 10661 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:05.918794 12622 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:05.935521 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.909725 12675 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:05.820076 12842 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.902848 12843 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:05.876933 12755 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:05.916671 12528 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:05.915995 12762 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.939639 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:05.940696 10559 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:05.877223 12556 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.916884 12416 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:16:05.948149 10708 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.686s (SENT) [suppressed 12 similar messages]
I20260709 13:16:05.953528 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.934573 12568 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:05.954136 10661 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:05.955489 10736 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:05.945523 12843 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:05.958887 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 89748.7us
I20260709 13:16:05.970480 12848 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.939209 12353 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.939507 12622 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:05.977850 12859 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.979039 11411 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:05.979846 12852 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:16:05.979933 12556 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:05.980621 12856 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.971753 12755 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.933091 12647 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.990302 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:05.991364 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:05.995040 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:05.997339 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:05.945927 12733 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:05.940834 12565 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:16:05.941489 12806 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:05.972756 12568 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:06.000387 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.001967 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.000521 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:06.002871 10669 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:05.974377 12729 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:06.007292 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 93141.1us
I20260709 13:16:06.007498 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:05.983398 12622 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.953655 12528 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:05.989737 12556 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:06.013187 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:05.962244 12762 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:05.990386 12353 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:06.019760 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:06.022845 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49589.3us
I20260709 13:16:06.023159 10592 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:16:06.027930 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88349.7us
I20260709 13:16:06.024324 12353 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.077011 12353 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.953397 12804 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:06.135371 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.135270 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:06.013553 12729 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.136335 10740 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.204561 10737 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:06.222836 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1432) took 1976 ms. Trace:
I20260709 13:16:06.223189 10663 rpcz_store.cc:276] 0709 13:16:04.246798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.459964 (+213166us) service_pool.cc:224] Handling call
0709 13:16:04.460288 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.250161 (+789873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.222620 (+972459us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54002d9e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:06.222783 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758740736}
I20260709 13:16:06.221611 10591 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:06.195186 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.177031 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:06.241835 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.013164 12675 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:06.251682 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 117381us
I20260709 13:16:06.251766 10740 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:16:06.202278 12861 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.010s
I20260709 13:16:05.990679 12850 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.028748 12556 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.165258 12733 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.265815 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.268874 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:06.272040 11411 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEARNER]: Advancing to term 4
I20260709 13:16:06.272470 12863 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.272943 12863 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:06.247397 12798 raft_consensus.cc:670] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:06.276903 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.278894 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:06.284346 12876 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.255510 12825 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.257926 12853 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.258409 12460 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.292855 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.193825 12587 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:16:06.285475 12729 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.297217 12729 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.298499 12729 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.301334 12729 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:06.305578 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:06.311404 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 370771us
I20260709 13:16:06.285960 12705 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.315165 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.315877 10591 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:06.312530 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 291767us
I20260709 13:16:06.287063 12842 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.312376 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.312391 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.319135 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.271502 12733 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.320706 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.309769 12460 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:06.335825 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:06.256668 12864 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.337s
I20260709 13:16:06.314713 12647 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.320966 12804 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.319531 12847 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.319155 12879 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.366274 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.336584 12705 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.360602 12570 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.361059 12762 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:06.346340 12556 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:06.363811 12518 consensus_meta.cc:287] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.147s	user 0.008s	sys 0.005s
I20260709 13:16:06.364073 12353 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.361086 10743 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.355275 12549 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:06.336272 12528 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.314877 12869 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.334s
I20260709 13:16:06.345443 12855 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:06.355361 12868 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:16:06.312882 12825 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:16:06.352224 12716 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.000s
I20260709 13:16:06.346693 12733 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.345283 12860 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.382117 12864 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:06.383251 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.383611 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.417246 12869 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:06.417631 12869 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:06.351526 12806 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.385845 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:06.355980 12872 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.342487 12460 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.369501 12705 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.380936 12798 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.355065 12804 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:06.392508 12556 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:06.402729 12855 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.402910 12882 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:16:06.404974 12353 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.405572 12825 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.407948 12624 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.414600 10743 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:06.381147 12570 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.391021 12549 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:06.417650 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:06.385334 12879 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.402071 12843 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.431490 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1195) took 1479 ms. Trace:
I20260709 13:16:06.433756 12798 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.419517 12848 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:16:06.434597 12874 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:16:06.445777 10593 rpcz_store.cc:276] 0709 13:16:04.952573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.952712 (+   139us) service_pool.cc:224] Handling call
0709 13:16:04.990596 (+ 37884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.257640 (+267044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.431208 (+1173568us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001e3cd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:06.431437 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494847232}
W20260709 13:16:06.376294 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 59756.9us
I20260709 13:16:06.416231 10664 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.439980 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:06.448905 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:06.449550 10743 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.442598 10588 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
W20260709 13:16:06.440024 12814 consensus_meta.cc:287] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.273s	user 0.010s	sys 0.001s
I20260709 13:16:06.432821 12705 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.440672 12825 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:06.436774 12556 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.440657 12353 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.438594 12883 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.435139 12528 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.421598 12847 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:16:06.458534 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:06.435367 12806 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:06.460984 10666 raft_consensus.cc:2393] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:06.458483 12736 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.000s
I20260709 13:16:06.448624 12647 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.468106 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:06.467171 12888 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:06.467604 12528 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:06.473297 12873 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 13:16:06.473472 12528 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:06.476209 12829 consensus_meta.cc:287] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.057s	user 0.001s	sys 0.010s
I20260709 13:16:06.469045 12825 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:06.466747 12883 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:06.471717 12840 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.974s	user 0.000s	sys 0.003s
I20260709 13:16:06.460878 12556 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:06.479322 10665 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:06.460978 12353 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:06.480265 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:06.480500 10665 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:06.436882 12860 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:06.459232 12814 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.470743 12863 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.465770 12568 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.476584 12829 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.485330 12721 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.481918 12855 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:06.503311 12871 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:06.503218 12870 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.503998 12814 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.479110 12647 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.505981 10585 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:06.506546 12815 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:06.506939 12844 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.507027 12798 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:06.507467 12825 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:06.517563 11409 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:06.560631 10743 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:06.610076 10587 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:06.501742 12721 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.769709 12727 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:06.770231 12727 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:06.771219 12727 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.773676 12727 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:06.780880 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 368208us
W20260709 13:16:06.785707 10706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.014s
W20260709 13:16:06.786090 10706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.007s	sys 0.014s
W20260709 13:16:06.786405 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 609430us
W20260709 13:16:06.787858 10708 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.004s	sys 0.016s
W20260709 13:16:06.788335 10708 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.004s	sys 0.016s
W20260709 13:16:06.788720 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 840537us
W20260709 13:16:06.831940 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.858260 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.858767 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71097.2us
I20260709 13:16:06.863130 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:06.863983 10743 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:06.883761 10735 raft_consensus.cc:2410] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:06.883848 12876 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.499193 12353 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.758605 12815 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:06.893668 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:06.894409 10665 raft_consensus.cc:2368] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:06.760315 12721 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.851276 12736 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.895288 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:06.899091 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:06.502966 12806 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:06.885915 11413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.006s	sys 0.014s
W20260709 13:16:06.885021 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 572656us
I20260709 13:16:06.881670 12762 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.857662 12883 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:06.887212 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 105546us
I20260709 13:16:06.904910 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:06.888494 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:06.909075 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:06.909946 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.010s	sys 0.022s
I20260709 13:16:06.912089 10660 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.886296 12790 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.912120 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.022s
I20260709 13:16:06.886096 12798 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.912964 10669 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:06.891389 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1201) took 1859 ms. Trace:
I20260709 13:16:06.914813 12829 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:06.916769 12883 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.918154 12643 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.919302 12528 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.889926 12879 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:06.894554 12843 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:06.903187 11411 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:06.923560 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.924391 10665 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [5.2-6.3]
I20260709 13:16:06.879856 12733 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:06.902731 12624 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:06.924002 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 190) took 1500 ms. Trace:
W20260709 13:16:06.908504 12766 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 3.299s	user 0.012s	sys 0.011s
I20260709 13:16:06.921741 10589 rpcz_store.cc:276] 0709 13:16:05.031921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.155073 (+123152us) service_pool.cc:224] Handling call
0709 13:16:05.170336 (+ 15263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.262106 (+ 91770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.262138 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.262181 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:05.262221 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.891190 (+1628969us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b540016a154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:06.891234 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.891342 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210580224}
I20260709 13:16:06.882122 12863 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:16:07.009560 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 84023.9us
I20260709 13:16:07.027647 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:07.009967 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.018s
I20260709 13:16:06.903101 12736 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.898741 12876 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.926401 12798 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.034678 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:07.016194 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.013s
I20260709 13:16:06.858161 12844 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:07.012133 12675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.009s
I20260709 13:16:07.019557 12587 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:07.023644 12624 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.035717 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:07.036716 10665 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.037885 12624 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.024211 10743 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:06.921908 12790 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.979017 12643 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:07.028646 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.018s
W20260709 13:16:07.044243 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 654215us
I20260709 13:16:07.029838 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:06.920965 12762 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:06.956387 12804 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:06.978858 12883 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:07.050437 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.035642 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.013s
I20260709 13:16:07.014101 12829 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:16:07.049597 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 142604us
I20260709 13:16:07.020450 10734 rpcz_store.cc:276] 0709 13:16:05.423641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.424096 (+   455us) service_pool.cc:224] Handling call
0709 13:16:05.424835 (+   739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.651814 (+226979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.651843 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.651881 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:05.651914 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.923806 (+1271892us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540032fd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:06.923849 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.923955 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521501568}
W20260709 13:16:07.038890 12675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.009s
I20260709 13:16:07.039711 10660 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:06.908563 12815 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:07.052145 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 666309us
I20260709 13:16:06.983526 12528 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.033965 12759 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.102787 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.146631 10660 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:07.043859 12624 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.153764 10665 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:07.152640 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:07.048349 12892 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:07.157954 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:07.049254 12460 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.050468 12568 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.157199 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:07.169370 10665 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.105109 12887 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.169554 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:07.102214 12814 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.171873 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.102353 12896 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.138110 12888 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.177500 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1121) took 4190 ms. Trace:
I20260709 13:16:07.156330 12815 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.046555 12587 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.105544 12889 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:16:07.161545 12759 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:07.214274 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 109931us
W20260709 13:16:07.183189 12890 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:16:07.172611 12460 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:07.184590 10738 rpcz_store.cc:276] 0709 13:16:02.981103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.072216 (+ 91113us) service_pool.cc:224] Handling call
0709 13:16:03.156126 (+ 83910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.156391 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.156426 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.183122 (+ 26696us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.489094 (+305972us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:03.489140 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.489225 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.908115 (+3418890us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b24001f0298. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420b09d 00007f4256e3d10e 00007f4256e5488c 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221
0709 13:16:07.161303 (+253188us) raft_consensus.cc:1685] finished
0709 13:16:07.161348 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.171621 (+ 10273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10365184,"thread_start_us":165384,"threads_started":1,"wal-append.queue_time_us":313775}
I20260709 13:16:07.224251 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.224551 10557 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:07.224852 10660 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:07.225850 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:07.227229 12898 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 13:16:07.185840 12814 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:07.178453 12896 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.181970 12887 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.239310 12887 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:07.217151 12622 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.192s	user 0.010s	sys 0.002s
I20260709 13:16:07.242695 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.170581 12624 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:07.174618 12892 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.231748 12675 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:07.236882 12896 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.270231 12798 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.215214 12888 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.245477 12622 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:07.250747 12556 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.004s
I20260709 13:16:07.245600 12803 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:07.290982 10665 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:07.251125 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:07.236107 12460 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.307014 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:07.307736 12900 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:16:07.307751 10665 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:07.309005 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:07.309373 12906 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:16:07.309619 12888 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.310668 12528 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:07.310878 12904 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:07.310997 12897 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.311219 12528 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.311599 12528 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.273864 12750 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:07.314450 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.282770 12876 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.312389 12528 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.328148 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:07.304363 12643 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.311564 12897 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.317462 12804 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:07.317782 12736 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.315819 12750 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:07.273237 12675 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.293278 12556 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.324890 12803 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:07.325300 12818 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:07.328905 12565 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:07.338610 12750 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.341449 12913 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:07.337917 12894 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:16:07.291956 12759 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.345032 12916 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:07.345659 10666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1452) took 1560 ms (client timeout 1933 ms). Trace:
I20260709 13:16:07.346449 10663 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.335688 12804 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:07.361754 10666 rpcz_store.cc:269] 0709 13:16:05.784910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.785013 (+   103us) service_pool.cc:224] Handling call
0709 13:16:07.345482 (+1560469us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540041f854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:07.345608 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444296064}
I20260709 13:16:07.352624 11415 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:07.374841 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.376351 12892 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.343053 12762 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.384737 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.375336 12622 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.379904 12901 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:07.380791 12750 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.353602 12565 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.359488 12844 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.364215 12913 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:07.399739 12587 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.402331 12565 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.403884 12864 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:07.404102 12705 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.942s	user 0.004s	sys 0.004s
I20260709 13:16:07.404349 12864 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:07.351023 12818 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.397673 12762 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.427780 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.389336 12916 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.428699 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 251) took 2366 ms. Trace:
I20260709 13:16:07.430259 10666 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:07.423496 12913 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.348556 12803 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.459079 12916 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.429668 12762 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.464169 12832 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.894s	user 0.000s	sys 0.013s
I20260709 13:16:07.469616 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.404712 12705 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:07.444126 12883 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.473388 12804 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.467092 12762 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.466727 12460 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.472930 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1206) took 2434 ms. Trace:
I20260709 13:16:07.483156 10590 rpcz_store.cc:276] 0709 13:16:05.035856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.200234 (+164378us) service_pool.cc:224] Handling call
0709 13:16:05.208123 (+  7889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.208314 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:05.244433 (+ 36119us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.282098 (+2037665us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18003281e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:07.469927 (+187829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.469993 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:07.470065 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.470156 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.470280 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35583,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":7503,"raft.queue_time_us":2561,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5185920,"thread_start_us":186757,"threads_started":1}
I20260709 13:16:07.491225 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.491979 10666 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:07.500890 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1207) took 2438 ms. Trace:
I20260709 13:16:07.501046 12705 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.501396 10594 rpcz_store.cc:276] 0709 13:16:05.062848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.168591 (+105743us) service_pool.cc:224] Handling call
0709 13:16:05.168849 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.317589 (+148740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.500620 (+2183031us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b540008af54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:07.500822 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132246272}
I20260709 13:16:07.503487 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 156) took 1650 ms. Trace:
I20260709 13:16:07.504017 10662 rpcz_store.cc:276] 0709 13:16:05.852630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.905392 (+ 52762us) service_pool.cc:224] Handling call
0709 13:16:05.919504 (+ 14112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.932497 (+ 12993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.932553 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.932595 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:05.932650 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.503224 (+1570574us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b540041f354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:07.503285 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.503425 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29400448}
I20260709 13:16:07.471629 12571 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.405251 12864 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.507133 12864 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.507566 12818 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.437444 11413 rpcz_store.cc:276] 0709 13:16:05.062056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.069908 (+  7852us) service_pool.cc:224] Handling call
0709 13:16:06.363395 (+1293487us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:06.363583 (+   188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.364037 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.364075 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.365184 (+  1109us) log.cc:844] Serialized 548 byte log entry
0709 13:16:06.921275 (+556091us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:06.930192 (+  8917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.980882 (+ 50690us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.427204 (+446322us) raft_consensus.cc:1685] finished
0709 13:16:07.427228 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.428616 (+  1388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24156032,"thread_start_us":530091,"threads_started":1,"wal-append.queue_time_us":665928}
W20260709 13:16:07.508765 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.509657 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.511513 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.512470 10662 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:07.513464 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:07.513646 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.472164 12675 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:07.514245 10666 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:07.516395 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:07.516191 12914 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:07.518139 10662 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:07.519718 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:07.520825 10666 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.522317 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.524998 10662 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:07.530453 12895 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:16:07.528242 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.531342 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:07.533675 11412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 301) took 2019 ms (client timeout 2055 ms). Trace:
W20260709 13:16:07.534062 11412 rpcz_store.cc:269] 0709 13:16:05.514412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.537574 (+ 23162us) service_pool.cc:224] Handling call
0709 13:16:07.531187 (+1993613us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:07.533622 (+  2435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3878144}
I20260709 13:16:07.531684 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1510) took 1117 ms. Trace:
I20260709 13:16:07.535252 10736 rpcz_store.cc:276] 0709 13:16:06.414473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.414582 (+   109us) service_pool.cc:224] Handling call
0709 13:16:06.414878 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.415205 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.415230 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.417897 (+  2667us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.809589 (+391692us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:06.809631 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.809723 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.431666 (+621943us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:07.531385 (+ 99719us) raft_consensus.cc:1685] finished
0709 13:16:07.531406 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.531631 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3307,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":2155,"spinlock_wait_cycles":16701696,"thread_start_us":391265,"threads_started":1,"wal-append.queue_time_us":607400}
I20260709 13:16:07.536320 12719 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.537513 12708 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.517535 12556 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:07.549459 12721 consensus_meta.cc:287] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.005s
I20260709 13:16:07.491318 12897 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.558311 12803 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.563705 12790 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.518602 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:07.528218 12913 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:07.573463 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 328464us
I20260709 13:16:07.574429 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:07.577690 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.579005 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.579515 10586 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:07.581447 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.584865 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.586514 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.589260 10662 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:07.590495 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.591545 10591 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:07.593513 10588 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:07.586620 12559 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:07.595909 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.598346 12919 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.598821 12919 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.598855 12913 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.599301 12919 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.596514 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.600230 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.600869 10588 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:16:07.601656 10589 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:07.597268 10590 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:07.550030 12721 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.602734 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:07.603433 11417 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.595557 12559 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.607870 12559 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.600502 12790 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.613628 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.614246 10666 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:07.615085 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:07.615964 10662 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:07.617416 10588 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:07.618044 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:07.619596 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.620414 10589 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:07.620733 12721 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.621409 11413 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:07.621263 12747 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.622296 12762 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.622733 12790 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:07.622599 12747 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.623406 12790 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.624624 12762 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.624722 12747 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.595687 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:07.622334 10666 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:07.626767 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.771493 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:07.771756 10590 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:16:07.771893 10668 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:07.772737 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:07.636878 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.745133 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:07.774236 10591 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:07.698663 12528 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.775290 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:07.626683 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:07.698391 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:07.775882 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.772670 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.694599 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.673270 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:07.776029 12759 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:07.653365 10592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1689) took 1654 ms (client timeout 1899 ms). Trace:
I20260709 13:16:07.776878 12922 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.636622 11412 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:07.777750 10590 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.646574 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 183) took 3111 ms. Trace:
I20260709 13:16:07.781719 10736 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.641376 12790 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.782186 10589 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
W20260709 13:16:07.788568 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 161951us
I20260709 13:16:07.782958 11417 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:16:07.785847 10592 rpcz_store.cc:269] 0709 13:16:05.996956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.001743 (+  4787us) service_pool.cc:224] Handling call
0709 13:16:07.649785 (+1648042us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b540039d5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:07.651291 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47260928}
I20260709 13:16:07.791544 10594 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
W20260709 13:16:07.782927 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 215670us
I20260709 13:16:07.793653 12859 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.794123 12859 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:07.796057 12859 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:07.788094 10741 rpcz_store.cc:276] 0709 13:16:04.535242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.628097 (+ 92855us) service_pool.cc:224] Handling call
0709 13:16:04.628335 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.221261 (+592926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.221296 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.221352 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:05.221385 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.646305 (+2424920us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540036ced4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:07.646364 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.646508 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363149056}
W20260709 13:16:07.782526 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.799964 12771 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:07.800344 12771 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:07.801126 12771 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.802240 12771 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:07.802522 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.785518 12792 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.798594 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.810056 10741 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 2.
I20260709 13:16:07.811025 10736 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:07.812404 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.812925 10736 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:07.811100 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.813886 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:07.779870 12825 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.811302 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.814090 10741 raft_consensus.cc:2410] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:07.815549 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.817247 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.818773 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.817998 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.819330 10736 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:07.821363 10741 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:07.826412 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.828203 10741 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:07.644111 12896 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:07.809557 12859 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:07.829448 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:07.827556 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.816152 12719 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:07.830618 12849 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.830539 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.816423 12624 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.835713 10741 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:07.835830 10560 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.770377 12869 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.798318 12922 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.901489 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:07.912777 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.901006 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.837550 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:07.895179 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 60223.7us
I20260709 13:16:07.913878 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.891650 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:07.913709 10736 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:07.916617 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 80853.6us
I20260709 13:16:07.917668 10669 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:07.918013 10560 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:07.865491 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.891394 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.918352 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.918848 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.923008 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.923141 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:07.924419 12792 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.924376 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.922652 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:07.859431 12849 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:07.966341 12790 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 13:16:07.913024 11412 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:16:07.877328 12721 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:08.116233 12721 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:07.847163 12528 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:07.847090 12897 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:08.119856 12897 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:08.120402 12897 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.920060 12806 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.125736 12806 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:08.126590 12857 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.126925 12928 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:16:07.924952 12792 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:08.063612 12935 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.138s	user 0.000s	sys 0.007s
I20260709 13:16:08.139189 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:07.938866 10736 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:07.925107 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:07.925998 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:07.924988 12869 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:08.015429 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.118716 12721 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:08.170660 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.139875 10743 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:16:08.175369 11417 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:08.155261 12824 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.180725 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:08.181031 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 261802us
I20260709 13:16:08.188658 10592 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.180110 12792 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.194492 12922 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:07.932199 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:08.077416 12913 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:08.023505 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 44946us
I20260709 13:16:08.182497 10589 raft_consensus.cc:2410] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:08.183673 12809 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:08.183949 12926 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:16:07.920439 12924 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:08.186141 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:08.171363 12806 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.195619 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1470) took 1109 ms. Trace:
I20260709 13:16:08.198057 10590 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:16:08.198375 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 266212us
I20260709 13:16:08.077766 12919 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:08.202809 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:08.206140 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:08.207553 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:08.201956 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.837811 12859 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:08.201397 10662 rpcz_store.cc:276] 0709 13:16:07.086701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.625683 (+538982us) service_pool.cc:224] Handling call
0709 13:16:07.637624 (+ 11941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.644160 (+  6536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.644188 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.780977 (+136789us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.926798 (+145821us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.926834 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.926894 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.195405 (+268511us) raft_consensus.cc:1685] finished
0709 13:16:08.195426 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.195552 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2535,"thread_start_us":110552,"threads_started":1,"wal-append.queue_time_us":127045}
W20260709 13:16:08.213876 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.200243 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:08.211898 12255 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.177213 12857 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:08.199466 12809 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:08.242269 10706 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:08.203430 12922 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:08.222632 12859 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:08.228364 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1463) took 2440 ms. Trace:
I20260709 13:16:08.195639 12896 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:08.212381 12721 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:08.232491 10660 raft_consensus.cc:2410] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:08.211484 12790 raft_consensus.cc:2764] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:08.236232 12806 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:08.199932 12824 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:08.238169 10592 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:08.239265 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:08.203090 12913 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:08.260646 10667 rpcz_store.cc:276] 0709 13:16:05.787612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.858532 (+ 70920us) service_pool.cc:224] Handling call
0709 13:16:05.858791 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.932660 (+ 73869us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:05.939126 (+  6466us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.965916 (+ 26790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.965977 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:05.966059 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.228114 (+2262055us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54000c3854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:08.228156 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.228283 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7252,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":7665,"raft.queue_time_us":33660,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7321,"spinlock_wait_cycles":169417088,"thread_start_us":26468,"threads_started":1,"wal-append.queue_time_us":73639,"wal-append.run_cpu_time_us":2607,"wal-append.run_wall_time_us":1452293}
I20260709 13:16:08.212441 12528 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:08.222311 12353 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.266080 12624 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:08.298614 12624 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:08.299021 12624 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:08.300096 11409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 253) took 3220 ms (client timeout 1958 ms). Trace:
I20260709 13:16:08.266575 12721 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:08.260324 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:08.240294 12255 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:08.261940 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:08.297294 12897 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:08.300855 12528 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:09.083946 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:08.756318 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1469) took 2822 ms. Trace:
I20260709 13:16:09.098131 10661 rpcz_store.cc:276] 0709 13:16:05.933464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.964606 (+ 31142us) service_pool.cc:224] Handling call
0709 13:16:05.986801 (+ 22195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.006915 (+ 20114us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:06.029835 (+ 22920us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.293826 (+263991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.293872 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:06.293917 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.756080 (+2462163us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54000c1f54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:08.756119 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.756259 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4689,"prepare.queue_time_us":27421,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":3454,"raft.queue_time_us":7202,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2725,"spinlock_wait_cycles":45782784,"thread_start_us":258980,"threads_started":1,"wal-append.queue_time_us":332501,"wal-append.run_cpu_time_us":986,"wal-append.run_wall_time_us":1008804}
W20260709 13:16:09.085246 11381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.007s	sys 0.007s
I20260709 13:16:08.245021 12903 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:09.085515 12729 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.799969 10668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.011s	sys 0.006s
W20260709 13:16:09.142057 10668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.012s	sys 0.010s
I20260709 13:16:08.471231 10743 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:09.143198 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1169) took 1352 ms. Trace:
I20260709 13:16:09.143612 10743 rpcz_store.cc:276] 0709 13:16:07.790676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.470233 (+679557us) service_pool.cc:224] Handling call
0709 13:16:08.470742 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.142904 (+672162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.143138 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.343181 10741 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:09.145191 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1168) took 1354 ms. Trace:
I20260709 13:16:09.145511 10741 rpcz_store.cc:276] 0709 13:16:07.790539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.308667 (+518128us) service_pool.cc:224] Handling call
0709 13:16:08.308977 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.144967 (+835990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.145143 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:09.049021 10666 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.001s	sys 0.016s
W20260709 13:16:09.146263 10666 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.001s	sys 0.017s
I20260709 13:16:09.147300 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1471) took 2043 ms. Trace:
I20260709 13:16:08.245409 12809 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.729242 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1519) took 1032 ms. Trace:
I20260709 13:16:09.147603 10666 rpcz_store.cc:276] 0709 13:16:07.103825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.742155 (+638330us) service_pool.cc:224] Handling call
0709 13:16:07.779184 (+ 37029us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:07.799296 (+ 20112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.799329 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:07.799836 (+   507us) log.cc:844] Serialized 52 byte log entry
0709 13:16:08.173722 (+373886us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:09.146568 (+972846us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.146899 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.147034 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.147096 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.147132 (+    36us) raft_consensus.cc:1685] finished
0709 13:16:09.147143 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.147253 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7862,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9881,"thread_start_us":1334577,"threads_started":2,"wal-append.queue_time_us":443803}
I20260709 13:16:09.150645 10736 rpcz_store.cc:276] 0709 13:16:07.697245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.180296 (+483051us) service_pool.cc:224] Handling call
0709 13:16:08.186501 (+  6205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.186628 (+   127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.186643 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.186678 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:08.186699 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.186730 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.728980 (+542250us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b540036d8d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:08.729162 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13493632}
I20260709 13:16:08.836020 12576 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:09.073966 12846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.779s	user 0.017s	sys 0.025s
I20260709 13:16:09.087572 10738 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:09.156976 12913 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:08.429831 12771 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:16:08.305370 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 306) took 1416 ms. Trace:
I20260709 13:16:09.158468 11415 rpcz_store.cc:276] 0709 13:16:06.889086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.889228 (+   142us) service_pool.cc:224] Handling call
0709 13:16:06.889536 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.374701 (+485165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.305081 (+930380us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400673c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:08.305294 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064250752}
W20260709 13:16:08.776290 10560 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.002s	sys 0.010s
I20260709 13:16:09.088088 12721 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:09.083678 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 163) took 1899 ms (client timeout 1761 ms). Trace:
W20260709 13:16:09.159977 10560 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.002s	sys 0.016s
W20260709 13:16:09.160293 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 971027us
W20260709 13:16:09.160126 10660 rpcz_store.cc:269] 0709 13:16:07.184065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.225616 (+ 41551us) service_pool.cc:224] Handling call
0709 13:16:08.476953 (+1251337us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000c2e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:09.083608 (+606655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313205632}
I20260709 13:16:09.084286 12528 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.392604 12570 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.088752 12897 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:08.300509 11409 rpcz_store.cc:269] 0709 13:16:05.079157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.095719 (+ 16562us) service_pool.cc:224] Handling call
0709 13:16:08.299871 (+3204152us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400347bd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:08.299991 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641284864}
I20260709 13:16:09.089555 12716 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:08.393260 10742 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:08.835703 10585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1694) took 2595 ms (client timeout 1894 ms). Trace:
I20260709 13:16:09.082563 12919 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.084918 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 264) took 1252 ms. Trace:
I20260709 13:16:09.084904 12857 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:08.391479 10740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1159) took 2525 ms (client timeout 2101 ms). Trace:
W20260709 13:16:09.173126 10740 rpcz_store.cc:269] 0709 13:16:05.865900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.925139 (+ 59239us) service_pool.cc:224] Handling call
0709 13:16:08.391256 (+2466117us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002beb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:08.391386 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252699392}
I20260709 13:16:08.854341 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 172) took 3218 ms. Trace:
W20260709 13:16:08.622373 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.261628 12922 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:09.165297 12624 consensus_meta.cc:287] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.002s
W20260709 13:16:08.851776 10558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.011s
W20260709 13:16:09.179880 10558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.012s	sys 0.011s
I20260709 13:16:09.106536 12920 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:08.783351 12924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.009s	sys 0.017s
W20260709 13:16:09.106782 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.537254 12899 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.560081 12825 consensus_meta.cc:287] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 13:16:08.303030 12824 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.083649 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1782) took 2605 ms. Trace:
I20260709 13:16:08.365005 12849 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:09.017552 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.001s	sys 0.020s
I20260709 13:16:09.109619 12255 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:08.384692 12792 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:08.394637 12549 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:08.565201 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.207887 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.393181 10586 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
W20260709 13:16:09.112618 11381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.007s	sys 0.007s
I20260709 13:16:08.835104 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1460) took 3048 ms. Trace:
I20260709 13:16:09.115437 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.209585 11417 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 2.
I20260709 13:16:09.117949 10667 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:09.124790 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.149369 10737 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:09.211263 10737 pending_rounds.cc:85] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:09.211516 10737 pending_rounds.cc:107] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:09.211733 10737 raft_consensus.cc:2889] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.151525 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.152832 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1174) took 1361 ms. Trace:
I20260709 13:16:09.153796 10661 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.154410 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.212564 10741 rpcz_store.cc:276] 0709 13:16:07.791451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.152277 (+1360826us) service_pool.cc:224] Handling call
0709 13:16:09.152521 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.152642 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.152656 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.152681 (+    25us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:09.152708 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.152738 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.152796 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.154246 10669 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:09.185411 12924 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:09.217918 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:09.216187 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.222371 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:09.162985 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.166921 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1173) took 1375 ms. Trace:
I20260709 13:16:09.223779 10743 rpcz_store.cc:276] 0709 13:16:07.791231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.152227 (+1360996us) service_pool.cc:224] Handling call
0709 13:16:09.166489 (+ 14262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.166651 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.166673 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.166710 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:09.166742 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.166791 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.166873 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.151208 11414 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:09.155968 12846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.886s	user 0.018s	sys 0.025s
I20260709 13:16:09.126716 12903 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:09.170287 10585 rpcz_store.cc:269] 0709 13:16:06.240727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.241552 (+   825us) service_pool.cc:224] Handling call
0709 13:16:08.835445 (+2593893us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002a8354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:08.835596 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605249920}
I20260709 13:16:09.175716 12814 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:09.008198 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1492) took 3359 ms (client timeout 2044 ms). Trace:
I20260709 13:16:09.172394 11416 rpcz_store.cc:276] 0709 13:16:07.832708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.833294 (+   586us) service_pool.cc:224] Handling call
0709 13:16:08.303927 (+470633us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:09.084862 (+780935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11333504}
I20260709 13:16:09.274263 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:09.180516 10740 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:09.181574 12919 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:09.182862 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:09.152004 12729 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.172444 12716 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:09.292284 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.293017 10662 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
W20260709 13:16:09.191088 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.193440 10663 rpcz_store.cc:276] 0709 13:16:06.478022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.478164 (+   142us) service_pool.cc:224] Handling call
0709 13:16:07.346264 (+868100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.362370 (+ 16106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.299583 (+937213us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540041f850. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:09.083589 (+784006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992247040}
I20260709 13:16:09.179430 12922 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:09.196480 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.001s	sys 0.022s
W20260709 13:16:09.296978 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.07022e+06us
W20260709 13:16:09.296558 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 153179us
I20260709 13:16:09.216162 12739 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.298331 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.298591 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 76294.7us
I20260709 13:16:09.176676 12806 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.181423 12920 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:09.301363 12755 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:09.195518 11379 connection.cc:256] RPC call timeout handler was delayed by -1.086274794000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:16:09.209126 10664 rpcz_store.cc:276] 0709 13:16:05.786918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.849523 (+ 62605us) service_pool.cc:224] Handling call
0709 13:16:05.851173 (+  1650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.447945 (+596772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.834791 (+2386846us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000b3bd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:08.835031 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298868224}
I20260709 13:16:09.302194 12647 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:09.186323 12863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.129s	user 0.021s	sys 0.045s
W20260709 13:16:09.302829 12863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.256s	user 0.021s	sys 0.046s
I20260709 13:16:09.302824 12878 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:09.303402 12863 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:09.301891 12755 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.303993 12863 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.305207 12643 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:09.305985 12755 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.306133 12721 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.302891 12647 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:09.193553 12205 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.195699 12825 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.189615 12899 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.174098 10587 rpcz_store.cc:276] 0709 13:16:05.636128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.650835 (+ 14707us) service_pool.cc:224] Handling call
0709 13:16:05.651103 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.758331 (+1107228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.854140 (+2095809us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54002c97d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:08.854287 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204848512}
I20260709 13:16:09.301105 12849 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:09.274542 10735 rpcz_store.cc:269] 0709 13:16:05.648642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.648752 (+   110us) service_pool.cc:224] Handling call
0709 13:16:09.007878 (+3359126us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540014cb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:09.008105 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736764672}
I20260709 13:16:09.288400 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.289374 10666 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.184424 12624 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.356593 12899 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.358094 12624 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.358654 12624 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.359233 12624 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:09.359663 12624 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.363451 10736 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:09.364306 12716 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.365207 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1177) took 1573 ms. Trace:
I20260709 13:16:09.365693 12716 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.365593 10736 rpcz_store.cc:276] 0709 13:16:07.792077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.155275 (+1363198us) service_pool.cc:224] Handling call
0709 13:16:09.155509 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.363880 (+208371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.365007 (+  1127us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540036c9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:09.365156 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477826816}
I20260709 13:16:09.366868 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.367492 10736 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4.
I20260709 13:16:09.369110 11382 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4.
I20260709 13:16:09.369402 11382 leader_election.cc:403] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:09.369921 12771 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.370342 12771 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:09.370764 10586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1717) took 1676 ms (client timeout 1657 ms). Trace:
W20260709 13:16:09.371179 10586 rpcz_store.cc:269] 0709 13:16:07.694068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.694208 (+   140us) service_pool.cc:224] Handling call
0709 13:16:09.370598 (+1676390us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540020fb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:09.370692 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406692096}
I20260709 13:16:09.372222 12771 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.372702 12771 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.376453 10594 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:09.291908 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 1.03159e+06us
W20260709 13:16:09.294009 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.294231 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.294835 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1478) took 1984 ms. Trace:
I20260709 13:16:09.377841 10660 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:09.378584 10706 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:09.296344 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.299487 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:09.379609 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 80191.2us
I20260709 13:16:09.379760 10706 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:09.301507 10743 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 8. Ops: []
I20260709 13:16:09.381578 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 204) took 1146 ms. Trace:
I20260709 13:16:09.381910 10743 rpcz_store.cc:276] 0709 13:16:08.235481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.270846 (+1035365us) service_pool.cc:224] Handling call
0709 13:16:09.301336 (+ 30490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.381272 (+ 79936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.381517 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:09.302044 11379 connection.cc:256] RPC call timeout handler was delayed by -1.0695093300000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:16:09.301872 12920 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.141853 12808 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.217074 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.287983 12903 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.325592 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 265) took 1425 ms. Trace:
I20260709 13:16:09.275715 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 198) took 1041 ms. Trace:
I20260709 13:16:09.423743 10740 rpcz_store.cc:276] 0709 13:16:08.234026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.179998 (+945972us) service_pool.cc:224] Handling call
0709 13:16:09.180248 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.275403 (+ 95155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.275652 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.323781 12721 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.322494 12570 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:09.348932 12954 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:09.350399 12863 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.350926 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.351825 10665 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:09.299358 12846 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.299464 12759 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.297350 12919 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.410641 12825 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.354573 12792 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.295127 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.377728 10668 rpcz_store.cc:276] 0709 13:16:07.310757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.938461 (+627704us) service_pool.cc:224] Handling call
0709 13:16:08.075702 (+137241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.107864 (+ 32162us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:09.142486 (+1034622us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.294504 (+152018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.294556 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.294603 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.294675 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.294774 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1088486,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":2542,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":21010,"thread_start_us":1184968,"threads_started":2,"wal-append.queue_time_us":206653}
I20260709 13:16:09.375800 12849 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.388718 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1160) took 3522 ms. Trace:
I20260709 13:16:09.398725 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.403080 10666 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:09.303463 12878 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:09.411425 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 220900us
I20260709 13:16:09.387043 12946 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.308022 12739 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.462803 11416 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.652985 12920 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.436113 12570 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:09.583092 12576 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.648231 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 264007us
I20260709 13:16:09.363451 12729 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.438524 12912 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.248s
I20260709 13:16:09.376431 12205 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.686308 12759 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.525842 12721 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.699005 10737 rpcz_store.cc:276] 0709 13:16:05.866123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.223562 (+357439us) service_pool.cc:224] Handling call
0709 13:16:09.076678 (+2853116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.217784 (+141106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.388461 (+170677us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b540014cb50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:09.388646 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6403060992}
I20260709 13:16:09.687012 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.700446 11417 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:09.631714 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 249657us
I20260709 13:16:09.701309 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:09.686756 12849 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.687376 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.687654 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.688611 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.439494 12814 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:09.689249 11412 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:09.703919 12814 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.688958 10735 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:09.705480 12771 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4.
I20260709 13:16:09.705893 12814 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.705802 12570 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.690750 11410 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:09.701584 10661 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:09.706892 10661 pending_rounds.cc:85] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 1
I20260709 13:16:09.706655 12954 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.707223 10661 pending_rounds.cc:107] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:09.707509 10661 raft_consensus.cc:2889] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.707566 12576 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.634174 12624 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.708683 12954 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.652488 12899 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:09.462235 10489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 203) took 11693 ms (client timeout 15000 ms). Trace:
I20260709 13:16:09.658624 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.711040 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:09.665957 12922 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.569226 12601 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.589103 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.711938 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:09.688060 10669 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:09.689458 12946 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.713454 12863 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.713944 12946 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.652649 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:09.714428 12863 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:09.714289 12825 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:09.714964 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62399.7us
I20260709 13:16:09.716068 12955 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:09.716355 12959 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.716612 12955 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:09.571815 12528 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.717518 12624 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.688654 12878 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.706876 12205 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.717795 12955 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.718336 12959 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.715489 12863 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:09.718739 12959 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:09.420324 12824 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:09.709615 12899 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.713361 12922 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.720183 11413 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:09.721069 12824 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.721566 12824 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.721894 12899 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.690591 12919 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.719666 12959 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.724918 12959 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.419716 12808 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.726166 12946 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.726989 12808 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.612816 12950 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:09.709767 10489 rpcz_store.cc:269] 0709 13:15:57.768342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.768499 (+   157us) service_pool.cc:224] Handling call
0709 13:16:09.462163 (+11693664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:01.896145 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:01.896794 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:01.896848 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:16:01.896880 (+    32us) tablet.cc:662] Decoding operations
0709 13:16:01.897766 (+   886us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:01.897864 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:01.897895 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:01.898568 (+   673us) tablet.cc:701] Row locks acquired
0709 13:16:01.898608 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:16:01.898751 (+   143us) write_op.cc:270] Start()
0709 13:16:01.898884 (+   133us) write_op.cc:276] Timestamp: P: 1783602961898691 usec, L: 0
0709 13:16:01.898921 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:16:01.970226 (+ 71305us) log.cc:844] Serialized 2823 byte log entry
0709 13:16:02.469574 (+499348us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f42541af0ac 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b
0709 13:16:02.668755 (+199181us) op_driver.cc:464] REPLICATION: finished
0709 13:16:03.065970 (+397215us) write_op.cc:301] APPLY: starting
0709 13:16:03.066164 (+   194us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:03.066452 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:03.066496 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:03.336600 (+270104us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:03.336978 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:16:03.337051 (+    73us) write_op.cc:312] APPLY: finished
0709 13:16:03.337466 (+   415us) log.cc:844] Serialized 59 byte log entry
0709 13:16:03.337688 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.337824 (+   136us) write_op.cc:454] Released schema lock
0709 13:16:03.337901 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:03.338334 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.338373 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":892877,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":336831,"apply.run_cpu_time_us":4571,"apply.run_wall_time_us":330656,"num_ops":7,"prepare.queue_time_us":256230,"prepare.run_cpu_time_us":18957,"prepare.run_wall_time_us":610862,"raft.queue_time_us":116676,"raft.run_cpu_time_us":28810,"raft.run_wall_time_us":81290,"replication_time_us":769661,"spinlock_wait_cycles":2435968,"thread_start_us":818863,"threads_started":4,"wal-append.queue_time_us":525571,"wal-append.run_cpu_time_us":18454,"wal-append.run_wall_time_us":1819614}]]}
I20260709 13:16:09.728106 12946 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.728295 12950 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:09.729468 12950 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.711931 12601 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.711302 10586 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:09.732077 12570 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:09.732539 10560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.008s
W20260709 13:16:09.732923 10560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.008s
I20260709 13:16:09.733754 12846 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.734620 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:09.719509 12528 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.735292 10735 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:09.709614 12576 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.732754 12849 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.421949 11418 rpcz_store.cc:276] 0709 13:16:07.899752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.899932 (+   180us) service_pool.cc:224] Handling call
0709 13:16:07.906685 (+  6753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.911169 (+  4484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.911200 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.917536 (+  6336us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.262106 (+344570us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:08.262148 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.279455 (+ 17307us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.325383 (+1045928us) raft_consensus.cc:1685] finished
0709 13:16:09.325409 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.325528 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6733,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":192633,"threads_started":1,"wal-append.queue_time_us":1239962}
I20260709 13:16:09.737891 10737 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.738315 12849 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.561028 10491 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 6, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 6 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.736164 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:09.572809 12924 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.600839 12903 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.740404 10738 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.741978 12903 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:09.656394 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.743001 10743 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:09.734395 12846 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.575341 12902 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:16:09.742924 10491 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.744808 10491 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 6 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.745702 12739 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.746465 10740 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:09.746943 10740 pending_rounds.cc:85] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:09.747217 10740 pending_rounds.cc:107] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:09.747504 10740 raft_consensus.cc:2889] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.618088 12809 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.745632 12846 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.713956 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:09.748553 10491 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 3 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:09.714108 12792 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.750168 12809 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:09.654389 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 375007us
I20260709 13:16:09.750762 12903 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:09.750808 10491 catalog_manager.cc:5697] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.751585 12903 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:09.752665 12903 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:09.754220 10491 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:16:09.750905 12792 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:09.755622 10491 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 2 to 3, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:16:09.756528 10708 leader_election.cc:336] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.686s (SENT)
I20260709 13:16:09.757117 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:09.757658 12792 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:09.668929 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.759027 10585 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
W20260709 13:16:09.736632 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 518754us
I20260709 13:16:09.764207 11416 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.766062 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.766639 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.767148 10589 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.767800 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.767901 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.767185 10590 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:09.769622 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.701013 12721 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:09.713068 10635 connection.cc:256] RPC call timeout handler was delayed by -2.0722853059999125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 13:16:09.773511 10737 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:09.716495 12825 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:09.780517 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.783394 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:09.785430 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.774178 10708 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.701s (SENT)
I20260709 13:16:09.794329 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.795312 10592 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:09.787593 10588 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:09.787758 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:09.788888 10585 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:09.789950 10586 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:09.790747 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.783310 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:09.798991 11416 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.791078 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.799806 10591 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:09.801831 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:09.802356 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.802675 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:09.802964 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.803474 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.791319 10491 catalog_manager.cc:5697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:09.792816 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.803536 10666 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:09.792577 10587 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:09.824030 12958 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.821754 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.823839 12955 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:09.701025 12759 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:09.801549 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:09.824582 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.825357 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1726) took 1904 ms. Trace:
I20260709 13:16:09.796303 12806 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.782764 12528 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:09.802394 10737 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:09.803478 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.791539 12576 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:09.835000 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.835515 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.835891 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:09.782349 12850 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:09.782970 12919 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:09.837481 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.877884 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.900053 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.869354 10491 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:09.898106 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 96055.5us
I20260709 13:16:09.854460 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.922147 11416 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:09.967437 10594 rpcz_store.cc:276] 0709 13:16:07.921169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.926206 (+  5037us) service_pool.cc:224] Handling call
0709 13:16:08.147727 (+221521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.376903 (+1229176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.825071 (+448168us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001e32d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:09.825274 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2825415552}
I20260709 13:16:09.978427 10665 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:09.916939 10708 leader_election.cc:336] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.831s (SENT)
I20260709 13:16:09.978685 10669 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:09.979318 10743 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:09.979362 10736 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:09.982388 10668 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:09.979579 10663 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:09.822789 12205 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.980228 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:09.979262 10491 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 5, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 5 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:09.978293 10667 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:09.878090 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.014292 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:09.877761 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.011521 10491 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 2 to 3, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.024024 10737 raft_consensus.cc:2410] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:10.007668 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:09.825374 12721 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.024987 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:09.941514 12969 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:16:10.031509 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.031809 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.027812 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.032526 10589 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:10.033604 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.024977 10666 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:10.028263 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.028477 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.034981 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.991914 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.010268 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.819087 12814 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:10.039101 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.042449 10590 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:10.027138 12759 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.030037 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.045089 10737 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:10.046033 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.046528 10737 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:10.046262 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.047030 10590 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.833056 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:10.026532 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 109633us
I20260709 13:16:10.034507 10592 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:10.029127 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 48966.7us
I20260709 13:16:10.035265 10591 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:10.053862 10708 leader_election.cc:336] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.899s (SENT)
I20260709 13:16:10.022428 10735 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:10.034085 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.987206 12528 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.038054 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.038619 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.058646 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.059082 10585 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.059804 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.061038 10592 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:09.832580 12959 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:10.011214 12576 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.039737 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.042361 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.030444 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.074514 10586 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.036602 10736 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:10.047068 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.024899 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.028700 12955 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:16:10.080628 12955 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.080673 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.081115 12955 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:10.066082 12528 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.081398 10668 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:10.082283 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.083227 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.085736 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.085963 12955 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.086776 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.087110 12955 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.087810 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.029367 12205 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.088850 11411 raft_consensus.cc:2368] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8.
I20260709 13:16:10.062544 12759 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.090375 12205 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:10.054286 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.037253 10491 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.032922 12946 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:10.069952 10589 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:10.070731 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.091922 10491 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 3 to 5, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 5 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.099249 10743 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:10.071372 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:09.877532 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.032361 12721 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:10.078238 12971 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:10.079613 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.050302 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.086380 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 203) took 1851 ms. Trace:
I20260709 13:16:10.013437 12958 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.091753 10586 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:10.013607 12806 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.092527 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.077152 10669 raft_consensus.cc:2376] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:16:10.068408 12919 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:16:10.097872 10594 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:10.171114 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.076465 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.036223 12972 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:16:09.854588 12924 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.221s
I20260709 13:16:10.044939 12814 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.088346 10735 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:10.121596 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.289307 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.382458 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.319025 10667 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:10.097855 10668 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:10.319362 10666 raft_consensus.cc:2368] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:16:10.288735 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.291689 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.384074 10588 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:10.287070 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.380812 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:10.324003 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.319494 10741 rpcz_store.cc:276] 0709 13:16:08.235241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.215644 (+980403us) service_pool.cc:224] Handling call
0709 13:16:09.217995 (+  2351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.688326 (+470331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.688353 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.688388 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:09.688419 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.086171 (+397752us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54002be654. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:10.086215 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.086328 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081228032}
W20260709 13:16:10.287230 12950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.005s	sys 0.016s
I20260709 13:16:10.157992 10585 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:10.168572 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.389894 10736 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:16:10.390482 12570 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.001s
I20260709 13:16:10.390918 10736 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:10.391023 10660 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:10.391417 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.392063 10736 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:10.393353 12806 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:10.394508 12806 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.121511 12846 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.388084 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:10.372397 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 44538.3us
I20260709 13:16:10.321249 10591 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:10.373507 10590 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:10.375458 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1509) took 3961 ms. Trace:
I20260709 13:16:10.383647 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.120972 12863 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.323102 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.288980 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.400738 10742 rpcz_store.cc:276] 0709 13:16:06.414222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.415404 (+  1182us) service_pool.cc:224] Handling call
0709 13:16:08.393017 (+1977613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.170015 (+776998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.375198 (+1205183us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54002beb50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:10.375390 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4547344768}
W20260709 13:16:10.338439 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 284581us
I20260709 13:16:10.273267 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.388222 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.388819 10741 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:10.406517 10708 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.915s (SENT)
I20260709 13:16:10.406541 10662 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:10.388875 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.407011 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.401933 10667 raft_consensus.cc:2410] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.406939 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.405925 10586 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:10.385511 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.408016 10591 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:10.401232 10593 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.402256 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.409761 10589 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:10.161818 12946 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:10.073608 12959 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.405064 12846 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.422859 12730 raft_consensus.cc:1064] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
W20260709 13:16:10.400436 12950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.016s
I20260709 13:16:10.387370 12850 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.421113 12896 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:10.427843 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.428839 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.439178 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.440443 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.412583 12919 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.438683 12850 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:10.441919 12896 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.445873 12814 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:10.445225 10591 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:10.398684 12759 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:10.445837 12896 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:10.438669 12792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.013s	sys 0.022s
W20260709 13:16:10.447410 12792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.013s	sys 0.022s
I20260709 13:16:10.449752 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.450286 10665 raft_consensus.cc:2376] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3. Re-sending same reply.
I20260709 13:16:10.167726 12824 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:10.453727 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.446046 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:10.440928 12730 raft_consensus.cc:1068] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Unable to promote non-voter e71e2e44af1e46d8a8423ae08646bc22: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:10.463148 10559 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:10.464651 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.466871 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.467579 10668 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.463904 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.432932 12903 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:10.477834 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.445653 12850 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.466228 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.462445 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.431262 10593 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:10.454922 12950 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:10.482136 12946 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.472605 12759 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.492283 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.492801 10666 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.460938 12814 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:10.485358 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.455284 12205 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:10.512068 12205 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.514676 12205 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:10.495362 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.517331 10669 raft_consensus.cc:2376] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7. Re-sending same reply.
I20260709 13:16:10.518505 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.456467 12570 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:10.520008 12570 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.522148 10665 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:16:10.523054 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.523777 10669 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.526846 12570 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:10.497995 10668 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:10.499862 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.530282 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.531930 10668 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:16:10.531889 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.533977 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.543790 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.536223 10668 pending_rounds.cc:85] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 7
W20260709 13:16:10.588260 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.588791 10585 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:10.560078 10632 leader_election.cc:336] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 1.587s (SENT)
I20260709 13:16:10.596797 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1178) took 2797 ms. Trace:
W20260709 13:16:10.556907 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.733206 10587 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:10.640856 10739 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.733883 10739 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:10.641901 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 241903us
I20260709 13:16:10.597790 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.734804 10739 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:16:10.628929 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 194874us
I20260709 13:16:10.736099 10739 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.547565 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1485) took 1427 ms. Trace:
I20260709 13:16:10.588703 10668 pending_rounds.cc:107] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:16:10.540737 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.590195 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.737470 10668 raft_consensus.cc:2889] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.737828 10585 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:10.735563 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.545722 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.641709 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.738131 10557 leader_election.cc:400] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8.
I20260709 13:16:10.739001 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.755429 10557 leader_election.cc:403] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:10.732555 10738 rpcz_store.cc:276] 0709 13:16:07.808377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.157272 (+1348895us) service_pool.cc:224] Handling call
0709 13:16:09.157624 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.740735 (+583111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.596597 (+855862us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540036b5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:10.596739 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339866880}
I20260709 13:16:10.754778 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:10.736783 10661 rpcz_store.cc:276] 0709 13:16:09.119849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.312694 (+192845us) service_pool.cc:224] Handling call
0709 13:16:09.349572 (+ 36878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.708178 (+358606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.547285 (+839107us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001dea54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:10.547496 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808759680}
I20260709 13:16:10.704107 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:10.744246 10669 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:16:10.743126 10708 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.865s (SENT)
I20260709 13:16:10.757073 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.757637 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.758275 10669 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:10.758687 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.770475 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.760285 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.665253 10588 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:10.771584 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.772294 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.554243 12976 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:10.761828 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.763069 12353 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.766005 12556 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:10.780382 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.558139 12846 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:10.760424 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 200367us
I20260709 13:16:10.554833 12721 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:10.762501 11382 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:10.759075 10708 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.894s (SENT)
I20260709 13:16:10.789458 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.545202 12925 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.784013 12759 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8.
I20260709 13:16:10.793051 12925 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:10.793653 12925 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.778718 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.778831 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.795965 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.796864 11411 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:10.797247 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:10.778945 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 55125.2us
I20260709 13:16:10.543581 12896 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.535336 12824 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:10.556926 12959 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:10.780912 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.781471 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.800864 10663 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:10.554872 12806 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.770659 10666 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:10.782972 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.546708 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 266) took 2635 ms. Trace:
I20260709 13:16:10.738831 12798 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.599967 12955 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.512s	user 0.003s	sys 0.007s
I20260709 13:16:10.786868 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.783370 10559 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:10.816103 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.773430 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.802304 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.807541 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.801781 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.783249 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.791700 12792 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:10.788218 12559 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:10.792354 12518 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.797652 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.800990 10590 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:10.811939 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1543) took 1020 ms. Trace:
I20260709 13:16:10.789489 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.837352 10593 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:10.738639 12255 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.788111 12809 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:16:10.826475 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.829676 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70631.2us
W20260709 13:16:10.842439 10708 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.000s (SENT)
W20260709 13:16:10.843330 10708 leader_election.cc:336] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.013s (SENT)
I20260709 13:16:10.843731 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:10.844084 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 60830.6us
I20260709 13:16:10.827740 10585 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4.
I20260709 13:16:10.769742 12946 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:10.807909 12920 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:10.850353 10739 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:10.850729 10739 pending_rounds.cc:85] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:10.779737 12945 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:10.828544 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.829279 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.853232 10666 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:10.542310 12528 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:10.835954 10737 rpcz_store.cc:276] 0709 13:16:09.791988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.046922 (+254934us) service_pool.cc:224] Handling call
0709 13:16:10.811713 (+764791us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540036ddd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:10.811872 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289458432}
I20260709 13:16:10.855880 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.837713 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.828186 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:10.841380 10589 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:10.838723 12518 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:10.848893 10708 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.094s (SENT)
I20260709 13:16:10.870026 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.849159 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.870759 10663 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:10.803803 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 362) took 1367 ms. Trace:
I20260709 13:16:10.842955 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.851536 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.831827 12863 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.801182 12896 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:10.859651 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78802.3us
I20260709 13:16:10.892463 10560 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.846092 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.894171 10669 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.895154 10669 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.858304 10589 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.870622 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:10.850993 10739 pending_rounds.cc:107] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 13:16:10.873869 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 84936us
I20260709 13:16:10.896549 10666 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.896605 10739 raft_consensus.cc:2889] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.897117 10589 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:10.897423 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1522) took 3122 ms. Trace:
I20260709 13:16:10.827059 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:10.829342 12864 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:10.900996 12528 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:10.875494 10592 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 8. Ops: []
I20260709 13:16:10.921875 10592 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:10.880429 10708 leader_election.cc:336] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.111s (SENT)
I20260709 13:16:10.876127 10588 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:10.897774 10739 rpcz_store.cc:276] 0709 13:16:07.775362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.298548 (+523186us) service_pool.cc:224] Handling call
0709 13:16:08.298852 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.640743 (+2341891us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001ad9a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f4257230dc0 00007f42572bb1c0 00007f42572bc231 00007f42572b8d8f 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c
0709 13:16:10.897205 (+256462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.897373 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361739648}
W20260709 13:16:10.925877 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45484.4us
I20260709 13:16:10.826409 11414 rpcz_store.cc:276] 0709 13:16:07.911681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.912952 (+  1271us) service_pool.cc:224] Handling call
0709 13:16:09.112447 (+1199495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.270643 (+158196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.546437 (+1275794us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400347bd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:10.546631 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533001088}
I20260709 13:16:10.904448 10666 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:10.927027 10708 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.198s (SENT)
I20260709 13:16:10.927066 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.927565 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:10.927977 12945 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:10.928884 10708 leader_election.cc:336] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.200s (SENT)
I20260709 13:16:10.906989 12919 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.849807 12920 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:10.909089 12902 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.930014 12902 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:10.909457 12733 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:10.914078 12946 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.915238 12863 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:10.874701 12897 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:10.916363 12954 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.874552 11413 rpcz_store.cc:276] 0709 13:16:09.436727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.463178 (+ 26451us) service_pool.cc:224] Handling call
0709 13:16:09.463468 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.720841 (+257373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.803552 (+1082711us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540043f8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:10.803739 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589615488}
I20260709 13:16:10.834370 12798 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:10.918972 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.918982 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.935431 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.858108 12810 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.929302 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.932354 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:10.931479 12897 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:10.925243 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.939075 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46691.7us
I20260709 13:16:10.857045 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:10.940470 10663 raft_consensus.cc:2410] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.946365 10593 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:10.946784 10593 pending_rounds.cc:85] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 7
I20260709 13:16:10.947026 10593 pending_rounds.cc:107] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:10.947155 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1197) took 1124 ms. Trace:
I20260709 13:16:10.947321 10593 raft_consensus.cc:2889] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.869975 12846 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.878677 12518 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.877885 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:10.955497 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.968685 11379 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 3. Current term is 4.
I20260709 13:16:10.969326 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:10.962780 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:10.963481 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:10.972826 10662 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:10.947536 10736 rpcz_store.cc:276] 0709 13:16:09.823120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.392701 (+569581us) service_pool.cc:224] Handling call
0709 13:16:10.392933 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.393113 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:10.599836 (+206723us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.946859 (+347023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.946909 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:10.946955 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.947012 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.947107 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":408178,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":67107,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":542814,"threads_started":3,"wal-append.queue_time_us":298505}
I20260709 13:16:10.877550 12955 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:16:10.975152 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:10.994778 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.976225 10708 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.091s (SENT) [suppressed 67 similar messages]
W20260709 13:16:10.997675 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 170685us
W20260709 13:16:10.964534 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 179023us
W20260709 13:16:11.015588 10632 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 2.161s (SENT)
I20260709 13:16:10.946192 12864 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.000532 10560 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.001276 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:10.999511 10708 leader_election.cc:336] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.108s (SENT)
I20260709 13:16:11.019800 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:10.976207 11409 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.013331 10662 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:11.016501 10632 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 1.541s (SENT)
I20260709 13:16:11.016508 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:10.995662 12730 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.968945 12983 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.974126 12945 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:11.028018 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 55295.5us
W20260709 13:16:11.023241 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.000327 12992 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:11.031963 10708 leader_election.cc:336] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.218s (SENT)
I20260709 13:16:11.034751 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:11.002393 12849 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:11.001278 12809 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.034799 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:10.972548 12920 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.028891 12528 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:11.041188 12549 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.041481 12824 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:11.052121 12925 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.052578 12824 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:11.052982 12824 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:11.053821 12824 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.055094 12824 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.042390 12849 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:11.035756 12946 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:11.043898 12798 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.058233 12946 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.058912 12798 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:11.059129 12946 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:11.059732 12932 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.785s	user 0.004s	sys 0.013s
I20260709 13:16:11.061712 12570 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.062048 12922 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:11.062498 12922 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.062196 12570 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.045738 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.035748 12863 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:11.004391 12897 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.064512 12897 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.066061 12570 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.069685 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1518) took 3373 ms. Trace:
I20260709 13:16:11.034154 12994 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.051563 12998 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.072402 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.038582 12809 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:11.037828 12983 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.048643 12992 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.084046 12992 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:11.082777 12809 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.080924 12998 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.086701 12992 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.087096 12998 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.063369 12922 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.089907 12922 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.090624 12958 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.088057 12992 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.097946 12850 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.079684 12920 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.197672 12824 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.198442 12824 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:11.200002 12824 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:11.139418 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 138758us
W20260709 13:16:11.139968 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.153164 10593 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:11.154834 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.155017 10661 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:11.158232 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:11.038370 10708 leader_election.cc:336] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.849s (SENT)
I20260709 13:16:11.107250 12983 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:11.213477 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 175041us
I20260709 13:16:11.070093 10734 rpcz_store.cc:276] 0709 13:16:07.696798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.697485 (+   687us) service_pool.cc:224] Handling call
0709 13:16:07.716451 (+ 18966us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:07.779653 (+ 63202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.779691 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:07.792908 (+ 13217us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.076730 (+1283822us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.076765 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.076838 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.059240 (+1982402us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:11.069377 (+ 10137us) raft_consensus.cc:1685] finished
0709 13:16:11.069402 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.069625 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25147,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":816,"spinlock_wait_cycles":11593472,"thread_start_us":485086,"threads_started":1,"wal-append.queue_time_us":1397070}
W20260709 13:16:11.173851 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 139553us
I20260709 13:16:11.220800 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.074122 11409 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:11.222559 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:11.177475 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 119990us
I20260709 13:16:11.068372 12518 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.082723 12259 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.224161 13008 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:11.224411 12921 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.178117 12553 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.224941 12259 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.179193 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.225977 12518 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.226368 10591 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:11.226536 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47791.4us
I20260709 13:16:11.181167 12925 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.227607 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.181088 12946 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:11.229839 12998 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:11.229770 12946 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.230728 12998 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.233816 12950 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:11.234304 12950 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:11.234763 12950 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.189167 12954 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:11.232395 12998 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.243189 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.243618 13012 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.243237 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.245577 10734 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.245430 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:11.243700 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 86698.2us
I20260709 13:16:11.251677 12745 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.258077 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:11.258376 12925 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.258879 12255 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.259269 12925 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:11.267359 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1815) took 1433 ms (client timeout 1658 ms). Trace:
I20260709 13:16:11.267706 12556 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.268325 12556 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:11.273095 12556 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:11.279072 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56740.2us
I20260709 13:16:11.280059 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.281198 12899 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.281387 12946 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:11.281657 12899 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.282110 12899 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.257158 12601 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:11.268009 10660 rpcz_store.cc:269] 0709 13:16:09.804231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.983741 (+179510us) service_pool.cc:224] Handling call
0709 13:16:11.237068 (+1253327us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54000c3d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:11.237263 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842104064}
I20260709 13:16:11.270303 12259 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:11.277848 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.278303 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.269618 12576 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:11.265848 12925 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:11.301690 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 84646.2us
W20260709 13:16:11.305814 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 85266.8us
I20260709 13:16:11.308394 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.308497 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:11.309537 12518 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:11.310109 12518 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:11.311141 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.311360 12518 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.312815 12576 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.310056 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.313458 12576 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.313905 10666 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.315667 12576 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:11.320976 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:11.326192 11409 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.331543 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.332993 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.334308 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.335774 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.336840 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.338878 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.339586 10665 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.343271 10734 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:11.345279 11411 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEARNER]: Advancing to term 5
I20260709 13:16:11.350525 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.350644 12902 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.351195 10669 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:11.352094 12902 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.352186 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:11.353695 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45912.8us
I20260709 13:16:11.355921 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:11.333030 12999 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 13:16:11.358282 10669 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:11.362020 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.311411 12809 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.364576 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.365984 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.366709 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.367218 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.367983 10664 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:11.368044 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.368942 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.371196 12730 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.372936 11413 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:11.373219 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:11.374042 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:11.374819 12925 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:11.376211 12950 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.364991 12809 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.376737 11382 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.377297 10559 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.377652 11412 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:11.378021 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.379070 12814 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:11.382849 10665 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:11.384086 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.389981 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.391376 10586 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:11.420133 10664 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:11.391110 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:11.391161 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.394260 12570 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:11.396579 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76911.9us
W20260709 13:16:11.405045 10708 leader_election.cc:336] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.524s (SENT)
W20260709 13:16:11.418843 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59450.3us
I20260709 13:16:11.425601 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:11.426815 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50270.6us
I20260709 13:16:11.426900 11414 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:11.427986 11411 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:16:11.428508 10660 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.427922 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.429528 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.428452 11411 pending_rounds.cc:85] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 3
I20260709 13:16:11.431841 11411 pending_rounds.cc:107] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:16:11.432126 11411 raft_consensus.cc:2889] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.430817 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:11.409775 12730 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:11.425343 12570 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:11.440274 12849 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:11.420328 12814 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:11.448156 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.441619 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 50654.7us
I20260709 13:16:11.442728 10585 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:11.446031 10666 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
W20260709 13:16:11.447068 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69954.8us
I20260709 13:16:11.440763 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.446897 10589 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:11.450486 12920 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.464318 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.450942 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.450227 12925 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.451548 10667 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:11.467895 10660 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:11.453048 12814 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.475771 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.475780 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.479188 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.480243 10669 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:11.467226 12920 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:11.478605 12601 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:11.482754 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.482659 12806 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:11.483424 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.484623 12570 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:11.476927 12824 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.473470 12849 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:11.485070 12730 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.448330 12576 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:16:11.487346 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 77592.5us
I20260709 13:16:11.489038 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.479033 12902 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:11.490854 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:11.492965 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 87965.1us
W20260709 13:16:11.493427 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.483918 12920 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.495083 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.498910 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.495401 12950 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:11.496289 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.497099 10589 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.496299 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.487399 12899 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.493077 10664 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:11.481980 11409 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:11.480021 12946 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:11.497989 12849 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.485844 12998 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:11.493683 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.497916 12730 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.503914 10665 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:11.510197 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.505920 12973 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.514863 12973 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.515312 12973 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.518401 12806 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.519099 12806 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.501873 12921 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.507472 12899 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.524680 13012 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:11.525342 13012 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.525779 13012 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.508358 12570 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:11.507827 10594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1235) took 1547 ms (client timeout 1951 ms). Trace:
W20260709 13:16:11.529763 10594 rpcz_store.cc:269] 0709 13:16:09.960363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.010063 (+ 49700us) service_pool.cc:224] Handling call
0709 13:16:11.507390 (+1497327us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b54001e46d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:11.507624 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138257664}
I20260709 13:16:11.508877 12259 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.530637 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.531424 10591 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:11.502127 10586 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:11.511127 10590 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.503949 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.511677 10593 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:11.511842 13016 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:16:11.512686 10589 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:11.512820 10708 leader_election.cc:336] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.546s (SENT)
I20260709 13:16:11.520967 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.521937 10660 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:11.524751 11414 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: Advancing to term 7
I20260709 13:16:11.511312 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.520049 12992 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.539819 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:11.540241 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.539875 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.538975 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.542129 10664 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:11.542037 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.542656 10665 raft_consensus.cc:2376] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5. Re-sending same reply.
I20260709 13:16:11.543752 10734 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:11.545650 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.545769 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.546657 10738 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.546625 12924 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:11.547789 12902 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.542333 10667 raft_consensus.cc:2376] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5. Re-sending same reply.
I20260709 13:16:11.553668 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.548269 12902 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:11.548370 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.573678 10585 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:11.577975 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.573593 12902 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:11.582798 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49909.3us
I20260709 13:16:11.582769 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.586549 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.587493 10660 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:11.540110 12980 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:16:11.588653 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.588006 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.596262 10594 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:11.596493 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.597292 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.600339 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:11.600085 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 87377us
I20260709 13:16:11.601817 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.600553 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.604206 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:11.606884 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 52489us
I20260709 13:16:11.607923 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:11.608930 12899 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:11.609452 10740 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:11.616366 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.617959 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.618400 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.574373 12992 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.598724 11412 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:11.626120 12925 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.627509 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.628450 10738 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:11.628811 10739 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:11.629171 10739 pending_rounds.cc:85] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:11.629490 10739 pending_rounds.cc:107] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:11.629738 10739 raft_consensus.cc:2889] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.629869 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.630905 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.632449 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.633157 10743 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:11.609568 12899 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:11.634305 12899 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.636888 12992 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.629899 10741 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:11.619174 10660 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:11.620043 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.623872 10559 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.624506 12825 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.624823 10735 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:11.625174 12809 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:11.637842 10741 pending_rounds.cc:85] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:11.645011 10741 pending_rounds.cc:107] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:16:11.645354 10741 raft_consensus.cc:2889] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.643579 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.607863 12259 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:11.647720 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.648551 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.644413 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.649932 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:11.656780 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54935.2us
W20260709 13:16:11.656311 10708 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.579s (SENT)
I20260709 13:16:11.660646 10663 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:11.664716 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.667958 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:11.648274 12992 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:11.654320 12921 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.671854 13012 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.668249 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:11.676564 13014 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.669436 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.665838 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.682741 10666 raft_consensus.cc:2368] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:11.681726 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.680948 10735 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:11.684664 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.686474 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.684724 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.649776 12902 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.691526 10667 raft_consensus.cc:2368] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:11.684366 10669 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 2.
I20260709 13:16:11.679982 12921 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.679368 12992 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:11.694737 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54570.4us
W20260709 13:16:11.690564 13024 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:16:11.695884 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:11.697505 12528 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:11.699076 13012 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.699548 10664 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:11.699543 12924 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.700829 10590 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:11.703915 12921 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.705349 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.706070 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.706378 10737 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:11.693511 10734 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:11.707787 10735 raft_consensus.cc:606] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:11.708289 10663 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:16:11.711865 10735 raft_consensus.cc:614] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:11.712809 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.713518 10740 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.714754 10669 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:11.710147 10660 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:11.717371 10739 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:16:11.717803 10739 pending_rounds.cc:85] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 6
I20260709 13:16:11.718137 10739 pending_rounds.cc:107] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:11.718315 12902 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.707824 12992 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.721472 12924 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.722494 10741 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.718449 10739 raft_consensus.cc:2889] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:11.723474 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.715915 12980 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:11.727635 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.728271 10666 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:11.733946 10664 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:11.735174 12924 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:11.708550 13014 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.762476 13014 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.736544 12920 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.740743 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.741518 13012 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:11.741640 11379 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:11.742312 10708 leader_election.cc:336] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.590s (SENT)
I20260709 13:16:11.744503 10668 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.745628 12998 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:11.765424 12998 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.766556 12998 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.769605 13012 consensus_queue.cc:1243] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:11.745882 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 50259.6us
I20260709 13:16:11.746088 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:11.748044 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.771205 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:11.771919 12576 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:11.727969 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.772308 12576 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.772691 12576 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:11.773851 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58402.1us
W20260709 13:16:11.774984 10708 leader_election.cc:336] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.658s (SENT)
I20260709 13:16:11.775411 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:11.751654 10665 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:11.749228 10664 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:11.760200 10734 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.779778 10667 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:11.784497 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 126990us
I20260709 13:16:11.788419 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.792284 10736 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.715173 12730 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:16:11.794317 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.726027 12973 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.802732 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:11.802942 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.789538 12556 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:11.806190 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 143688us
I20260709 13:16:11.805816 13014 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:11.811347 12903 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.811827 12973 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:11.798420 10664 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.781195 12946 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:11.780339 12849 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:11.822803 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.781612 12950 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:11.828300 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.808823 12941 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.814574 12556 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.845497 12556 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.846666 10668 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:11.844724 12255 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:11.783653 12528 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:16:11.848551 12255 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:11.848749 12824 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:11.849803 12255 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.835215 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:11.853026 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 112393us
I20260709 13:16:11.853793 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:11.854991 12730 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.856331 12259 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:11.835150 13030 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.856878 12259 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.857199 13030 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.857348 12259 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.857656 13031 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.858091 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.858258 13031 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:11.857677 13030 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.859150 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.859743 10669 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.859670 13031 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.794942 12601 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:11.841364 10590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
W20260709 13:16:11.842903 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 67985.8us
I20260709 13:16:11.844676 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:11.845391 12924 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:11.851866 10490 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:11.852293 12814 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.837239 12919 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:11.836560 12983 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:16:11.888120 12983 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.888566 12983 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:11.889791 12920 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:11.889647 12983 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:11.890897 10708 leader_election.cc:336] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.669s (SENT)
I20260709 13:16:11.891176 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:11.891232 12983 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.891475 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.892267 10739 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.893044 12950 raft_consensus.cc:1064] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
W20260709 13:16:11.893546 12950 raft_consensus.cc:1068] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Unable to promote non-voter e71e2e44af1e46d8a8423ae08646bc22: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:11.894177 10664 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.891402 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:11.871173 10738 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.872973 10734 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:11.876369 10662 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:11.879792 11410 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:11.879810 10590 raft_consensus.cc:606] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:11.877127 12924 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:11.881201 10490 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.882637 10741 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:11.883998 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:11.880350 11411 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:11.885341 10591 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:11.885993 12814 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:11.889815 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.813095 12806 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.867419 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:11.865607 12255 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.902511 10667 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:11.906987 10739 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:11.908109 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54223us
I20260709 13:16:11.916335 10594 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:16:11.942408 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 137819us
I20260709 13:16:11.943291 10736 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.945868 13042 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:11.931453 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.958881 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.925999 10669 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:11.959389 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.938248 11414 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:11.938724 10490 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 5 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.939922 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:11.962527 10665 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.946270 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:11.948678 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 135715us
W20260709 13:16:11.968304 10635 connection.cc:256] RPC call timeout handler was delayed by -1.6323588870000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2803s for a response
I20260709 13:16:11.952768 10664 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:11.953177 12924 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:11.972628 12924 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.957090 10736 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:11.935209 11409 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 13:16:11.978941 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.990170 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:11.991786 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:11.900782 12576 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:11.962035 11414 pending_rounds.cc:85] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 4
I20260709 13:16:11.993682 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:11.994215 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 45748us
I20260709 13:16:11.999137 10736 raft_consensus.cc:2393] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 3: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:11.997082 10588 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:12.001142 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:11.992285 13012 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:16:12.007719 10660 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:16:12.008126 10660 pending_rounds.cc:85] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 3
I20260709 13:16:12.008378 10660 pending_rounds.cc:107] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:16:12.008637 10660 raft_consensus.cc:2889] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.957561 12919 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.958323 13042 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:12.010249 10490 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 3 to 5, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 5 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:12.011858 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 121077us
I20260709 13:16:12.002921 11414 pending_rounds.cc:107] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:12.014806 13014 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:12.013435 12824 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:16:12.023181 10490 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 3, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 3 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:12.020432 10708 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.669s (SENT)
I20260709 13:16:11.992475 12814 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:12.028338 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:12.007588 12899 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:12.062752 10742 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:12.010088 12921 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:12.017025 12903 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:12.023764 11414 raft_consensus.cc:2889] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.067509 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:12.086702 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:12.086261 10490 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 3 to 6, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 6 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.136910 10741 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:12.008242 12925 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:16:12.085621 10587 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:16:12.140646 10743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:12.141443 10743 raft_consensus.cc:606] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:12.141860 10743 raft_consensus.cc:614] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:12.151064 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 84599.7us
W20260709 13:16:12.152294 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.022504 11413 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:12.138713 10587 pending_rounds.cc:85] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 5
I20260709 13:16:12.065099 12899 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.158219 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:12.153389 10587 pending_rounds.cc:107] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:16:12.159118 10587 raft_consensus.cc:2889] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.152644 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:12.162364 10735 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:12.026173 12992 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:12.162427 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.215384 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:12.184021 13013 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.091s	user 0.004s	sys 0.005s
I20260709 13:16:12.226311 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:12.234444 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 81893.9us
I20260709 13:16:12.161480 12899 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:12.193423 12601 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:12.184258 13031 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:12.238077 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53586.6us
I20260709 13:16:12.238217 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:12.214367 12570 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:12.163576 12925 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:12.061672 13042 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:12.278381 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 255947us
I20260709 13:16:12.278550 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:12.286815 10491 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 219) took 11280 ms (client timeout 15000 ms). Trace:
W20260709 13:16:12.286769 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 266369us
I20260709 13:16:12.233696 12553 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.183765 13014 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:12.283699 10490 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:12.280377 12570 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:12.440804 13024 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:16:12.280661 12925 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:12.287164 12576 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:12.441109 12570 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.452899 12814 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.292752 13040 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:12.580802 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 345376us
I20260709 13:16:12.622929 10560 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:12.612314 13016 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:16:12.583547 13040 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.442011 12553 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:12.649708 12850 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:12.645032 13040 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:12.287222 10491 rpcz_store.cc:269] 0709 13:16:00.737076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.742662 (+  5586us) service_pool.cc:224] Handling call
0709 13:16:12.010193 (+11267531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:10.835159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:10.905775 (+ 70616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:10.905810 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:10.905829 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:10.907276 (+  1447us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:10.907370 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:10.907408 (+    38us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:10.908854 (+  1446us) tablet.cc:701] Row locks acquired
0709 13:16:10.908879 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:10.909068 (+   189us) write_op.cc:270] Start()
0709 13:16:10.909209 (+   141us) write_op.cc:276] Timestamp: P: 1783602970909010 usec, L: 0
0709 13:16:10.909238 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:16:10.930490 (+ 21252us) log.cc:844] Serialized 5213 byte log entry
0709 13:16:11.109251 (+178761us) op_driver.cc:464] REPLICATION: finished
0709 13:16:11.110759 (+  1508us) write_op.cc:301] APPLY: starting
0709 13:16:11.110854 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:11.111069 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:11.111191 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:11.355547 (+244356us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5c0009648c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d4ab331 00007f425d4ab221 00007f425d4a5f6c 00007f425ac0630b 00007f425ac05fd3 00007f425ad04e34 00007f425acf097c 00007f425acf4d61 00007f425acf4d19 00007f425acf4ca9 00007f425acf4c71
0709 13:16:11.386375 (+ 30828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:11.386746 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:16:11.386825 (+    79us) write_op.cc:312] APPLY: finished
0709 13:16:11.387333 (+   508us) log.cc:844] Serialized 95 byte log entry
0709 13:16:11.387629 (+   296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:11.388063 (+   434us) write_op.cc:454] Released schema lock
0709 13:16:11.388152 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:11.388778 (+   626us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:11.388815 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":260,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":1212,"apply.run_cpu_time_us":8218,"apply.run_wall_time_us":277936,"num_ops":13,"prepare.queue_time_us":405768,"prepare.run_cpu_time_us":29163,"prepare.run_wall_time_us":221234,"raft.queue_time_us":54489,"raft.run_cpu_time_us":1617,"raft.run_wall_time_us":4943,"replication_time_us":197826,"spinlock_wait_cycles":217478912,"thread_start_us":382449,"threads_started":4,"wal-append.queue_time_us":114284,"wal-append.run_cpu_time_us":21071,"wal-append.run_wall_time_us":1342781}]]}
I20260709 13:16:12.644199 12549 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.212s
W20260709 13:16:12.763043 13032 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.625s	user 0.001s	sys 0.000s
I20260709 13:16:12.672205 12992 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:12.774365 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.112s	sys 0.247s
W20260709 13:16:12.776358 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.112s	sys 0.247s
W20260709 13:16:12.776693 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 541262us
W20260709 13:16:12.783799 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.785034 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.785348 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.780180 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 203) took 1212 ms. Trace:
I20260709 13:16:12.800473 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1884) took 1301 ms. Trace:
I20260709 13:16:12.796979 10591 rpcz_store.cc:276] 0709 13:16:11.549477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.549606 (+   129us) service_pool.cc:224] Handling call
0709 13:16:11.574638 (+ 25032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.906304 (+331666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.761110 (+854806us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:12.761396 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713949568}
I20260709 13:16:12.800949 10660 rpcz_store.cc:276] 0709 13:16:11.485454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.737939 (+252485us) service_pool.cc:224] Handling call
0709 13:16:12.004935 (+266996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.015686 (+ 10751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.787034 (+771348us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54000c5150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:12.787205 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612633984}
W20260709 13:16:12.802863 10558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.014s
W20260709 13:16:12.805460 10558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.015s
W20260709 13:16:12.809042 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.836824 13077 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:12.838080 13045 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.504s	user 0.001s	sys 0.000s
I20260709 13:16:12.840618 13054 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.230s
I20260709 13:16:12.842188 13054 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:12.843536 13054 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.844170 13054 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:12.846639 13049 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:16:12.742210 12973 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 13:16:12.851194 13037 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.557s	user 0.001s	sys 0.001s
I20260709 13:16:12.852789 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 183) took 1407 ms. Trace:
W20260709 13:16:12.853718 13063 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:16:12.855533 13053 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:12.763734 13052 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.416s
I20260709 13:16:12.664535 12925 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:12.859570 12925 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:12.861482 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.861829 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 327) took 1165 ms. Trace:
I20260709 13:16:12.862331 11412 rpcz_store.cc:276] 0709 13:16:11.696165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.696380 (+   215us) service_pool.cc:224] Handling call
0709 13:16:11.696696 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.697087 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.697133 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.697689 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.810072 (+112383us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.810124 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.810237 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.861518 (+1051281us) raft_consensus.cc:1685] finished
0709 13:16:12.861556 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.861737 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1123,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":107876,"threads_started":1,"wal-append.queue_time_us":250224}
I20260709 13:16:12.865898 13071 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:12.869935 13034 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.924s	user 0.003s	sys 0.015s
I20260709 13:16:12.853231 10663 rpcz_store.cc:276] 0709 13:16:11.445231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.725510 (+280279us) service_pool.cc:224] Handling call
0709 13:16:11.769172 (+ 43662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.769803 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:11.770170 (+   367us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.900548 (+130378us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.906354 (+  5806us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.940857 (+ 34503us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:11.940893 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.940955 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.852552 (+911597us) raft_consensus.cc:1685] finished
0709 13:16:12.852581 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.852728 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":51060,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":129989,"threads_started":1,"wal-append.queue_time_us":257950}
I20260709 13:16:12.897995 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1536) took 1026 ms. Trace:
W20260709 13:16:12.906103 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 460899us
W20260709 13:16:12.919706 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 632860us
I20260709 13:16:12.900803 10667 rpcz_store.cc:276] 0709 13:16:11.871979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.010847 (+138868us) service_pool.cc:224] Handling call
0709 13:16:12.024892 (+ 14045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.139746 (+114854us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:12.471434 (+331688us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.895559 (+424125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.896022 (+   463us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.897307 (+  1285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.897782 (+   475us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.897926 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20080,"prepare.queue_time_us":301643,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1362,"thread_start_us":550153,"threads_started":2}
W20260709 13:16:12.965011 13041 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.623s	user 0.001s	sys 0.000s
I20260709 13:16:12.968009 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1535) took 1096 ms. Trace:
I20260709 13:16:12.919577 12850 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:12.979736 12850 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:12.983137 13046 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.036s	user 0.015s	sys 0.018s
W20260709 13:16:12.986047 12255 consensus_meta.cc:287] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.038s	user 0.000s	sys 0.010s
W20260709 13:16:12.986100 13051 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.411s	user 0.002s	sys 0.008s
I20260709 13:16:12.986726 11412 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEARNER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:12.988001 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:12.988090 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:12.988708 10590 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:12.989564 10591 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:12.990295 10587 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:12.968457 10665 rpcz_store.cc:276] 0709 13:16:11.871721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.987664 (+115943us) service_pool.cc:224] Handling call
0709 13:16:12.001029 (+ 13365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.083026 (+ 81997us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:12.280990 (+197964us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.874716 (+593726us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.885015 (+ 10299us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.885150 (+   135us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:12.885184 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.885255 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.967763 (+ 82508us) raft_consensus.cc:1685] finished
0709 13:16:12.967793 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.967941 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187366,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":54,"raft.queue_time_us":6524,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":73094,"thread_start_us":420277,"threads_started":2,"wal-append.queue_time_us":518405}
I20260709 13:16:12.991461 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:12.992195 10588 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:12.996654 12899 consensus_meta.cc:287] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.000s
I20260709 13:16:12.997336 13072 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:12.997720 13072 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:12.998332 13036 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.051s	user 0.000s	sys 0.017s
I20260709 13:16:12.998620 13072 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:12.999680 13072 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.001338 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:13.001716 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1558) took 1259 ms. Trace:
I20260709 13:16:13.002010 10593 raft_consensus.cc:2368] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
W20260709 13:16:13.003767 13050 log.cc:927] Time spent T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.387s	user 0.005s	sys 0.001s
W20260709 13:16:13.004977 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.005878 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.006968 12992 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.007448 12992 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.002175 10737 rpcz_store.cc:276] 0709 13:16:11.741950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.743060 (+  1110us) service_pool.cc:224] Handling call
0709 13:16:11.743520 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.754310 (+ 10790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.754353 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.754888 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.907745 (+152857us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:11.907806 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.907883 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.997645 (+1089762us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:13.001383 (+  3738us) raft_consensus.cc:1685] finished
0709 13:16:13.001411 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.001627 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8915,"raft.queue_time_us":11557,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":22753024,"thread_start_us":152273,"threads_started":1,"wal-append.queue_time_us":191831}
I20260709 13:16:12.986128 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:13.075011 10588 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:16:13.035564 10708 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.012s
W20260709 13:16:13.080514 10708 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.013s
W20260709 13:16:13.081429 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 633713us
I20260709 13:16:12.997020 12899 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:12.988166 13039 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.040s	user 0.006s	sys 0.007s
I20260709 13:16:12.989679 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:13.089737 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.100090 10739 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:13.104763 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 225) took 1261 ms. Trace:
I20260709 13:16:13.088228 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:13.106416 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.005s	sys 0.027s
W20260709 13:16:13.113546 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.005s	sys 0.027s
W20260709 13:16:13.113562 10586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.006s	sys 0.011s
W20260709 13:16:13.114300 10586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.006s	sys 0.011s
W20260709 13:16:13.114472 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 876247us
I20260709 13:16:13.106177 10740 rpcz_store.cc:276] 0709 13:16:11.843326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.843467 (+   141us) service_pool.cc:224] Handling call
0709 13:16:11.843777 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.844197 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.844229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.844658 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.005844 (+161186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:12.005903 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.005997 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.966201 (+960204us) raft_consensus.cc:1685] finished
0709 13:16:12.966220 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.104709 (+138489us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5638,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":160726,"threads_started":1,"wal-append.queue_time_us":339707}
W20260709 13:16:13.111822 12259 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.254s	user 0.011s	sys 0.006s
W20260709 13:16:13.124141 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 501277us
I20260709 13:16:13.127897 10666 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:16:13.115492 13030 consensus_meta.cc:287] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.256s	user 0.014s	sys 0.000s
I20260709 13:16:13.112603 12809 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.112773 12601 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.132486 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1534) took 1261 ms. Trace:
I20260709 13:16:13.133278 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:13.110924 13054 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.132474 12920 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.141561 13068 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.141901 12920 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.142084 13068 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.134209 10663 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:13.139070 10661 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.140194 11412 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:13.138720 10664 rpcz_store.cc:276] 0709 13:16:11.871445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.972604 (+101159us) service_pool.cc:224] Handling call
0709 13:16:11.972957 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:11.973465 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.973507 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:11.974173 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 13:16:12.018678 (+ 44505us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:12.018731 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.018818 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.003118 (+984300us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:13.123834 (+120716us) raft_consensus.cc:1685] finished
0709 13:16:13.123879 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.132428 (+  8549us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4870,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":7963904,"thread_start_us":44038,"threads_started":1,"wal-append.queue_time_us":305088}
I20260709 13:16:13.132472 12992 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.142377 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:13.129554 10667 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:13.144377 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.148027 10667 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:13.151435 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:13.152127 10663 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.140339 13058 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.180099 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.178165 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:13.183903 10594 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:13.135447 12553 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:13.130060 12259 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.182493 10667 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.133853 13030 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.194121 10667 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.158172 13058 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:13.196761 12556 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.351s	user 0.009s	sys 0.002s
I20260709 13:16:13.197475 13058 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.197196 12556 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.198005 13058 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.198951 13058 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.199810 12556 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.200196 13058 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:13.200433 10592 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:13.200609 13058 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.201988 12255 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:13.202368 12255 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:13.202469 10667 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:13.202826 10667 pending_rounds.cc:85] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 5
I20260709 13:16:13.203058 10667 pending_rounds.cc:107] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:13.203424 10667 raft_consensus.cc:2889] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:13.202932 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58662.3us
I20260709 13:16:13.201093 13058 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:13.144253 12809 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.210269 10585 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:13.195725 13030 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.209560 10663 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:13.211087 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:13.193636 12570 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 13:16:13.223518 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.224295 10664 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:13.192791 12814 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.192400 13079 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:13.146181 12601 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.155400 13076 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:16:13.231371 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.210105 12549 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:13.234895 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:13.235756 10667 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.203198 12255 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.240936 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:13.246867 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:13.248659 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:13.250478 12601 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:13.227037 12992 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:16:13.252238 12255 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.254935 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:13.255676 13012 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:13.256201 13012 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.256562 13012 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.258750 12920 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:13.228530 12570 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.260962 12899 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:13.263804 12549 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:13.264187 10662 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:13.264899 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 193) took 1363 ms. Trace:
I20260709 13:16:13.264256 12255 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.265815 12255 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.266352 12255 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.267994 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.268661 10735 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 2.
I20260709 13:16:13.269762 12849 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.270406 13069 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:16:13.270331 12849 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.269786 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.286324 10743 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:13.288519 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52807.5us
W20260709 13:16:13.289088 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54952.2us
I20260709 13:16:13.233769 13057 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:13.265206 10662 rpcz_store.cc:276] 0709 13:16:11.901590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.696130 (+794540us) service_pool.cc:224] Handling call
0709 13:16:13.263668 (+567538us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:13.263890 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.264680 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.264853 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13927296}
I20260709 13:16:13.293219 10667 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
W20260709 13:16:13.300714 10708 connection.cc:256] RPC call timeout handler was delayed by -1.5236413879999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:16:13.301168 10708 connection.cc:256] RPC call timeout handler was delayed by -1.5173413879999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:16:13.237450 13079 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.271960 12814 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.313218 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:13.322280 10667 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.297732 13031 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:13.322312 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.323562 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.323071 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:13.326784 10632 connection.cc:256] RPC call timeout handler was delayed by -1.1650918579998688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:16:13.330533 10662 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:13.334897 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1560) took 1592 ms. Trace:
I20260709 13:16:13.335273 10742 rpcz_store.cc:276] 0709 13:16:11.742873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.757335 (+ 14462us) service_pool.cc:224] Handling call
0709 13:16:11.757750 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.066371 (+308621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.334676 (+1268305us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54002bfa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:13.334840 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530906496}
I20260709 13:16:13.316778 12570 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.316941 13068 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.343036 10667 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:13.343792 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:13.327301 10632 connection.cc:256] RPC call timeout handler was delayed by -1.0228918579998663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:16:13.307858 12899 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:13.331889 12730 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.349686 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:13.349560 12730 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.350242 13058 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.351591 12730 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:13.352160 13058 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.352959 10588 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:13.353891 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:13.355402 13048 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.906s	user 0.007s	sys 0.018s
I20260709 13:16:13.356189 12809 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.356258 13058 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:13.356575 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 192) took 1505 ms. Trace:
I20260709 13:16:13.355545 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:13.357956 13058 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:13.356979 10668 rpcz_store.cc:276] 0709 13:16:11.850712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.850839 (+   127us) service_pool.cc:224] Handling call
0709 13:16:11.851095 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.919264 (+ 68169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.919326 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.921302 (+  1976us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.021599 (+100297us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:12.021629 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.021684 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.306144 (+1284460us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:13.356332 (+ 50188us) raft_consensus.cc:1685] finished
0709 13:16:13.356351 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.356525 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3373,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":267344640,"thread_start_us":141413,"threads_started":2,"wal-append.queue_time_us":294698}
I20260709 13:16:13.358641 13079 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.359079 13082 raft_consensus.cc:993] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:16:13.359180 13081 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.359643 13082 raft_consensus.cc:1081] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:16:13.360728 10594 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:16:13.361114 10594 pending_rounds.cc:85] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 6
W20260709 13:16:13.361193 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56739.1us
I20260709 13:16:13.361393 10594 pending_rounds.cc:107] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:13.361749 10594 raft_consensus.cc:2889] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.362152 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:13.362583 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.363400 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.363929 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:13.364073 12922 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:13.364372 10668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:16:13.364584 12809 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.364944 12922 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:13.365399 12922 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:13.366283 12922 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.367340 12922 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.367420 12259 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.364100 10667 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:13.311863 12992 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:13.383610 12921 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.385841 12849 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.364945 10668 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.388603 10668 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.361760 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:13.391860 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.392251 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.358446 13076 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.392271 13043 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:13.395521 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:13.395891 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:13.396247 13064 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.550s	user 0.008s	sys 0.003s
I20260709 13:16:13.396581 10594 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:16:13.396963 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.397058 10585 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:13.398398 13075 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:16:13.399034 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:13.399628 12925 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
W20260709 13:16:13.398411 13083 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:16:13.400213 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:13.401196 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1763) took 1414 ms. Trace:
I20260709 13:16:13.402467 10632 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:13.401551 10586 rpcz_store.cc:276] 0709 13:16:11.986339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.986725 (+   386us) service_pool.cc:224] Handling call
0709 13:16:11.999871 (+ 13146us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:12.025724 (+ 25853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.025743 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:12.153088 (+127345us) log.cc:844] Serialized 52 byte log entry
0709 13:16:13.114682 (+961594us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:13.234856 (+120174us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.296696 (+ 61840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.296829 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.401022 (+104193us) raft_consensus.cc:1685] finished
0709 13:16:13.401040 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.401149 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67670,"prepare.queue_time_us":227799,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":109916,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":14088,"spinlock_wait_cycles":1749888,"thread_start_us":1076292,"threads_started":2,"wal-append.queue_time_us":1071273}
I20260709 13:16:13.381605 13080 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:13.403534 13077 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.403963 13077 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.404304 13077 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.404417 12922 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.348884 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.405762 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1764) took 1415 ms. Trace:
I20260709 13:16:13.381572 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1759) took 1433 ms. Trace:
I20260709 13:16:13.406394 10743 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
W20260709 13:16:13.347114 10708 connection.cc:256] RPC call timeout handler was delayed by -1.2374413879999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24910000000000002s for a response
W20260709 13:16:13.407421 10708 connection.cc:256] RPC call timeout handler was delayed by -1.2284413879999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2501s for a response
I20260709 13:16:13.406273 10592 rpcz_store.cc:276] 0709 13:16:11.948224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.948351 (+   127us) service_pool.cc:224] Handling call
0709 13:16:11.988057 (+ 39706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.200884 (+1212827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.381332 (+180448us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540020f654. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:13.381514 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787649920}
I20260709 13:16:13.377889 10635 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.415015 12730 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:13.346627 13014 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:13.420671 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:13.421110 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 57271.1us
I20260709 13:16:13.424403 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.425103 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:13.426774 10592 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:13.422701 10668 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.403566 13080 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:13.433236 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:13.406132 10589 rpcz_store.cc:276] 0709 13:16:11.990307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.990419 (+   112us) service_pool.cc:224] Handling call
0709 13:16:12.005973 (+ 15554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.025286 (+ 19313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.025347 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.084528 (+ 59181us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.518960 (+434432us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.519017 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.519113 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.395558 (+876445us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:13.397128 (+  1570us) raft_consensus.cc:1685] finished
0709 13:16:13.397147 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.405705 (+  8558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7290,"raft.queue_time_us":49324,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":21267,"spinlock_wait_cycles":58340608,"thread_start_us":355737,"threads_started":1,"wal-append.queue_time_us":545363}
I20260709 13:16:13.428047 10632 leader_election.cc:400] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:16:13.435953 10632 leader_election.cc:403] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:13.344681 13091 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:13.418367 13040 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
W20260709 13:16:13.433281 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88478.6us
I20260709 13:16:13.435879 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:13.443430 10593 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:13.443611 10585 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.444216 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:13.445559 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.447397 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.448664 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.450881 10587 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:16:13.428035 12518 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.425956 13089 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.457382 10668 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.433832 12941 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.417634 13071 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:13.458633 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:13.465608 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.436761 13080 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.453846 13082 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.436334 12983 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:16:13.473217 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 202980us
W20260709 13:16:13.525068 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62444.2us
I20260709 13:16:13.455044 13072 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:13.455940 12850 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:13.493381 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.450377 13040 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.543783 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.544503 10738 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.472704 13085 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.566267 10669 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:13.547122 10743 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:13.524405 12920 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:16:13.548666 13040 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.549731 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.550396 13086 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.535355 13089 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.561992 13049 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:13.562057 12814 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.562700 12255 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.562861 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:13.582209 10668 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:13.460786 12518 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.563735 11414 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:13.564231 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.524674 12941 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.451292 13014 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.564770 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:13.573330 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 145149us
W20260709 13:16:13.573558 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 167112us
W20260709 13:16:13.576632 10708 connection.cc:256] RPC call timeout handler was delayed by -1.0435816529998192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.328s for a response
I20260709 13:16:13.577454 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.524421 13043 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:16:13.530045 12922 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.566601 12973 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:13.591755 10737 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:13.594416 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:13.580067 12950 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.527423 13082 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.624378 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.581938 13086 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:13.624898 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:13.633211 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:13.629206 12850 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:13.650786 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 84915.2us
W20260709 13:16:13.630226 10708 leader_election.cc:336] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.537s (SENT)
I20260709 13:16:13.651578 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:13.625809 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.645170 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81565cb1f2054410aae97284b914f79c"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:13.646130 10741 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.649227 10737 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:13.652649 10587 raft_consensus.cc:606] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Received request to transfer leadership to TS e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:13.653033 10587 raft_consensus.cc:614] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.629797 13091 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:13.658969 10738 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:13.662649 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.614284 11409 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:13.613806 12980 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.680392 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54615.5us
I20260709 13:16:13.684561 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.645517 13040 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:13.624521 12814 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:13.645766 13092 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.678838 13055 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:13.649024 12925 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.651031 12950 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.844507 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.583405 13089 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:13.678705 12922 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:13.854066 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 207261us
I20260709 13:16:13.646553 13085 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.190s
I20260709 13:16:13.851127 13091 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.852130 12941 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.840554 12518 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:13.852918 13082 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:13.859555 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.863912 12806 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.653288 13012 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.836872 13040 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:13.864920 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 234712us
I20260709 13:16:13.678962 12973 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:13.852440 12556 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:13.866530 10585 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:13.845827 10738 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:13.891060 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 345974us
I20260709 13:16:13.886169 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:13.896975 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.892884 10740 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:13.911716 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:13.776505 12980 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.843102 12814 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:13.916065 10734 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:13.926760 13038 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:13.927294 13038 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.927695 13038 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.905663 12919 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:13.935485 13061 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:16:13.943126 12973 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.913990 11382 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:13.993788 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79880.9us
I20260709 13:16:13.946487 12922 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:13.946290 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:13.947041 13081 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:13.883725 13102 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:16:13.947820 13108 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:16:13.845649 12925 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.837102 13092 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:13.958389 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.953215 10737 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:13.960319 10741 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:13.962461 12920 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.963028 13115 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:13.966518 13089 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.968008 13012 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.969717 13014 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:13.972393 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:13.865285 13077 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.956384 12255 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.974818 13040 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.978323 12755 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:13.887362 13086 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:13.979183 13093 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:13.979835 12980 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:13.979948 13072 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.994462 11382 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:14.000388 10739 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:13.940202 12950 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:13.997802 12919 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:16:14.161725 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 250056us
I20260709 13:16:14.012993 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.226621 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:14.007254 10663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.022s	sys 0.045s
I20260709 13:16:14.190471 10585 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:14.217343 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1571) took 2163 ms. Trace:
I20260709 13:16:14.227046 10669 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
W20260709 13:16:14.213513 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 328362us
I20260709 13:16:14.181618 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:14.227814 10663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.023s	sys 0.095s
I20260709 13:16:14.228474 10589 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:14.228782 10589 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:14.215140 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.957635 12992 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:14.018909 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.224682 13104 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.232256 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:14.232952 10587 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:14.233150 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.234220 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:14.234812 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.236461 10588 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:14.232888 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 238494us
I20260709 13:16:14.225416 13093 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:14.227402 10736 rpcz_store.cc:276] 0709 13:16:12.003914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.004101 (+   187us) service_pool.cc:224] Handling call
0709 13:16:12.017482 (+ 13381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.066438 (+ 48956us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:12.578118 (+511680us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.106938 (+528820us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.397723 (+290785us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:13.904629 (+506906us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b2c0006cc38. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:13.905036 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.905177 (+   141us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:13.905213 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.905299 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.006542 (+101243us) raft_consensus.cc:1685] finished
0709 13:16:14.006569 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.166776 (+160207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80185,"prepare.queue_time_us":209643,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3605,"raft.queue_time_us":2617,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":26558,"spinlock_wait_cycles":27430400,"thread_start_us":861201,"threads_started":2,"wal-append.queue_time_us":573987}
I20260709 13:16:14.006844 13081 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.241899 13102 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:14.241755 13038 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.243839 11409 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:14.244453 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:14.244706 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:14.245558 13106 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.247457 13077 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.245014 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.253865 10660 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 3.
I20260709 13:16:14.254073 10559 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:14.272271 10708 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.746s (SENT)
I20260709 13:16:14.276022 10559 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:14.255045 10742 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:14.017760 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:14.144425 12730 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:14.214221 12755 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:14.160810 13112 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:14.226009 13014 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.264129 10592 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:14.264258 10706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.004s	sys 0.011s
W20260709 13:16:14.324082 10706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.012s
W20260709 13:16:14.324427 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 699540us
I20260709 13:16:14.270417 10737 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:14.277168 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.330008 10736 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:14.277899 10559 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:14.255892 13042 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:14.280166 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53608.9us
I20260709 13:16:14.334161 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:14.282187 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1551) took 1096 ms. Trace:
I20260709 13:16:14.334997 10665 rpcz_store.cc:276] 0709 13:16:13.185601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.402509 (+216908us) service_pool.cc:224] Handling call
0709 13:16:13.402818 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.415904 (+ 13086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.415946 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.419519 (+  3573us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.625109 (+205590us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:13.625161 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.625247 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.281952 (+656705us) raft_consensus.cc:1685] finished
0709 13:16:14.281979 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.282122 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28800,"raft.queue_time_us":12795,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2889,"spinlock_wait_cycles":452864,"thread_start_us":173923,"threads_started":1,"wal-append.queue_time_us":375415}
I20260709 13:16:14.259565 13071 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:14.270082 10589 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.339793 10589 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.252846 13093 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:14.320827 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:14.332026 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54221.9us
I20260709 13:16:14.270938 13106 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:14.258477 13081 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:14.281695 12549 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:14.344635 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:14.347124 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 90256.8us
I20260709 13:16:14.262588 13102 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.252657 13104 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.347334 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:14.333431 13091 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.264011 12992 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.339233 13012 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.348459 13115 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:14.321895 13112 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.348573 12814 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:14.336915 13014 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.336930 13085 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:14.351676 13058 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:14.368767 12549 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.352789 13068 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.353981 13120 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.354416 13096 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.356290 13038 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:14.357673 13119 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.392s	user 0.003s	sys 0.000s
I20260709 13:16:14.319676 13079 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.362298 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:14.319821 12730 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:14.374732 10708 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.791s (SENT)
I20260709 13:16:14.340929 13105 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:14.351799 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:14.342383 13077 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:14.393016 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.344226 13071 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:14.395987 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44281.2us
I20260709 13:16:14.398507 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:14.384382 13112 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.390192 12549 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.429504 11379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.013s	sys 0.017s
W20260709 13:16:14.429944 11379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.013s	sys 0.017s
W20260709 13:16:14.430253 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 777412us
I20260709 13:16:14.388303 13058 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:14.381675 13091 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.399824 12814 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:14.454397 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 92188us
I20260709 13:16:14.455416 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:14.447019 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:14.457113 10591 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.401059 13071 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.485984 13014 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.386822 13115 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.489986 10589 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:16:14.492278 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.450762 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:14.399958 13080 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.000s
W20260709 13:16:14.496860 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46203.6us
I20260709 13:16:14.420994 13012 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.397619 13120 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:14.394995 13085 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:14.459259 12730 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.459956 12925 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.423643 12755 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.467141 13091 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:14.392807 13096 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.467603 12814 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:14.471401 13104 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.472855 13055 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:14.473176 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 98489.6us
W20260709 13:16:14.476756 13103 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.514s	user 0.001s	sys 0.001s
I20260709 13:16:14.480353 13102 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:14.538192 12730 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.538630 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1548) took 1415 ms. Trace:
I20260709 13:16:14.538977 10666 rpcz_store.cc:276] 0709 13:16:13.123173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.147387 (+ 24214us) service_pool.cc:224] Handling call
0709 13:16:13.157483 (+ 10096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.406613 (+249130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.406642 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.416666 (+ 10024us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.589287 (+172621us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:13.589354 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.589441 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.475948 (+886507us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:14.538354 (+ 62406us) raft_consensus.cc:1685] finished
0709 13:16:14.538374 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.538576 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20882,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"spinlock_wait_cycles":53639936,"thread_start_us":364517,"threads_started":2,"wal-append.queue_time_us":465818}
I20260709 13:16:14.481052 13092 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:14.482342 13106 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.540990 13106 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.483613 13077 raft_consensus.cc:2764] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:14.484004 12992 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:14.423241 13116 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.545637 13116 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:14.546015 13116 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.421213 13079 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:14.549657 12549 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.550002 13079 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.550881 10590 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:14.452481 13126 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:14.484933 13058 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.472712 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.554260 10742 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:14.498023 10591 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:14.451329 10734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:14.557169 10734 raft_consensus.cc:606] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:14.557598 10734 raft_consensus.cc:614] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.522471 12899 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:14.523393 13120 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.501086 13118 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.527060 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:14.537168 10708 leader_election.cc:336] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.814s (SENT)
I20260709 13:16:14.570914 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:14.537398 12814 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:14.574021 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47055us
I20260709 13:16:14.580689 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:14.581663 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.558429 12755 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:14.583642 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:14.526219 13080 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.571146 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 386) took 1147 ms. Trace:
I20260709 13:16:14.578601 13115 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.580307 12992 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:14.594205 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.596002 10663 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.598011 10667 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:14.582449 12925 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:16:14.586410 12806 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:14.586737 13068 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:14.640687 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 103562us
I20260709 13:16:14.595288 11413 rpcz_store.cc:276] 0709 13:16:13.423886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.428064 (+  4178us) service_pool.cc:224] Handling call
0709 13:16:13.457569 (+ 29505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.889799 (+432230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.894396 (+  4597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.012644 (+118248us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.422095 (+409451us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:14.427801 (+  5706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.445076 (+ 17275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.553447 (+108371us) raft_consensus.cc:1685] finished
0709 13:16:14.554751 (+  1304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.569255 (+ 14504us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":303647,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":484705,"threads_started":2,"wal-append.queue_time_us":373562}
I20260709 13:16:14.595482 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:14.591789 13058 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.597512 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:14.650106 11411 raft_consensus.cc:1240] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.651736 13085 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.652151 13042 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:14.655202 13081 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.656510 12549 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.588433 12983 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.658855 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:14.659876 13030 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.660096 13116 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.660894 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:14.567539 13126 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.665915 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:14.748428 10743 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.670856 13080 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:14.671504 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.672487 13071 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.570668 12899 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.675457 13093 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.678962 10664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35970
I20260709 13:16:14.679427 10661 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:14.679733 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.759665 10664 raft_consensus.cc:606] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:16:14.760064 10664 raft_consensus.cc:614] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.686873 10669 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:14.692997 10662 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.554502 13055 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.693989 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:14.697795 10708 leader_election.cc:336] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.867s (SENT)
I20260709 13:16:14.705340 11409 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:14.697865 12806 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:14.692507 12730 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:14.760039 10665 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:14.745157 10663 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:14.769239 10743 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
W20260709 13:16:14.771122 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77232.8us
I20260709 13:16:14.771880 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:14.773844 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 76055us
I20260709 13:16:14.775019 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1590) took 1205 ms. Trace:
I20260709 13:16:14.773099 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:14.785254 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:14.736512 13042 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.797691 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:14.798782 10669 raft_consensus.cc:2410] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:14.775470 10735 rpcz_store.cc:276] 0709 13:16:13.569506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.953400 (+383894us) service_pool.cc:224] Handling call
0709 13:16:13.953902 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.998558 (+ 44656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.998601 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.162374 (+163773us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.401402 (+239028us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:14.439834 (+ 38432us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.477601 (+ 37767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.477672 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.774783 (+297111us) raft_consensus.cc:1685] finished
0709 13:16:14.774809 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.774955 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37469,"prepare.queue_time_us":58046,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":218436,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":43131,"thread_start_us":238619,"threads_started":1,"wal-append.queue_time_us":422444}
W20260709 13:16:14.809517 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.749167 13030 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.815930 13030 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:14.817085 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.773442 13093 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:14.784044 12549 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:14.783896 12983 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.827067 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:14.784474 12941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.006s	sys 0.012s
I20260709 13:16:14.782342 13068 raft_consensus.cc:2764] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:16:14.830513 10708 leader_election.cc:336] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.919s (SENT)
I20260709 13:16:14.800367 12973 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:14.831509 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.835459 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:14.839262 10708 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.987s (SENT)
I20260709 13:16:14.839715 10708 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:14.839862 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:14.841029 10708 leader_election.cc:336] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.032s (SENT)
I20260709 13:16:14.841485 13106 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.844220 12925 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:14.830495 12549 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.841903 10589 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:14.841912 13038 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.845171 12549 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:14.842245 13141 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:14.835336 12983 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.843434 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:14.854564 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.854687 12983 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:14.857427 13126 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:14.857976 13126 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:14.861156 13113 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.892s	user 0.003s	sys 0.000s
W20260709 13:16:14.859666 10708 leader_election.cc:336] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.091s (SENT)
I20260709 13:16:14.823832 13139 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:14.832180 12941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.006s	sys 0.016s
I20260709 13:16:14.852464 12850 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:14.852945 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 206) took 1196 ms. Trace:
I20260709 13:16:14.865618 12806 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.944530 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.867941 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:14.851192 10560 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:14.885947 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.946009 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.927726 10669 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:14.832926 13117 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.921379 10661 rpcz_store.cc:276] 0709 13:16:13.656468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.656637 (+   169us) service_pool.cc:224] Handling call
0709 13:16:13.771578 (+114941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.759644 (+988066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.852708 (+ 93064us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003b3154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:14.852884 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087325952}
I20260709 13:16:14.824430 12921 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:14.947218 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:14.872932 13112 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.950801 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:14.952294 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.955875 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:14.956770 10668 raft_consensus.cc:2368] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8.
I20260709 13:16:14.956621 10660 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:16:14.957823 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106685us
I20260709 13:16:14.962698 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:14.860350 13116 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:14.967044 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.968833 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.969745 10735 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:14.970261 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:14.966053 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:14.970836 10662 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:14.977514 10668 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:14.949005 13080 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:14.987916 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.988049 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.959314 13106 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.991823 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.995479 10660 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:14.965102 12925 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:14.993822 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 135151us
I20260709 13:16:14.994019 10741 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:15.001046 10708 leader_election.cc:336] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.142s (SENT)
I20260709 13:16:14.991672 10669 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 3.
I20260709 13:16:14.998013  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:14.996066 10661 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:15.001544 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:14.998982 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.004390 10668 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.008085 10735 raft_consensus.cc:2368] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:16:15.012452 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.019836 13126 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.023042 13042 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.027196 12549 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.989717 13076 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:15.029810 13076 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:15.031487 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.031143 13076 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:14.972996 12921 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:15.038077 10739 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.042059 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.035015 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:15.050127 10664 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:15.050246 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:14.968397 12950 consensus_queue.cc:1059] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:14.962718 13117 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.000365 12925 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.063421 12992 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:15.065790 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64776us
I20260709 13:16:15.068038 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:15.053058 13145 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:15.042379 13096 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.027143 13055 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.069460 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.043414 13132 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:15.042783 12899 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.045572 13038 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.071992 13042 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.068996 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:14.999816 13080 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:14.957612 13139 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:15.081146 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.064628 12755 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.085283 10739 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:15.065732 12850 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.067431 12925 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.095355 10708 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.164s (SENT)
I20260709 13:16:15.069577 12992 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:15.097648 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.093514 13042 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.124138 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.124985 10734 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.091361 12755 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.118410 13112 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.105170 13068 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:15.120909 13139 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:15.093611 13030 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:15.070514 13138 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:15.118947 12919 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:15.103170 13158 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:16:15.125356 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.116326 12921 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.101745 12992 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.134658 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.087414 13132 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.106724 12549 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:15.147490 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 61307.1us
I20260709 13:16:15.129206 12755 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.150496 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.161405 10738 raft_consensus.cc:2368] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6.
I20260709 13:16:15.101161 12850 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.159772 10660 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:15.164033 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:15.164752 10660 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.165308 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69389.4us
I20260709 13:16:15.168329 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.167382 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:15.169075 10736 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:15.178386 10662 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:15.179028 10734 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:15.179349 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:15.180080 10662 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:15.184497 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:15.187170 10668 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:15.191175 10708 leader_election.cc:336] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.216s (SENT)
I20260709 13:16:15.192723 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:15.215975 13149 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
W20260709 13:16:15.232384 10540 auto_rebalancer.cc:893] Removing replace marker failed: Replica 18f1a9f5e66846dba474825fb5b2b784 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:16:15.232872 10540 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:16:15.233147 10540 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:15.235826 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:15.236596 10663 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.220139 13071 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.223395 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:15.238646 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.233073 13162 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:16:15.249509 11415 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:16:15.250105 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.255079 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.255625 10738 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.256457 13106 raft_consensus.cc:3055] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.256834 13106 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:15.257627 13106 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.258455 10663 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:15.258793 13106 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:15.272464 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 80165.5us
I20260709 13:16:15.166265 13116 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.273398 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.140955 13030 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:15.272503 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79882.9us
I20260709 13:16:15.301291 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.304764 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.305250 10632 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:15.305440 10734 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:15.306980 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:15.320099 10668 raft_consensus.cc:2410] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:16:15.317778 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56016.3us
I20260709 13:16:15.324510 10660 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:15.327481 10738 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:15.265231 13042 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.330322 10660 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.330791 10737 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 6. Ops: [4.3-4.3]
I20260709 13:16:15.301405 12980 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:15.337663 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.338129 12980 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:15.332371 13164 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:16:15.331597 12730 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.367225 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.368786 10735 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.381690 12730 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:15.382771 13117 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.383319 13080 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.384573 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.386726 13030 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.382933 12730 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.390532 13132 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:15.382908 13173 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:15.302009 13116 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.301753 12806 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:15.334306 12973 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:15.395879 10735 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:15.388763 12925 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:15.396144 13153 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:15.341902 12980 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:15.404047 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 125784us
I20260709 13:16:15.406391 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.418522 10559 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.417243 12259 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 13:16:15.432219 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83471.2us
I20260709 13:16:15.435338 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.432165 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.437740 10743 raft_consensus.cc:2393] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 4: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:15.438303 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.404587 12973 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.430747 12806 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.429448 12553 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:15.475733 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.452342 12806 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:15.476492 10743 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.478444 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.481084 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.481830 10737 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:15.483533 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51450.8us
I20260709 13:16:15.485754 13117 raft_consensus.cc:1064] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:16:15.496536 10743 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:16:15.481030 13179 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:16:15.478451 12806 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.500976 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.496259 12553 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:15.507948 13170 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:15.517827 12973 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.518487 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.518647 13116 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.519085 10740 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.508909 12553 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:15.512247 13190 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.530122 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.527952 12814 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:16:15.542235 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.542929 11415 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:15.552983 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.557070 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.557793 10593 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:15.559482 10585 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:15.521353 12925 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.561305 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:15.562076 10589 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.564216 10594 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:15.562626 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:15.565488 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:15.528929 12553 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.573051 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.567171 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.537845 13190 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:15.578661 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.579552 11418 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:15.572039 10743 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.568015 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.580940 10593 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:15.584419 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.585482 10739 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:15.586975 10742 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:15.588917 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.592963 10593 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:15.568207 12850 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.568014 12973 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.563187 13195 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.591178 10739 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:15.600539 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.601154 10742 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:15.601888 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.602273 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.602451 10593 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:15.588816 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.607218 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.609959 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.610520 10743 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.598775 12973 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:15.614683 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.615263 10737 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:15.616382 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:15.619102 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.624049 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.626984 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.627660 10739 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.628973 10743 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:15.608465 12850 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.631027 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.633579 12992 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:15.635468 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.653587 12850 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.654775 10594 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:15.655838 12850 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:15.637346 11382 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:15.657704 11382 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:15.612519 13190 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.658689 12849 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:15.659106 12849 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.639921 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.659536 12849 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.610095 13071 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.660223 13071 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.661470 13176 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:15.661990 13176 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:15.662281 13071 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.641359 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.662798 13176 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.665216 10668 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:15.637610 12973 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.643939 13117 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.645633 12925 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.669636 12925 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.671700 12925 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.646040 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.672518 10589 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:15.646678 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.648739 12553 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.649910 12921 raft_consensus.cc:1064] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:16:15.681244 12553 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.629161 13080 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:15.684939 13080 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.621793 13132 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.690063 13132 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.690622 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.692200 13132 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.693619 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.650472 10557 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.651283 10592 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.645128 12755 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.658938 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:15.675696 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.698333 10587 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:15.698743 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:15.643347 13093 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
W20260709 13:16:15.678200 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.669061 10664 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.702430 10593 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.707284 12755 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:15.706067 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 55677us
I20260709 13:16:15.708196 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.709241 12992 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:15.709851 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.710646 13186 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:15.710964 10591 raft_consensus.cc:2410] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:15.711064 13186 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:15.711627 13186 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.711817 11410 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:15.603658 13195 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.714391 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:15.714560 13195 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.717446 13192 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.717866 10742 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.718540 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:15.721632 13192 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:15.722029 13192 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.722405 13192 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.720690 13186 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:15.709977 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:15.726270 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.737874 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 250302us
I20260709 13:16:15.622166 12730 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:15.743321 10743 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:15.733624 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:15.745942 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.746910 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.746747 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.749131 11415 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:15.751626 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.752873 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:15.753594 11411 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
W20260709 13:16:15.754184 13161 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.701s	user 0.002s	sys 0.000s
I20260709 13:16:15.750054 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.750531 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.751315 12730 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:15.757485 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.758252 10738 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:15.759271 10591 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:15.756011 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:15.761258 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.761866 10735 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:15.729719 13080 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:15.763293 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:15.765741 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:15.778429 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:15.776877 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.772832 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:15.781603 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:15.782243 10591 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:15.748751 12992 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.764272 12556 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.750308 13093 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:15.766970 13106 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:15.778674 13132 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:15.814769 10593 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 4.
I20260709 13:16:15.768746 12755 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.762239 13196 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:15.825883 10742 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:15.777887 13077 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:15.835662 11382 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:15.784564 13124 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.844689 10667 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:15.789433 12556 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.852362 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:15.778975 13078 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:16:15.814533 13195 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.858780 10740 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:15.820580 13132 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:15.872725 10739 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:15.862399 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80560.5us
W20260709 13:16:15.884284 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 116362us
I20260709 13:16:15.858453 12556 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.885819 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:15.992694 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:15.906036 13195 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:15.831641 12980 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:15.859730 13138 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.880175 13132 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.841673 12755 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.017620 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:16.022379 13168 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.905s	user 0.002s	sys 0.002s
I20260709 13:16:15.823787 12992 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:16.022027 12730 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.031672 13186 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:16.036706 10635 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.541s (SENT)
I20260709 13:16:16.076318 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:16.058818 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 173061us
I20260709 13:16:15.869458 13081 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.061215 10660 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.009769 13106 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:16.021059 13185 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.906283 12925 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:16:16.042627 13188 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.076473 12806 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
I20260709 13:16:16.090912 10660 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:15.869066 12921 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.074651 13078 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.099712 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:16.100315 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63638us
I20260709 13:16:16.076745 13138 raft_consensus.cc:697] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:16.108395 10660 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.117558 10660 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:16.118427 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:16.118950 10660 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:16.119637 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:16.120131 10660 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:16.108337 10635 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.548s (SENT) [suppressed 27 similar messages]
W20260709 13:16:16.147514 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.101119 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:16.106478 13078 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.088999 13185 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:16.179512 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.096105 13188 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.210060 11412 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.164821 13195 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.227173 10660 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:16.101509 12806 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:16.210865 13078 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.234252 10660 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:16.273842 10668 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:16.232221 13058 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:16.274295 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 183108us
I20260709 13:16:16.281749 10660 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.289494 10660 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:16.291618 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 386922us
W20260709 13:16:16.294018 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.299255 11412 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:16:16.293219 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 195775us
I20260709 13:16:16.291988 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:16.301988 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:16.314838 13217 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.315223 13217 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.315505 13217 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:16.321786 13205 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:16.322427 13217 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.324647 13217 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:16.303635 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.12149e+06us
I20260709 13:16:16.304380 13132 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.304827 12899 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.306141 12825 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:16.307840 12556 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.234421 13106 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:16.312096 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.312951 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:16.325743 13212 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:16.326086 13209 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:16.331614 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:16.331815 10708 leader_election.cc:336] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.225s (SENT)
W20260709 13:16:16.302994 13175 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.955s	user 0.005s	sys 0.003s
I20260709 13:16:16.450680 10591 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:16.436995 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:16.311359 12755 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:16.330312 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:16.461622 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 148758us
I20260709 13:16:16.462673 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:16.277732 13138 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.338999 12825 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:16.488313 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:16.481643 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 149842us
I20260709 13:16:16.450984 13207 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:16.489493 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:16.495774 10591 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.501649 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:16.503242 10590 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.467734 13196 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.507829 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 399491us
I20260709 13:16:16.509054 11415 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:16.509222 10635 leader_election.cc:336] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.617s (SENT)
I20260709 13:16:16.509613 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:16.510872 10592 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:16.467551 12980 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:16.472477 12899 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.511755 10589 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:16.513051 12730 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:16.514585 10635 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.645s (SENT)
I20260709 13:16:16.513120 13223 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:16.515240 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:16.563545 13223 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:16.563912 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49403.5us
I20260709 13:16:16.563964 13086 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:16.564566 13086 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:16.564957 12730 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.565485 13216 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:16.565932 12850 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.565678 13086 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.566431 12850 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:16.565157 10635 leader_election.cc:400] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:16:16.566947 10635 leader_election.cc:403] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.567162 13086 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.567920 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:16.529757 13196 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.569861 13196 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.532833 12556 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.496762 13220 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.497473 11412 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:16.545902 13192 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.000s
I20260709 13:16:16.501801 13058 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:16.550474 12899 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.550209 12980 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.552013 13209 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.562988 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:16.516106 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:16.602270 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 86228.8us
I20260709 13:16:16.526321 13188 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.566030 13216 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.566871 12850 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:16.529386 13214 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:16:16.571067 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1891) took 1917 ms (client timeout 1639 ms). Trace:
W20260709 13:16:16.613005 10667 rpcz_store.cc:269] 0709 13:16:14.653185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.658625 (+  5440us) service_pool.cc:224] Handling call
0709 13:16:16.570867 (+1912242us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002da354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:16.570986 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344308992}
I20260709 13:16:16.571147 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:16.527452 12825 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.478945 11409 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:16.581061 13071 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 3. Current term is 4.
I20260709 13:16:16.581169 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:16.594945 13220 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:16.603412 13209 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.609391 13195 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:16.584270 12730 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:16.615028 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.600590 12806 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.605679 13076 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.610675 11414 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:16.599112 12899 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.511020 13207 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.599737 13058 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:16.664776 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.598578 13192 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:16.634861 12825 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:16.794463 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 213341us
I20260709 13:16:16.795272 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:16.672926 10590 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:16.564461 13223 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:16.664713 13222 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.677798 12730 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:17.088690 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 423059us
I20260709 13:16:16.985769 13132 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:16.679225 12806 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.404s
W20260709 13:16:17.046212 13218 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.432s	user 0.000s	sys 0.000s
I20260709 13:16:17.050292 13220 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.052295 13216 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.054354 13209 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.056071 12899 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:16.900911 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 394) took 1145 ms. Trace:
I20260709 13:16:17.096817 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:16.664234 13076 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:17.102035 10708 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.012s
I20260709 13:16:17.104228 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:17.108289 13138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.010s	sys 0.008s
W20260709 13:16:17.041040 13228 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.429s	user 0.000s	sys 0.000s
W20260709 13:16:17.064790 13078 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 13:16:17.127075 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.104681 10735 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.199263 10743 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:17.183399 10708 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.004s	sys 0.012s
W20260709 13:16:17.201179 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 688460us
W20260709 13:16:17.211350 13229 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:16:17.218994 13207 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.226220 13058 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.229696 12980 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.082649 13222 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.183768 13076 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:17.187726 13138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.010s	sys 0.009s
I20260709 13:16:17.242532 13192 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.197582 13238 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:17.248387 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.028s	sys 0.075s
W20260709 13:16:17.253995 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.016s
W20260709 13:16:17.256637 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.016s
W20260709 13:16:17.256237 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.028s	sys 0.075s
W20260709 13:16:17.258046 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 644188us
W20260709 13:16:17.248209 13086 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.002s
W20260709 13:16:17.247423 12850 consensus_meta.cc:287] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.003s
W20260709 13:16:17.252166 13106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.006s	sys 0.019s
I20260709 13:16:17.201068 13209 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:16:17.264767 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:17.268990 13230 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.269311 13222 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.270258 13222 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.271363 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.271729 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.278435 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.279227 10739 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:17.282164 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:17.283004 10738 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:17.283109 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.284011 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.284121 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1606) took 1001 ms. Trace:
I20260709 13:16:17.284462 10668 rpcz_store.cc:276] 0709 13:16:16.283066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.286545 (+  3479us) service_pool.cc:224] Handling call
0709 13:16:16.286913 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.298160 (+ 11247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.298195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.298583 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.506353 (+207770us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:16.506405 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.506490 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.283938 (+777448us) raft_consensus.cc:1685] finished
0709 13:16:17.283954 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.284072 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5105,"raft.queue_time_us":9481,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":2347,"thread_start_us":49398,"threads_started":1,"wal-append.queue_time_us":206304}
I20260709 13:16:17.185061 11414 rpcz_store.cc:276] 0709 13:16:15.533625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.537957 (+  4332us) service_pool.cc:224] Handling call
0709 13:16:16.562875 (+1024918us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194eee 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:16.678605 (+115730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7225600}
I20260709 13:16:17.288112 10735 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:17.289499 10735 pending_rounds.cc:85] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:17.270694 13222 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.289737 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:17.289786 10735 pending_rounds.cc:107] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:17.291055 10735 raft_consensus.cc:2889] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.292066 10740 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:17.292145 10743 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.292488 10738 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:17.269519 13230 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:17.265385 13106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.006s	sys 0.019s
I20260709 13:16:17.205775 13078 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.276126 12549 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:17.289175 12259 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:16:17.352963 13240 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:17.362812 12980 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:17.364847 13191 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.368474 13222 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.406069 10593 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:17.406499 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1610) took 2405 ms. Trace:
I20260709 13:16:17.282828 13086 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.398415 10738 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.415261 13230 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.406885 10735 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.455986 10738 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:17.263527 12850 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.408684 10743 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:17.410756 12849 consensus_meta.cc:287] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.751s	user 0.006s	sys 0.007s
I20260709 13:16:17.503762 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 250) took 1848 ms. Trace:
W20260709 13:16:17.337689 13138 raft_consensus.cc:670] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 13:16:17.415344 10741 rpcz_store.cc:276] 0709 13:16:15.001341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.014754 (+ 13413us) service_pool.cc:224] Handling call
0709 13:16:15.053221 (+ 38467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.053551 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:15.067798 (+ 14247us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.304587 (+1236789us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800383500. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:17.127025 (+822438us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.406093 (+279068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.406156 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.406216 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.406298 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.406435 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244020,"prepare.queue_time_us":427706,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":5023,"raft.queue_time_us":100935,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20504,"spinlock_wait_cycles":3526400,"thread_start_us":894514,"threads_started":3,"wal-append.queue_time_us":1562404}
W20260709 13:16:17.439715 12825 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:16:17.506403 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:17.411353 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.509764 10740 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:17.509827 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:17.519589 10635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.005s	sys 0.009s
W20260709 13:16:17.519958 10635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.005s	sys 0.009s
I20260709 13:16:17.510572 10737 rpcz_store.cc:276] 0709 13:16:15.655224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.694475 (+ 39251us) service_pool.cc:224] Handling call
0709 13:16:15.694718 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.694900 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:16.632231 (+937331us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.503215 (+870984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.503304 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:17.503378 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.503482 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.503675 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":916885,"prepare.queue_time_us":977865,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":117568,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":58,"thread_start_us":870334,"threads_started":2,"wal-append.queue_time_us":729128}
I20260709 13:16:17.535554 10590 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.538357 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:17.541069 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.541662 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.542464 10594 raft_consensus.cc:2368] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9.
I20260709 13:16:17.543031 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.543581 10737 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:17.544133 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.545393 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.519455 12601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.008s	sys 0.006s
I20260709 13:16:17.546006 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.411860 13191 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.549580 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.549077 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.550261 10586 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:17.556097 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 298548us
W20260709 13:16:17.556126 10708 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.304s (SENT)
W20260709 13:16:17.547839 12601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.008s	sys 0.006s
I20260709 13:16:17.542845 13238 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.557646 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:17.505362 12849 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.559128 10586 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:17.559089 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.544783 13058 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.570866 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.572896 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.548312 13209 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:17.580682 13191 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.580734 13058 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.581378 13248 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.557389 13230 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.558954 13244 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.555673 13106 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:17.588425 10737 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:17.587996 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.588660 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.588335 13112 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.590196 13248 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:17.590876 10708 connection.cc:256] RPC call timeout handler was delayed by -3.1286475179999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3024s for a response
W20260709 13:16:17.619737 10708 connection.cc:256] RPC call timeout handler was delayed by -2.9849432290000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31370000000000003s for a response
I20260709 13:16:17.592623 13058 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.593173 13230 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.596576 12850 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:17.597499 13231 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:17.599193 12849 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.601068 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.601778 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:17.587078 13245 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:17.602960 13247 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.578913 13132 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.579167 12730 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.574389 13216 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.580210 13238 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.605296 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:17.637624 13058 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.606108 10736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.033s	sys 0.076s
W20260709 13:16:17.606499 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 316185us
W20260709 13:16:17.651127 10736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.033s	sys 0.076s
I20260709 13:16:17.581965 13209 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:17.628222 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.651856 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1618) took 2512 ms. Trace:
I20260709 13:16:17.630119 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:17.639680 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:17.642046 10589 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:17.642863 10738 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.612682 13112 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:17.646987 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.630865 13078 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:17.605546 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 810257us
I20260709 13:16:17.661095 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:17.661422 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56219.4us
I20260709 13:16:17.653008 13250 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:17.664316 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:17.652355 10736 rpcz_store.cc:276] 0709 13:16:15.139661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.154720 (+ 15059us) service_pool.cc:224] Handling call
0709 13:16:15.168737 (+ 14017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.168939 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:15.316817 (+147878us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.334124 (+ 17307us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.594604 (+1260480us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b1800009280. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf 00007f42572d3038
0709 13:16:16.594779 (+   175us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.651455 (+1056676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.651502 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:17.651543 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.651605 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.651787 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1232875,"prepare.queue_time_us":1281689,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":387876,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":10077,"spinlock_wait_cycles":20550784,"thread_start_us":1056227,"threads_started":2,"wal-append.queue_time_us":607527}
I20260709 13:16:17.648651 13243 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.611835 13244 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.649511 12849 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.654481 13209 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.674580 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:17.678032 13176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.010s	user 0.004s	sys 0.056s
I20260709 13:16:17.678774 13243 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.650244 13132 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:17.682427 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.687419 10738 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
W20260709 13:16:17.710160 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.651469 12730 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.654980 13058 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.679569 13207 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.696707 13244 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.692849 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:17.713690 11382 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.665818 13252 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:17.693493 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:17.714831 10708 connection.cc:256] RPC call timeout handler was delayed by -2.5693468140002551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:16:17.727429 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:17.727741 10708 connection.cc:256] RPC call timeout handler was delayed by -2.4604468140003064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:16:17.728240 10708 connection.cc:256] RPC call timeout handler was delayed by -2.4217468140002438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 13:16:17.728601 10708 connection.cc:256] RPC call timeout handler was delayed by -2.4136468140002307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:16:17.729070 10708 connection.cc:256] RPC call timeout handler was delayed by -2.0680468140001267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 13:16:17.712963 13176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.045s	user 0.004s	sys 0.056s
I20260709 13:16:17.722790 13106 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.655304 13216 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:17.648846 13247 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:17.729445 10708 connection.cc:256] RPC call timeout handler was delayed by -2.0528475720000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 13:16:17.677453 13086 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.738667 13086 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:17.684837 12825 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:17.726176 13249 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:17.646651 13245 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:17.736765 10708 connection.cc:256] RPC call timeout handler was delayed by -1.8989475719999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 13:16:17.739166 13086 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:17.740584 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.677798 12849 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.739631 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:17.743669 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69176.4us
I20260709 13:16:17.731585 13138 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:17.731703 13244 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.732764 13106 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:17.760381 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:17.756016 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:17.739351 13252 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:17.762300 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:17.770262 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:17.745738 13132 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.763864 13138 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:17.731482 13207 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.775249 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.731747 13112 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:17.785663 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46110.7us
I20260709 13:16:17.765143 13255 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.746212 12825 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:17.792667 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48672.2us
I20260709 13:16:17.795044 13216 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.796576 13245 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.797115 13246 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.797561 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.797262 13252 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.798134 10586 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:17.799131 13112 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.799887 13248 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.788475 13106 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.800966 13263 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.801568 13263 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.801640 13106 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.802080 13263 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.803856 13138 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.804962 12825 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.763975 13244 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.815604 10632 leader_election.cc:400] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9.
I20260709 13:16:17.818642 10632 leader_election.cc:403] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:17.774300 13259 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:17.781052 13132 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.817426 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 259) took 1248 ms. Trace:
I20260709 13:16:17.822091 10742 rpcz_store.cc:276] 0709 13:16:16.568588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.568726 (+   138us) service_pool.cc:224] Handling call
0709 13:16:16.569116 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.060985 (+491869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.061027 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.061077 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:17.061118 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.817185 (+756067us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540036ced4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:17.817230 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.817368 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130683392}
I20260709 13:16:17.816720 13216 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:17.819339 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49143.8us
I20260709 13:16:17.824236 13132 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:17.827455 13182 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 2.321s	user 0.011s	sys 0.062s
I20260709 13:16:17.827610 11414 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:17.785976 13261 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.831650 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:17.832214 12825 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:17.837998 13255 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:17.838076 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 211) took 3235 ms. Trace:
I20260709 13:16:17.844458 10666 rpcz_store.cc:276] 0709 13:16:14.593257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.593398 (+   141us) service_pool.cc:224] Handling call
0709 13:16:14.640949 (+ 47551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.644292 (+  3343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.644327 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.644804 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.266017 (+621213us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b180002dfa0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:15.397194 (+131177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:15.487799 (+ 90605us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.488149 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.488242 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.826781 (+2338539us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:17.828784 (+  2003us) raft_consensus.cc:1685] finished
0709 13:16:17.828804 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.828922 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140772,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1975,"raft.queue_time_us":205,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":2293,"spinlock_wait_cycles":84024576,"thread_start_us":211859,"threads_started":2,"wal-append.queue_time_us":831244}
W20260709 13:16:17.846354 13254 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:17.847333 13255 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.829668 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:17.851231 13137 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.851625 13137 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:17.851979 13137 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.838487 13055 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.853231 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:17.843384 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:17.813921 13247 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:17.870283 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.825281 13251 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.879062 13257 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.825672 13230 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.838501 13245 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.881297 10734 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.895895 10734 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:17.890348 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 47084.4us
I20260709 13:16:17.894732 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.899367 10708 leader_election.cc:400] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8.
I20260709 13:16:17.901949 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:17.903878 12601 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.903726 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:17.829073 13267 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:17.844781 13132 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.920288 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:17.896852 10734 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.916334 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:17.920994 10742 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:16:17.895480 13076 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
I20260709 13:16:17.915453 13248 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.878080 13238 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.895584 13257 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.880744 12919 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:17.928655 12601 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:17.942339 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:17.949453 12549 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.944020 13260 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:17.928596 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:17.956808 13252 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:17.967406 13260 consensus_queue.cc:1243] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:17.894183 13247 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:16:17.943002 13253 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:17.949000 13055 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9.
I20260709 13:16:17.943775 13244 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.922323 12849 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.929726 13230 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:17.924065 13058 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:17.922063 12899 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:17.957048 13248 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:17.981431 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.959060 13257 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.948933 13086 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:17.966001 11414 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:17.968334 13068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.315s	user 0.017s	sys 0.073s
I20260709 13:16:17.957485 13250 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:17.916356 13245 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:17.970913 12825 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:17.925985 13085 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 13:16:18.022684 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 266634us
I20260709 13:16:18.019990 13230 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:18.025108 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:17.949769 13243 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:17.981657 13253 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:17.962527 13259 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:16:18.016598 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 90502.7us
W20260709 13:16:18.028409 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 133746us
I20260709 13:16:17.970769 12850 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:18.018985 12919 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.033947 10635 leader_election.cc:400] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6.
I20260709 13:16:18.048313 10635 leader_election.cc:403] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:16:18.029760 13068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.377s	user 0.017s	sys 0.074s
I20260709 13:16:17.953722 13076 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.028199 13252 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.041050 13195 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.042520 13086 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:18.036187 13230 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.044349 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:18.010548 13186 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:18.060014 13195 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.044330 13253 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.050217 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.050244 13192 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:16:18.047768 12919 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:18.098496 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 48360.3us
I20260709 13:16:18.061641 10588 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:18.065904 11409 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:18.080219 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:18.054266 13058 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6.
W20260709 13:16:18.049093 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.059806 13252 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.081457 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:18.083762 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49939.1us
I20260709 13:16:18.108009 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.067655 13209 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.071830 12899 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:18.072467 13186 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.099912 10740 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.111407 13279 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:18.111577 13055 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.108978 13211 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.113590 13211 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:18.101011 13112 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.114454 13211 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.114701 13112 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.115486 13211 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.116711 13112 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:18.104677 12850 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.087196 13195 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.110183 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65906.4us
I20260709 13:16:18.131253 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:18.113689 13206 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 2.251s	user 0.009s	sys 0.007s
I20260709 13:16:18.096472 12973 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.061283 13076 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:18.121095 10740 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.147930 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:18.130015 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.148892 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:18.149637 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.128250 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:18.149994 13236 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.106948 13252 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.097654 13137 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.100737 11414 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:18.154554 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.066960 13248 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.117353 11411 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.168974 13273 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:16:18.169677 13209 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:18.132790 12549 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:16:18.177346 10663 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:18.177435 13238 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.178015 13238 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.178435 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.179032 10669 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:18.179939 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.180425 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.181704 10665 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:18.157291 13247 raft_consensus.cc:2764] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:18.180986 10662 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:18.185184 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.125577 12899 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.197651 13275 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.158471 13236 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.154515 13279 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:18.184357 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:18.190052 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:18.156800 13055 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:18.160027 13058 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.202467 11418 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.203687 11411 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.204120 12899 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:18.163540 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.273200 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.273918 10668 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:18.274132 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 110656us
I20260709 13:16:18.179876 13238 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:18.207132 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.275369 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.212725 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:18.276181 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.219945 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:18.110528 12919 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.210024 12825 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:18.294554 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:18.300307 10742 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:18.280889 13058 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.303622 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.275856 13245 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:18.310856 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:18.311235 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:18.311623 10661 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.311879 10669 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.315402 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.315652 12919 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.323648 13253 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.325685 13257 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.302718 12825 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.327760 13257 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:18.327452 12825 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.329113 13230 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.330850 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:18.331427 10592 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.331622 10590 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.334326 13137 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:18.334949 13236 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.209151 13263 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.331053 13230 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:18.348109 10635 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:18.349280 10590 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:18.318174 13132 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.350611 13209 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.349979 13261 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:18.313110 13238 raft_consensus.cc:2764] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:18.308030 13275 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:16:18.382105 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:18.398800 10590 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.399295 10590 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.361361 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.380511 10664 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.360584 10661 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.400188 10590 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.449779 10590 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.417520 10662 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:18.420099 10666 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.355019 13245 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:18.426232 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:18.379261 13285 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:16:18.457756 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 75744.5us
I20260709 13:16:18.458746 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:18.459686 10664 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.396044 13188 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.397346 13216 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:18.476465 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 131479us
W20260709 13:16:18.434032 13106 consensus_meta.cc:287] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.002s
I20260709 13:16:18.371189 13253 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:18.430475 12973 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.490433 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:18.545265 11443 heartbeater.cc:646] Failed to heartbeat to 127.9.68.126:35023 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.68.126:35023 timed out after 15.000s (SENT)
I20260709 13:16:18.549388 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:18.553392 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.459975 13055 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.556109 10664 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:18.573426 10590 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:18.590691 11411 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:18.475864 12899 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.408208 13196 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:16:18.600947 10590 pending_rounds.cc:85] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 7
I20260709 13:16:18.376791 13209 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:18.493824 13080 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.491670 13216 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.631621 12973 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.668219 12899 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.504073 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:18.670935 10590 pending_rounds.cc:107] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:18.822847 10590 raft_consensus.cc:2889] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.823410 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.698475 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:18.689868 13080 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:18.670295 13184 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.357906 13279 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:18.701771 13291 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:18.819749 13209 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:18.683573 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.715188 13216 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.496138 13188 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:18.830873 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.832834 10592 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.000s
I20260709 13:16:18.881585 10592 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
W20260709 13:16:18.724234 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.853575 10708 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.639s (SENT)
I20260709 13:16:18.863847 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:18.864745 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 503434us
I20260709 13:16:18.883227 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:18.865150 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:18.876222 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 417545us
I20260709 13:16:18.883772 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:18.884192 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.884950 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.821511 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:18.871999 12549 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.886080 13080 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.886545 13209 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:18.886878 13132 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.887418 13080 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.872362 10737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.022s	sys 0.049s
I20260709 13:16:18.822525 12899 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.716835 13263 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:18.887099 13209 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:18.889832 13289 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:16:18.890303 13106 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:18.890792 13106 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.892390 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:18.892678 10737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.022s	sys 0.049s
I20260709 13:16:18.892963 11413 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:18.878539 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.896320 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.898524 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:18.898701 10590 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:18.907269 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1802) took 1337 ms. Trace:
I20260709 13:16:18.870139 12809 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.873206 13267 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.909844 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:18.907752 10588 rpcz_store.cc:276] 0709 13:16:17.569940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.570320 (+   380us) service_pool.cc:224] Handling call
0709 13:16:18.907048 (+1336728us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540020fb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:18.907197 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108235648}
I20260709 13:16:18.913456 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:18.914788 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:18.915738 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1784) took 3269 ms. Trace:
I20260709 13:16:18.916193 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:18.917822 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:18.918695 11415 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:18.871691 11410 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:18.879709 13184 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.916227 10585 rpcz_store.cc:276] 0709 13:16:15.639889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.640324 (+   435us) service_pool.cc:224] Handling call
0709 13:16:15.640621 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.713583 (+ 72962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.713612 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.714033 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.819199 (+105166us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:15.819236 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.113017 (+2293781us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:18.908709 (+795692us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54001e4bd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:18.908776 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.908822 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:18.908841 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.908998 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":950,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"spinlock_wait_cycles":208278144,"thread_start_us":104850,"threads_started":1,"wal-append.queue_time_us":148067}
I20260709 13:16:18.919106 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:18.897672 13230 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.925657 13245 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:18.905174 13263 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.911839 12809 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:18.926491 13275 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:18.913697 13132 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.926535 13071 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.962473 12809 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:18.964865 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:18.985097 10668 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.970295 13209 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:18.971546 13211 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.856s	user 0.011s	sys 0.002s
I20260709 13:16:18.928369 13238 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:18.976471 13230 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.955322 11414 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.940038 13261 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:18.965716 13184 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:18.988663 10667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.001s	sys 0.033s
W20260709 13:16:19.013501 10667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.001s	sys 0.033s
I20260709 13:16:18.943203 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:18.983202 13195 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.813s	user 0.009s	sys 0.000s
I20260709 13:16:18.994990 10740 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:18.981549 13247 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.994057 13071 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:19.055507 12919 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.000s
I20260709 13:16:19.055994 13185 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.015640 12809 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.056028 13071 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:19.059037 13258 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.288s	user 0.014s	sys 0.000s
I20260709 13:16:18.988950 13275 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:19.064486 13275 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:19.013584 13252 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.002s
I20260709 13:16:19.065594 13252 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:19.066798 13290 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.741s	user 0.005s	sys 0.010s
I20260709 13:16:19.067677 13252 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.071345 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.072757 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.072937 10668 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:19.074676 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.095821 10662 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.096741 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.097422 10662 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:19.098315 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.099211 10662 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:19.076761 11411 raft_consensus.cc:2368] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9.
I20260709 13:16:19.013178 13261 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:19.083516 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.111150 10665 raft_consensus.cc:2410] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:19.112036 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.084393 12601 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:19.086113 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 405) took 1208 ms. Trace:
I20260709 13:16:19.089074 10664 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:16:19.090040 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.100414 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.130973 10668 raft_consensus.cc:2376] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7. Re-sending same reply.
I20260709 13:16:19.120500 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.132098 10662 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:19.133136 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.134552 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.135521 10662 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:19.128778 11418 rpcz_store.cc:276] 0709 13:16:17.877291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.877589 (+   298us) service_pool.cc:224] Handling call
0709 13:16:17.915834 (+ 38245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.213593 (+297759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.085852 (+872259us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540065efd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:19.086042 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658605312}
I20260709 13:16:19.137827 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.130228 12601 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:19.149281 12601 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.150306 12601 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.128791 13261 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.138633 10665 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:19.110651 13221 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:16:19.053932 13195 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.236168 10739 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:19.166049 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.162307 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.321452 10662 raft_consensus.cc:2410] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:16:19.254908 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 427837us
I20260709 13:16:19.322623 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:19.324203 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 57394.4us
I20260709 13:16:19.323347 10585 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:19.324482 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.326001 10662 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:19.204440  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:19.165206 10664 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:19.327952 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:19.326248 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.329108 10665 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.328532 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.328941 10668 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:19.330073 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.330982 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:19.277467 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.241582 12825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.053s	sys 0.087s
I20260709 13:16:19.332428 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:19.274571 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:19.275038 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 358919us
W20260709 13:16:19.267568 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 359400us
I20260709 13:16:19.337651 10660 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:19.338790 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.332788 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.339869 10662 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.243891 13080 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.341869 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:19.342197 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.327979 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.326872 13209 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.344089 10664 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:19.344699 10668 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.344538 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:19.343096 13252 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.241706 13207 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:19.361209 13080 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.340607 10665 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:19.330678 13238 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:19.386042 11413 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:19.386217 13195 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.348984 13138 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:16:19.386662 10706 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.416775 13261 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.387842 13312 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.373415 10660 raft_consensus.cc:2410] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:16:19.400357 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.093708 13247 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.413565 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1624) took 1111 ms. Trace:
W20260709 13:16:19.339699 12825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.070s	sys 0.099s
I20260709 13:16:19.455295 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.456333 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1616) took 1256 ms. Trace:
I20260709 13:16:19.456868 13247 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:19.456725 10667 rpcz_store.cc:276] 0709 13:16:18.200491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.200658 (+   167us) service_pool.cc:224] Handling call
0709 13:16:18.204175 (+  3517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.204831 (+   656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.204872 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.205389 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.013966 (+808577us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.014025 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.014105 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.456160 (+442055us) raft_consensus.cc:1685] finished
0709 13:16:19.456177 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.456280 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":808177,"threads_started":1,"wal-append.queue_time_us":1045584}
I20260709 13:16:19.459333 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.460330 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.463862 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.464524 10667 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.420548 13209 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.456355 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.466049 10734 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.466205 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.466794 10739 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:19.466928 10660 raft_consensus.cc:2393] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.467793 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.467860 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.468205 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.468904 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.451800 11411 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:19.469624 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.470311 10737 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:19.471077 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.471617 10737 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
I20260709 13:16:19.472363 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.472851 10737 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.454682 13238 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.473893 10741 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:19.475167 10741 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:19.469734 10660 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:19.476473 10667 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:19.345001 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:19.421021 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 76759.2us
I20260709 13:16:19.476814 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.419282 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.477895 10668 raft_consensus.cc:2368] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:16:19.386582 13216 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:19.434979 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 89163.2us
I20260709 13:16:19.137450 12899 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.479866 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.453303 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.451706 10663 rpcz_store.cc:276] 0709 13:16:18.302357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.302493 (+   136us) service_pool.cc:224] Handling call
0709 13:16:18.302766 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.303349 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:18.491595 (+188246us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.014546 (+522951us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.014773 (+   227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.043797 (+ 29024us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.043959 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:19.043990 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.044063 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.413336 (+369273us) raft_consensus.cc:1685] finished
0709 13:16:19.413355 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.413498 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":973,"prepare.queue_time_us":639429,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":5895,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":71246,"thread_start_us":492047,"threads_started":2,"wal-append.queue_time_us":570065}
I20260709 13:16:19.480279 10734 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:19.480729 10665 raft_consensus.cc:2376] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7. Re-sending same reply.
I20260709 13:16:19.466912 13209 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:19.480963 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1655) took 1621 ms. Trace:
I20260709 13:16:19.443406 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.483484 10666 raft_consensus.cc:2368] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:16:19.483412 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.442389 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.469022 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:19.482132 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 140433us
I20260709 13:16:19.420722 13252 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:19.484834 10739 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.486305 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1631) took 1113 ms. Trace:
I20260709 13:16:19.434332 12921 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.442111 13307 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.488113 10560 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.481683 10734 rpcz_store.cc:276] 0709 13:16:17.859287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.859502 (+   215us) service_pool.cc:224] Handling call
0709 13:16:17.859716 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.461160 (+1601444us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b540023b7a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f425722ea1d 00007f42572151a4 00007f4257297447 00007f42572affe7 00007f42572b17de 00007f42572bbb49 00007f42572bc416 00007f42572b8d8f 00007f42572b883e 00007f425c27d419
0709 13:16:19.480738 (+ 19578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.480914 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95227136}
I20260709 13:16:19.489923 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.508117 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.491451 10667 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:19.595788 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1635) took 1222 ms. Trace:
I20260709 13:16:19.619223 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1634) took 1246 ms. Trace:
I20260709 13:16:19.545717 10660 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 6.
I20260709 13:16:19.619573 10667 rpcz_store.cc:276] 0709 13:16:18.373273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.491007 (+1117734us) service_pool.cc:224] Handling call
0709 13:16:19.491251 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.618982 (+127731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.619162 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:19.497431 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:19.540917 10737 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:19.491940 10665 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:19.452837 13207 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.621074 10666 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 3.
W20260709 13:16:19.617102 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 66909.8us
I20260709 13:16:19.619390 10664 rpcz_store.cc:276] 0709 13:16:18.373554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.507377 (+1133823us) service_pool.cc:224] Handling call
0709 13:16:19.595015 (+ 87638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.595309 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.595346 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.595411 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:19.595470 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.595542 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.595710 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:19.621181 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.587591 10739 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:19.623838 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 135818us
I20260709 13:16:19.624294 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1633) took 1251 ms. Trace:
I20260709 13:16:19.632759 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1637) took 1258 ms. Trace:
I20260709 13:16:19.633659 10666 rpcz_store.cc:276] 0709 13:16:18.374057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.631503 (+1257446us) service_pool.cc:224] Handling call
0709 13:16:19.632273 (+   770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.632441 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.632466 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.632508 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.632556 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.632608 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.632714 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:19.620380 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 130493us
I20260709 13:16:19.484865 13238 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.529585 13247 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:19.636291 13216 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:19.497812 13252 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.632071 10665 rpcz_store.cc:276] 0709 13:16:18.373033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.491583 (+1118550us) service_pool.cc:224] Handling call
0709 13:16:19.491758 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.624074 (+132316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.624245 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:19.646663 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:19.629086 10667 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.611871 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:19.627842 12825 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:19.618103 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:19.618289 12921 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:19.529192 13310 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.626034 13209 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:19.642074 10666 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:19.491083 10663 rpcz_store.cc:276] 0709 13:16:18.372554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.485617 (+1113063us) service_pool.cc:224] Handling call
0709 13:16:19.485879 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.486035 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.486058 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.486088 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:19.486136 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.486180 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.486257 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:19.594731 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:19.625617 13207 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:19.494743 13217 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:16:19.647918 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.650625 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:19.757289 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106727us
I20260709 13:16:19.738548 13080 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:19.675206 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.759927 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.646925 13247 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:19.626256 13307 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:19.652478 13196 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:19.665432 12921 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.724469 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.657002 12825 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.665668 13310 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:19.646332 12925 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:16:19.666054 11411 raft_consensus.cc:2376] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9. Re-sending same reply.
I20260709 13:16:19.651580 13184 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:16:19.589979 13308 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:16:19.742048 10667 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:19.743214 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.657327 10665 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:19.762723 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1639) took 1388 ms. Trace:
I20260709 13:16:19.771881 10667 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:19.772142 10666 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:16:19.764278 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 137901us
I20260709 13:16:19.756784 13207 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:19.770255 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 108840us
I20260709 13:16:19.757781 13209 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:19.761911 13261 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.764998 13314 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.771817 10664 rpcz_store.cc:276] 0709 13:16:18.374524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.633235 (+1258711us) service_pool.cc:224] Handling call
0709 13:16:19.635011 (+  1776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.635257 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:19.635910 (+   653us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.762330 (+126420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.762375 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.762424 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.762483 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.762675 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2386,"prepare.queue_time_us":202,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":2494,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1866,"thread_start_us":123168,"threads_started":1}
I20260709 13:16:19.799947 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.810009 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.810444 10734 raft_consensus.cc:2376] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3. Re-sending same reply.
I20260709 13:16:19.811013 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.811779 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.812278 10734 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:19.812791 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.766690 12809 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:19.802587 10665 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:19.803764 10667 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:19.766836 12980 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.775028 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1791) took 3444 ms. Trace:
I20260709 13:16:19.766582 12825 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.816301 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.813184 10734 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.767989 13310 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.818941 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.820832 10667 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.816186 10593 rpcz_store.cc:276] 0709 13:16:16.331013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.331135 (+   122us) service_pool.cc:224] Handling call
0709 13:16:16.331390 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.406563 (+1075173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.774829 (+2368266us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400298e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:19.774976 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471033600}
I20260709 13:16:19.768921 13196 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:19.822866 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.826980 10664 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:19.829015 10667 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:19.830525 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.831085 10741 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:19.833233 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.833825 10741 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:19.817863 12809 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.858054 10734 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:19.862442 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.863042 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.867993 10667 raft_consensus.cc:2376] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6. Re-sending same reply.
I20260709 13:16:19.868240 10664 raft_consensus.cc:2376] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9. Re-sending same reply.
I20260709 13:16:19.855011 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.822163 12980 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:19.867998 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.815619 13314 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:19.870510 10734 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:19.856385 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.871876 10741 raft_consensus.cc:2368] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5.
I20260709 13:16:19.872632 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.832746 12899 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.881723 13307 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:19.882957 13337 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:19.876081 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.879220 12980 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:19.879925 13330 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:19.887053 10741 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:19.887295 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1638) took 2588 ms. Trace:
I20260709 13:16:19.887254 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:19.884148 12730 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:19.888118 10743 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.888367 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:19.887892 10735 rpcz_store.cc:276] 0709 13:16:17.298502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.298923 (+   421us) service_pool.cc:224] Handling call
0709 13:16:17.328149 (+ 29226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.454476 (+126327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.887094 (+2432618us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b540036d3d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:19.887237 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171926272}
I20260709 13:16:19.893391 10666 raft_consensus.cc:2376] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6. Re-sending same reply.
I20260709 13:16:19.899628 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 334) took 3572 ms. Trace:
I20260709 13:16:19.900051 11412 rpcz_store.cc:276] 0709 13:16:16.327378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.327583 (+   205us) service_pool.cc:224] Handling call
0709 13:16:16.327982 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.594461 (+266479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.896668 (+3302207us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400571f54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:19.899523 (+  2855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332620672}
I20260709 13:16:19.902745 12809 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:19.903237 10735 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:19.907745 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.913381 13079 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:19.913889 13079 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:19.887656 13209 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.915980 13079 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:19.923524 13252 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:19.924360 13288 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.598s	user 0.011s	sys 0.004s
I20260709 13:16:19.926666 13314 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:19.929417 10593 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:19.930490 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:19.931850 10592 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:19.937721 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:19.944375 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:19.945906 10735 raft_consensus.cc:2410] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:19.947000 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1660) took 1879 ms. Trace:
I20260709 13:16:19.951002 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:19.951782 10586 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:19.862550 13196 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.947474 10736 rpcz_store.cc:276] 0709 13:16:18.067219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.067329 (+   110us) service_pool.cc:224] Handling call
0709 13:16:18.067617 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:18.085702 (+ 18085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.085732 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:18.098632 (+ 12900us) log.cc:844] Serialized 52 byte log entry
0709 13:16:18.271536 (+172904us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.271575 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.271643 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.923758 (+1652115us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:19.932938 (+  9180us) raft_consensus.cc:1685] finished
0709 13:16:19.932958 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.946944 (+ 13986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11160,"raft.queue_time_us":21500,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":1709,"spinlock_wait_cycles":20133120,"thread_start_us":138943,"threads_started":1,"wal-append.queue_time_us":197404}
I20260709 13:16:19.959369 10735 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:19.830442 13247 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:19.943372 13332 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:19.967659 13314 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:19.943470 13246 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:19.962273 13116 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:19.969545 13246 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:19.969890 13246 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:19.970615 13246 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:19.964088 12809 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:19.975193 12809 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:19.975628 12809 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:19.973927 13116 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:16:19.984856 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 110249us
I20260709 13:16:19.986274 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1630) took 1614 ms. Trace:
I20260709 13:16:19.989712 10668 rpcz_store.cc:276] 0709 13:16:18.372316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.486873 (+1114557us) service_pool.cc:224] Handling call
0709 13:16:19.487093 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.487263 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:19.578979 (+ 91716us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.845115 (+266136us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b180044b540. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:19.985852 (+140737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.985912 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.985983 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.986078 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.986204 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91543,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":5107,"raft.queue_time_us":584,"spinlock_wait_cycles":21142784,"thread_start_us":139819,"threads_started":1}
I20260709 13:16:19.957564 13253 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:19.995177 10664 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:20.006223 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.007052 10592 raft_consensus.cc:2368] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:20.034641 10743 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:19.976696 12809 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.058472 13055 raft_consensus.cc:476] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:19.964663 13332 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:19.975518 12921 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.064312 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:20.075259 13238 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:20.076084 13238 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.076841 13332 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:19.984057 13310 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.079193 13310 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:20.084695 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76721.2us
I20260709 13:16:20.086700 11412 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.087464 11409 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:20.088124 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:20.088723 11418 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:20.088722 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:20.092443 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:20.092931 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 152566us
I20260709 13:16:20.097124 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.111068 10588 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:20.111970 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.063921 12921 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.102159 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.104276 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:20.099006 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.159417 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:20.149542 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:20.284212 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:20.247371 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.343694 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 231247us
W20260709 13:16:20.407217 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.174036 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.234417 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:20.113168 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.113387 10588 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:20.406397 10668 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.296868 11416 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:20.406822 10667 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:20.417646 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:20.421893 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:20.099937 13185 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.427390 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:20.441359 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.441882 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.103636 12809 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.444447 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:20.482376 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.522581 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:20.523244 10588 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.299975 12825 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:20.526438 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 82134.9us
I20260709 13:16:20.168190 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:20.171468 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:20.297091 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:20.170338 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:20.495262 13342 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:20.107761 13216 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:20.168895 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:20.417183 13238 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.527719 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:20.526456 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.493481 13207 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.001s
I20260709 13:16:20.531213 10586 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:20.532058 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 419199us
I20260709 13:16:20.540604 10632 leader_election.cc:400] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9.
I20260709 13:16:20.546530 10668 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:20.492131 13343 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.528721 12259 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.444826 13185 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.560531 13332 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:20.531833 13217 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:16:20.561339 13238 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.647289 11411 raft_consensus.cc:2368] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:20.627964 10587 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.669519 10588 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:20.553174 13216 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.530444 13345 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:16:20.568217 13207 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.679929 13217 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.652721 12259 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.705433 13339 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.712433 13217 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:20.737807 13207 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.737697 13217 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.738155 13186 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.739557 13186 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:20.740887 10708 connection.cc:256] RPC call timeout handler was delayed by -1.6884429289998479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:16:20.741474 10708 connection.cc:256] RPC call timeout handler was delayed by -1.6281429289999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 13:16:20.742287 13185 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.742559 10668 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:20.742386 10708 leader_election.cc:336] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.905s (SENT)
I20260709 13:16:20.743144 10668 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:20.743877 10668 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.744773 10668 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.745280 13332 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:20.746086 13332 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.749468 13339 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.751530 13247 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:20.752213 13247 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.754231 12973 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:20.755308 13349 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:16:20.756525 13350 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:16:20.758230 13352 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:20.759855 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:20.761524 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:20.766300 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:20.767061 10736 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 3.
I20260709 13:16:20.768554 10736 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:20.650231 13343 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.780546 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:20.784794 10668 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:20.799764 10668 pending_rounds.cc:85] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 3
I20260709 13:16:20.800081 10668 pending_rounds.cc:107] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:20.800366 10668 raft_consensus.cc:2889] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.788628 10737 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:20.682515 13238 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:20.814857 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48673.7us
W20260709 13:16:20.815948 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.844249 13042 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.812671 13242 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:20.796516 13351 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:16:20.858747 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 173654us
W20260709 13:16:20.860596 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118285us
I20260709 13:16:20.854332 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.856504 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:20.812855 13344 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:16:20.861431 10708 connection.cc:256] RPC call timeout handler was delayed by -1.5723429289998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:16:20.861590 10665 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:20.863024 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.854123 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:20.862679 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:20.814829 13191 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.856024 13217 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:20.875259 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.883162 10708 connection.cc:256] RPC call timeout handler was delayed by -1.5660429289998774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:16:20.874300 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.874908 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:20.889134 10664 raft_consensus.cc:2376] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6. Re-sending same reply.
I20260709 13:16:20.876430 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:20.879762 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:20.864962 10668 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:20.890995 11381 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:20.891770 10708 connection.cc:256] RPC call timeout handler was delayed by -1.5651429289998759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:16:20.893108 10708 connection.cc:256] RPC call timeout handler was delayed by -1.4112429289998545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2352s for a response
W20260709 13:16:20.893746 10708 connection.cc:256] RPC call timeout handler was delayed by -1.1763429289999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26130000000000003s for a response
W20260709 13:16:20.894081 10708 connection.cc:256] RPC call timeout handler was delayed by -1.1306854389999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 13:16:20.894353 13269 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.894766 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:20.895251 13238 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.882957 10667 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:20.896185 13216 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.868453 12973 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:16:20.894371 10708 connection.cc:256] RPC call timeout handler was delayed by -1.1090854389999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:16:20.901054 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.902590 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.902899 13247 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:20.904716 13355 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:16:20.905135 13238 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.905673 13238 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:20.907614 13238 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.897308 13042 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.908638 13209 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.908094 13238 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:20.909097 13332 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.909119 13209 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.909956 13042 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.910012 13209 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.910727 13042 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:20.911659 13042 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.912226 13343 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.903409 13221 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:20.912834 13221 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:20.913089 12825 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.913223 13221 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.890560 13191 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.889837 13338 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.915551 13191 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.909487 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1690) took 1026 ms. Trace:
I20260709 13:16:20.916306 10741 rpcz_store.cc:276] 0709 13:16:19.883041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.897644 (+ 14603us) service_pool.cc:224] Handling call
0709 13:16:19.897874 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.084569 (+186695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.084599 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.085077 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.148858 (+ 63781us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:20.148891 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.148956 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.909191 (+760235us) raft_consensus.cc:1685] finished
0709 13:16:20.909215 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.909419 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42843,"raft.queue_time_us":45465,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3994,"thread_start_us":206884,"threads_started":2,"wal-append.queue_time_us":291821}
I20260709 13:16:20.904052 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.897343 12730 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.920816 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 352546us
I20260709 13:16:20.920548 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:20.922827 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.908208 13309 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.925594 10590 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:20.910645 12259 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.930531 13346 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.934497 10632 leader_election.cc:400] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:20.936563 10632 leader_election.cc:403] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.917914 13242 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.938748 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.939745 13332 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.940120 13332 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:20.940454 13332 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.942662 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:20.945304 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.945917 10592 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:20.946480 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.919391 13357 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.945773 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.957942 10587 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:20.960224 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:20.941627 13242 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:20.942186 13343 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.938602 13346 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:20.941720 13338 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:20.965654 10635 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.548s (SENT)
W20260709 13:16:20.985183 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.985251 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:20.966274 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:20.988138 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 94009.2us
I20260709 13:16:20.949353 13360 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:20.936105 12730 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:20.961426 13357 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.012600 13357 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:20.972189 13242 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.949373 13361 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:21.015383 13367 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:21.021556 13370 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.022063 13370 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:20.965464 13247 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:21.024526 13247 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:21.026276 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.996903 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.002223 10635 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.571s (SENT)
I20260709 13:16:20.941512 13309 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.004549 13338 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.009603 13343 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.010248 13366 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:20.980831 13346 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.043545 13343 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.044145 13366 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:21.045727 13366 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.026960 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.008675 13209 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.027331 13247 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.030334 13261 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.033255 13242 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.027782 13360 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.042083 12730 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:21.064148 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62058.3us
W20260709 13:16:21.047737 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45576.3us
W20260709 13:16:21.082113 10635 leader_election.cc:336] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.603s (SENT)
I20260709 13:16:21.082898 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.065580 13081 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:21.085939 10635 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.638s (SENT)
W20260709 13:16:21.070902 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 123010us
W20260709 13:16:21.089572 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126553us
I20260709 13:16:21.089128 12730 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:21.091634 10740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 263) took 2972 ms (client timeout 1768 ms). Trace:
W20260709 13:16:21.092119 10740 rpcz_store.cc:269] 0709 13:16:18.119622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.147711 (+ 28089us) service_pool.cc:224] Handling call
0709 13:16:21.091360 (+2943649us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54002bfa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:21.091516 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946129664}
I20260709 13:16:21.090294 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.070446 13370 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.070595 13310 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.093278 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:21.101665 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.043059 13332 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.123445 10740 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:21.099144 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.122529 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:21.046518 13366 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.070469 13191 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:21.065651 13343 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.128952 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.130507 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.135007 11415 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:21.130764 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.136173 10585 raft_consensus.cc:2410] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:16:21.134408 10635 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.741s (SENT) [suppressed 44 similar messages]
I20260709 13:16:21.137437 10740 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:21.122720 13081 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.087525 12825 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:21.139140 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.139839 10632 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:21.138657 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58246.2us
I20260709 13:16:21.122191 13217 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.078132 13261 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.123304 13221 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.138818 13106 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:21.131474 13361 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.142438 13081 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.124341 13137 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:21.124713 13310 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.126935 13207 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.141762 13277 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.134218 13367 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:21.143261 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44193us
I20260709 13:16:21.184397 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.143543 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.151029 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.186688 10740 raft_consensus.cc:2410] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:21.151913 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.187565 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.188122 10740 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.176679 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.188970 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.152853 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.190119 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.163079 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.191007 10740 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:21.153792 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.192497 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.192646 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.193050 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.194088 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.188122 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.195166 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.196818 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:21.195281 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.198485 10741 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:21.199430 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.199617 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.200333 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.201107 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1317) took 1195 ms. Trace:
I20260709 13:16:21.201448 10591 rpcz_store.cc:276] 0709 13:16:20.006132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.041959 (+ 35827us) service_pool.cc:224] Handling call
0709 13:16:21.199330 (+1157371us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194eee 0000000000375939 00007f425c2081e0 00007f425c2d10c4 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:21.201055 (+  1725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115154432}
I20260709 13:16:21.202375 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.202715 10591 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.202591 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.203150 10588 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.203943 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.204916 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.200524 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.205976 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:21.206404 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.206799 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.151585 13137 consensus_queue.cc:1243] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:21.208417 10588 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:21.208657 10592 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:21.209177 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.209357 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.212708 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.213130 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.213944 10588 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:21.195230 12730 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.207177 13217 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.174242 13367 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.185400 13366 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.222812 10559 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.177886 13343 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:21.224020 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.149091 13221 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.151281 13081 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.163489 13209 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.147564 13242 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.162829 13310 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.227866 11415 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:21.244915 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.147096 13261 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.145720 13332 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.223241 10587 raft_consensus.cc:2368] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
W20260709 13:16:21.230499 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46214.1us
W20260709 13:16:21.217204 13336 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.401s	user 0.002s	sys 0.000s
I20260709 13:16:21.233356 10741 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.226547 13137 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:21.199313 13191 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:21.142732 13369 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.206090 13216 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:21.257791 13216 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.258244 13216 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.262866 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1929) took 2195 ms. Trace:
I20260709 13:16:21.263230 10663 rpcz_store.cc:276] 0709 13:16:19.067711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.745674 (+677963us) service_pool.cc:224] Handling call
0709 13:16:19.746039 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.746448 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.746486 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.746988 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.805575 (+ 58587us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.805896 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.806092 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.806159 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.216529 (+1410370us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:21.262598 (+ 46069us) raft_consensus.cc:1685] finished
0709 13:16:21.262696 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.262814 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":180,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":198,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":2539,"spinlock_wait_cycles":23561472,"thread_start_us":39373,"threads_started":1,"wal-append.queue_time_us":47503}
I20260709 13:16:21.268436 13247 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.232017 13346 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.233908 13251 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:16:21.271425 13346 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.146763 13360 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.162248 13377 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:16:21.223451 13338 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.162699 12806 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:16:21.163736 13207 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.227391 13277 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.251556 10708 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.237224 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.286321 11416 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:21.229573 13367 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.254910 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.255245 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.229374 13370 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:21.148339 13361 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.256161 13369 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.234918 12825 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.255776 10591 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.274626 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.241711 13362 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.254573 13137 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:21.299892 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.307883 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.291620 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1659) took 3224 ms. Trace:
I20260709 13:16:21.287086 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.298969 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.310210 10592 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11. Re-sending same reply.
I20260709 13:16:21.299351 10665 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.312127 10661 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11. Re-sending same reply.
W20260709 13:16:21.288707 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 82787.7us
I20260709 13:16:21.310873 10664 raft_consensus.cc:2376] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5. Re-sending same reply.
I20260709 13:16:21.288960 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.313714 13370 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.314981 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.315541 10592 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:21.307554 13055 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.316207 13055 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.313592 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:21.282858 13191 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:21.318109 13055 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.318601 13055 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.318269 13191 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.319370 13277 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.320500 13361 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.294047 13188 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.321308 13277 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:21.323110 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.323328 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.324237 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.324479 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.310817 10738 rpcz_store.cc:276] 0709 13:16:18.066962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.069817 (+  2855us) service_pool.cc:224] Handling call
0709 13:16:18.070068 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.122380 (+ 52312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.122399 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.122898 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.045910 (+2923012us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800383ec0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:21.126529 (+ 80619us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:21.126614 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.126739 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.291283 (+164544us) raft_consensus.cc:1685] finished
0709 13:16:21.291309 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.291550 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39151,"raft.queue_time_us":57954,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":24494,"spinlock_wait_cycles":9557248,"thread_start_us":80446,"threads_started":1,"wal-append.queue_time_us":3109107}
I20260709 13:16:21.325460 10741 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.329200 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.321777 13369 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.330783 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.332104 10741 raft_consensus.cc:2368] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 6.
I20260709 13:16:21.332695 10591 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.332976 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.327831 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.338665 13383 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:21.339804 13247 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.338882 13255 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.341904 10741 raft_consensus.cc:2393] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:21.342418 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 87220.4us
I20260709 13:16:21.342968 13377 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:21.284366 13221 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:16:21.322454 13137 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.359321 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.345513 10708 leader_election.cc:400] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 3 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4.
I20260709 13:16:21.359898 10663 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:21.346020 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.361177 10708 leader_election.cc:400] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:16:21.289529 13217 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.361631 10708 leader_election.cc:403] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.290540 13346 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.344969 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.344525 13277 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:21.365579 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.289583 13310 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:16:21.381958 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.383651 10737 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: [2.4-5.5]
I20260709 13:16:21.368587 13209 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 5.
I20260709 13:16:21.387449 13138 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.387790 13367 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.388247 13138 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:21.388754 13138 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.389514 13221 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.389887 13221 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.390046 10735 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.390684 13138 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.390865 13367 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.391115 10735 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.391791 10740 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.392021 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.393689 10740 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.396441 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:21.379081 11410 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:21.379231 13216 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.357674 12825 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:21.380761 13252 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.393201 10735 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.397270 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.405194 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:21.390731 13221 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.408864 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.412909 13216 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.413666 13248 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.405508 10663 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11. Re-sending same reply.
I20260709 13:16:21.415874 10737 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:21.406031 13346 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.419654 13221 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.419763 13374 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:21.421536 13176 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:21.422801 13176 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.423242 13176 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.424301 13176 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.428752 13176 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.427222 10742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1673) took 1965 ms (client timeout 2123 ms). Trace:
W20260709 13:16:21.429499 10742 rpcz_store.cc:269] 0709 13:16:19.462115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.477133 (+ 15018us) service_pool.cc:224] Handling call
0709 13:16:21.427004 (+1949871us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b540028df54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:21.427142 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185902336}
I20260709 13:16:21.432163 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1923) took 2366 ms. Trace:
I20260709 13:16:21.432523 10660 rpcz_store.cc:276] 0709 13:16:19.065947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.476593 (+410646us) service_pool.cc:224] Handling call
0709 13:16:21.431988 (+1955395us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b5400320d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:21.432110 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156743424}
W20260709 13:16:21.437628 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.441653 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.442548 10742 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.448307 13374 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:21.448835 13374 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.449955 13374 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.450960 13207 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:21.451709 13374 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.453486 10666 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:21.454319 13190 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.454986 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 235) took 1505 ms. Trace:
I20260709 13:16:21.455320 10666 rpcz_store.cc:276] 0709 13:16:19.949910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.950281 (+   371us) service_pool.cc:224] Handling call
0709 13:16:21.453245 (+1502964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.453869 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.454810 (+   941us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400320d50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:21.454930 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3455833856}
I20260709 13:16:21.456631 10708 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 6.
I20260709 13:16:21.457408 10708 leader_election.cc:403] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.463044 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.465047 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.468657 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.469805 10742 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:21.413889 13369 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.475442 10737 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:21.482468 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.456734 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 415) took 2132 ms. Trace:
I20260709 13:16:21.485409 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.486200 10742 raft_consensus.cc:2376] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7. Re-sending same reply.
I20260709 13:16:21.406160 13137 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.417848 13251 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:16:21.473265 13246 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.472620 13346 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 4. Current term is 6.
W20260709 13:16:21.497196 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.489070 13338 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:21.527951 13366 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:21.532622 13348 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.050s	user 0.000s	sys 0.002s
W20260709 13:16:21.534541 13359 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.603s	user 0.000s	sys 0.001s
I20260709 13:16:21.535246 13369 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.529526 13366 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.539080 13338 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.545570 13309 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.546887 13370 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.546748 13366 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.547969 13366 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.550186 13339 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.586733 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:21.589753 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 359109us
I20260709 13:16:21.592227 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:21.596760 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.600338 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:21.602483 10667 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:21.602727 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 146082us
I20260709 13:16:21.603471 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1258) took 1953 ms. Trace:
I20260709 13:16:21.604285 10734 rpcz_store.cc:276] 0709 13:16:19.649304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.886074 (+236770us) service_pool.cc:224] Handling call
0709 13:16:19.886466 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.947621 (+ 61155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.947650 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.948095 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.094981 (+146886us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:20.095034 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.095123 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.531927 (+1436804us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:21.602598 (+ 70671us) raft_consensus.cc:1685] finished
0709 13:16:21.602650 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.603153 (+   503us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60807,"raft.queue_time_us":77581,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":2961,"spinlock_wait_cycles":72604928,"thread_start_us":116497,"threads_started":1,"wal-append.queue_time_us":320444}
I20260709 13:16:21.609700 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.610743 10737 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:21.611299 10734 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:21.612246 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.612602 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.613757 10734 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:21.615855 10738 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.493458 12825 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:21.625923 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.626437 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.485502 11410 rpcz_store.cc:276] 0709 13:16:19.324065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.326765 (+  2700us) service_pool.cc:224] Handling call
0709 13:16:21.378604 (+2051839us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194e9c 00007f4254194a5b 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:21.378774 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.406577 (+ 27803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.418213 (+ 11636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13232512}
I20260709 13:16:21.627790 10666 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:21.640456 13216 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.642127 13216 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.644258 12850 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.645345 12899 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:21.661401 13079 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:21.663478 13137 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.666154 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.667120 10592 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.672222 12899 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:21.646222 12850 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.673174 12899 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.678236 13216 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:21.678457 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 86519.7us
I20260709 13:16:21.673846 12809 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.684993 10589 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:21.686010 13086 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.685885 12809 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.686653 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.686630 13086 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:21.687772 10594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1315) took 1682 ms (client timeout 2021 ms). Trace:
W20260709 13:16:21.688271 10594 rpcz_store.cc:269] 0709 13:16:20.005521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.006432 (+   911us) service_pool.cc:224] Handling call
0709 13:16:21.686259 (+1679827us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:21.687665 (+  1406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15806720}
I20260709 13:16:21.689237 13367 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.689750 13367 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.690227 13367 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.698886 10737 raft_consensus.cc:1240] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.686915 13369 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.708556 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.712302 10590 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:21.716450 10739 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1247) took 2068 ms (client timeout 1548 ms). Trace:
W20260709 13:16:21.716969 10739 rpcz_store.cc:269] 0709 13:16:19.647491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.647722 (+   231us) service_pool.cc:224] Handling call
0709 13:16:21.715959 (+2068237us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54001ccd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:21.716227 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521002368}
I20260709 13:16:21.723255 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.676681 12850 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.727532 12849 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:21.728046 12849 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.731972 13086 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:21.734330 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.736068 13329 consensus_queue.cc:1059] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:21.748199 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:21.749028 10740 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.748980 12849 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.754266 13042 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.753726 13247 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.758255 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:21.759219 10586 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.763470 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.763917 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.765442 10587 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.767884 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:21.771080 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 138150us
I20260709 13:16:21.739010 13329 raft_consensus.cc:3055] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.770540 10585 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:21.773900 13329 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.773988 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.781124 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.782095 11409 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:21.782277 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:21.783273 10737 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:21.780926 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.798058 11415 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:21.800644 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:21.775462 13329 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.856828 12973 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:21.865164 10740 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:21.878546 13243 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.878959 13381 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:21.879302 13243 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:21.879976 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 167846us
I20260709 13:16:21.882632 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.883388 11412 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:21.887058 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:21.887964 11411 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.889619 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.890460 10666 raft_consensus.cc:2368] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:16:21.896545 10592 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:21.897161 13042 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.904395 13243 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:21.898052 13042 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.911154 13329 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.897248 13369 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.912631 13042 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.912292 13369 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.902516 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:21.915040 13369 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.899718 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.915609 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.916316 10665 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:21.904488 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 194432us
I20260709 13:16:21.918092 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.918805 11417 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:21.920421 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.921241 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.921810 13184 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:21.924932 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.921339 13381 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:21.926322 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.926656 13198 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:21.927680 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.928525 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:21.928714 12850 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.929105 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:21.929873 10593 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:21.898851 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1704) took 1912 ms. Trace:
I20260709 13:16:21.930651 11414 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:21.931869 10587 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.930583 10743 rpcz_store.cc:276] 0709 13:16:19.986222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.173634 (+187412us) service_pool.cc:224] Handling call
0709 13:16:20.302567 (+128933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.408807 (+106240us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:20.492689 (+ 83882us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.431491 (+938802us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18002ccce0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:21.750408 (+318917us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.752487 (+  2079us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.753016 (+   529us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:21.753149 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.754160 (+  1011us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.898071 (+143911us) raft_consensus.cc:1685] finished
0709 13:16:21.898249 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.898579 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51162,"prepare.queue_time_us":115448,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":326,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":50499,"spinlock_wait_cycles":4092288,"thread_start_us":317869,"threads_started":1,"wal-append.queue_time_us":1260089}
I20260709 13:16:21.933916 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:21.934713 10587 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:21.936744 10587 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:21.897270 12973 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:21.942772 12973 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.901588 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:21.944850 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.878629 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.938732 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.937929 13369 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:21.945996 10665 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.946615 12809 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.946281 13369 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.940707 10666 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.948184 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.948359 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:21.948947 13369 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:21.941473 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:21.904433 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.903391 10590 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:21.949473 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.950495 13198 raft_consensus.cc:2764] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:21.951164 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.951179 10591 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.952121 10666 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:21.952939 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.953190 10590 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:16:21.949782 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69025.5us
I20260709 13:16:21.953804 10663 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:21.954537 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:21.898072 12899 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.943024 12850 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:21.944276 10660 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:21.958168 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.954622 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:21.961691 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.949534 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:21.963454 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.964109 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.964382 10664 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:21.964706 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:21.965341 10660 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:21.962427 10662 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:21.966367 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.968252 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:21.976626 13188 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:21.986635 13188 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:21.986454 13367 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.983024 13055 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.975169 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:21.987764 10665 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:21.989379 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:21.990470 13055 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:21.988863 10663 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:21.992125 10490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 114) took 19826 ms (client timeout 15000 ms). Trace:
I20260709 13:16:21.987797 13188 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:21.992187 12809 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:21.969808 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:21.995381 13055 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:20.515710  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.997910 13374 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:21.998553 13374 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.999711 13374 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:21.993553 10490 rpcz_store.cc:269] 0709 13:16:02.173668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.220779 (+ 47111us) service_pool.cc:224] Handling call
0709 13:16:02.909709 (+688930us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:16:21.991880 (+19082171us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:12.836804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:12.837474 (+   670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:12.837527 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:12.837553 (+    26us) tablet.cc:662] Decoding operations
0709 13:16:12.838450 (+   897us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:12.838531 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:12.838560 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:12.839261 (+   701us) tablet.cc:701] Row locks acquired
0709 13:16:12.839314 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:16:12.839479 (+   165us) write_op.cc:270] Start()
0709 13:16:12.839628 (+   149us) write_op.cc:276] Timestamp: P: 1783602972839420 usec, L: 0
0709 13:16:12.839651 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:12.890531 (+ 50880us) log.cc:844] Serialized 2793 byte log entry
0709 13:16:13.833598 (+943067us) op_driver.cc:464] REPLICATION: finished
0709 13:16:14.350940 (+517342us) write_op.cc:301] APPLY: starting
0709 13:16:14.351035 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:14.351282 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:14.351400 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:14.352234 (+   834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:14.352430 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:16:14.352478 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:14.352715 (+   237us) log.cc:844] Serialized 59 byte log entry
0709 13:16:14.352873 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.352989 (+   116us) write_op.cc:454] Released schema lock
0709 13:16:14.353037 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:14.369575 (+ 16538us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.374873 (+  5298us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":642420,"reported_tablets":20,"spinlock_wait_cycles":503632640,"child_traces":[["op",{"apply.queue_time_us":499799,"apply.run_cpu_time_us":2425,"apply.run_wall_time_us":2425,"num_ops":7,"prepare.queue_time_us":399916,"prepare.run_cpu_time_us":54322,"prepare.run_wall_time_us":397135,"raft.queue_time_us":310142,"raft.run_cpu_time_us":65142,"raft.run_wall_time_us":291730,"replication_time_us":947602,"thread_start_us":994946,"threads_started":4,"wal-append.queue_time_us":427158,"wal-append.run_cpu_time_us":21338,"wal-append.run_wall_time_us":2030975}]]}
I20260709 13:16:22.000661 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:22.001674 13176 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:22.002957 13322 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:22.003360 13322 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:21.998116 13188 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.004189 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:22.004968 10667 raft_consensus.cc:2368] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:22.005299 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:22.006502 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 52075.8us
I20260709 13:16:22.007148 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:22.010878 13400 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 13:16:22.026022 10667 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:22.028874 10560 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.029500 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.030694 13198 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.031370 13198 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:22.031924 13370 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.032241 13367 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.032974 13367 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.032483 13198 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.033239 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.033591 13367 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.037479 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.038182 13055 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.038477 13370 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.038887 13370 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.038821 13055 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.039332 13370 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.041075 13055 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.042713 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.027176 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:22.043505 13176 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:22.047108 13257 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:22.047600 13257 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:22.049713 10663 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:22.048813 13257 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.051019 13257 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.037724 10664 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:22.042887 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.056437 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:22.032343 13246 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.005s
I20260709 13:16:22.061837 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.059623 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:22.050220 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.069868 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.069051 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.071563 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:22.106599 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.104171 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 141942us
I20260709 13:16:22.060810 11416 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:22.147081 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76033.9us
I20260709 13:16:22.148057 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.103896 13367 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:22.159289 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 197933us
I20260709 13:16:22.071861 12809 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:16:22.163791 13366 consensus_meta.cc:287] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.000s
I20260709 13:16:22.071617 13220 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:16:22.166257 13366 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.171380 13116 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.171778 12825 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.171948 13116 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.172389 12825 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.172538 13116 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.172909 12825 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.178225 13236 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.164656 13042 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.161674 13055 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:22.182248 13055 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.182686 13055 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.204929 11415 raft_consensus.cc:2410] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:22.167332 10736 raft_consensus.cc:2410] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:16:22.168547 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 52665.1us
I20260709 13:16:22.222175 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:22.231676 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 181611us
I20260709 13:16:22.261503 10632 leader_election.cc:400] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:22.233676 13116 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.267748 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.273351 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.241381 13055 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.289779 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.286634 13042 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:22.297652 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 61610.5us
I20260709 13:16:22.298503 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.300454 13367 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.303442 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.305263 13370 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.307408 13370 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.309046 13116 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.309348 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.301539 12973 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:22.314658 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.319641 13246 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.320202 13246 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.322399 13246 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:22.322566 11416 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
W20260709 13:16:22.330241 13407 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:22.331187 13246 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.331740 13246 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.335094 11416 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:22.336771 13313 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.337415 13313 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.338923 11411 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:22.340112 13313 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:22.342511 10706 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:22.344442 13246 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:22.346222 13345 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.348212 13345 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.349143 13246 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.349534 13246 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:22.350575 13246 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.352203 13313 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:22.354182 13313 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.296968 13042 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:22.361886 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 72226.3us
I20260709 13:16:22.359309 13243 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:22.375574 13055 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.377730 13243 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:22.378227 13243 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:22.379360 13243 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.380863 13243 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.364090 13042 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:22.385697 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 342873us
I20260709 13:16:22.313165 12825 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.388190 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.402352 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.402185 11379 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:22.414243 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 114222us
W20260709 13:16:22.417251 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 241) took 2331 ms (client timeout 2871 ms). Trace:
W20260709 13:16:22.430042 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.427322 10593 rpcz_store.cc:269] 0709 13:16:20.083505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.083619 (+   114us) service_pool.cc:224] Handling call
0709 13:16:21.685111 (+1601492us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:22.409667 (+724556us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400298e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:22.414422 (+  4755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492258944}
I20260709 13:16:22.409266 13247 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.431133 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.426739 13374 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.443243 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.451483 13247 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.452840 11414 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:22.454469 12849 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.458273 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:22.458401 12825 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:22.460480 13414 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.446350 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.444566 13257 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:16:22.472064 10589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1805) took 4762 ms (client timeout 2260 ms). Trace:
I20260709 13:16:22.472314 10592 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:22.472488 10589 rpcz_store.cc:269] 0709 13:16:17.709620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.709800 (+   180us) service_pool.cc:224] Handling call
0709 13:16:22.471830 (+4762030us) spinlock_profiling.cc:243] Waited 3.96 s on lock 0x7b5400299854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:22.471956 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9099372928}
I20260709 13:16:22.474004 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.474576 10668 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:22.441952 13367 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:22.474829 13247 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.494990 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.497735 10668 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:22.499065 13423 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.498912 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.500249 10668 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:22.491757 13370 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:22.502979 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.499509 13422 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:22.504572 13367 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.505558 13422 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.506240 13422 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:22.507387 13422 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.499020 13421 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.512684 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:22.514860 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56661.6us
I20260709 13:16:22.515514 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:22.518755 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 86082us
I20260709 13:16:22.509509 13370 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:22.524627 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 215411us
I20260709 13:16:22.524307 13370 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.525345 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:22.531180 10559 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 4 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.532884 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.534098 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.534909 13186 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.534857 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.535451 13186 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.535650 11416 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.535918 13322 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.537346 13322 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.537177 13042 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.537673 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:22.538282 11412 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.539494 13042 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:22.542030 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 111000us
I20260709 13:16:22.544239 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:22.540619 13419 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:22.535874 13186 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.548508 13246 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.548899 13374 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:22.551335 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.553653 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:22.496821 13414 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.558379 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.560258 13414 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:22.560614 10667 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:22.518376 13423 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.563686 13423 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.565100 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.566215 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:22.566321 10660 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:22.566742 10668 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.560922 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.570858 11416 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:22.498330 13247 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.566329 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.578416 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:22.524835 13369 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.586607 13369 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.593863 12850 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.594138 11412 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:22.594384 12850 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:22.595247 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:22.595315 12850 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.596275 13076 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:22.596741 13076 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:22.597573 13076 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.526144 12825 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:22.610864 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 89262.1us
I20260709 13:16:22.620085 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.622074 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:22.622609 10594 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.625741 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:22.628505 10588 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:22.629110 10706 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.606536 12825 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.646463 13362 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.648425 13078 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:16:22.649485 13428 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.650125 13428 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:22.651211 13428 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.648675 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.658357 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:22.658738 13247 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:22.659472 13247 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:22.659441 13313 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:22.660143 13247 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:22.663270 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:22.628790 13423 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:22.645211 12825 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.649497 13078 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.676908 13078 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:22.672926 13374 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:22.672744 11409 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:22.671252 13423 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.677079 13243 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:22.695120 13429 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:22.721369 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.728787 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 104657us
I20260709 13:16:22.731196 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:22.733717 13367 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.734200 13367 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.735059 10588 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:22.736159 13367 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.736312 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:22.737641 10632 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:22.737852 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.738418 13367 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.739125 13367 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:22.740082 13367 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.739565 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:22.742338 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:22.675660 13042 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:16:22.745146 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 201021us
I20260709 13:16:22.691970 13374 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.705881 13423 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.705123 11409 pending_rounds.cc:85] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 4
I20260709 13:16:22.764374 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:22.768085 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 109800us
I20260709 13:16:22.681732 13186 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.780974 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.747044 13429 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:22.786731 13370 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.788373 13313 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:22.763969 13078 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:22.791096 13433 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:16:22.791421 13426 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.792011 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:22.793005 11416 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:22.793212 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.770529 13374 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.821152 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:22.822043 13078 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.824199 10669 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:22.825788 13425 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:16:22.830032 13370 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:22.830541 10585 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:22.830683 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:22.831354 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.886998 10588 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:22.833491 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:22.835708 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 274) took 1977 ms. Trace:
I20260709 13:16:22.842592 13345 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.769932 11409 pending_rounds.cc:107] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:16:22.849601 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.897711 10589 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:22.851500 13246 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.865818 10741 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.890173 10736 rpcz_store.cc:276] 0709 13:16:20.858325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.894545 (+ 36220us) service_pool.cc:224] Handling call
0709 13:16:22.835496 (+1940951us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540032fd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:22.835654 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700046720}
I20260709 13:16:22.817987 13313 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:22.906781 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:22.900009 10594 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:22.862557 13419 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:22.909821 10591 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:22.885620 13042 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:22.914541 10742 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:22.919696 13441 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.919606 13429 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:22.923318 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 73847.9us
I20260709 13:16:22.924055 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.902267 11409 raft_consensus.cc:2917] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:16:22.930511 11412 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:22.935932 13421 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:22.940248 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.937366 13186 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:22.945523 13421 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.939836 13440 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.946735 13442 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:22.952668 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:22.897990 13247 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.902765 13345 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.933179 11411 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:22.915230 12850 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:22.932154 13441 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:22.962080 13442 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:22.937760 13403 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.835s	user 0.004s	sys 0.000s
I20260709 13:16:22.958040 13419 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:22.934199 11409 raft_consensus.cc:2889] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.969899 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:22.970582 10663 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.932268 13246 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:22.960999 13345 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:22.965488 13442 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:23.021627 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.056154 13436 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:23.120913 13403 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:22.935360 13042 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:23.177203 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 243189us
I20260709 13:16:23.171082 13429 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.188824 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 427) took 1237 ms. Trace:
I20260709 13:16:23.189715 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:23.170694 13370 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:23.201714 13370 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.185297 13429 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.122195 13313 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:23.259056 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.09582e+06us
W20260709 13:16:23.262148 13439 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:16:23.226322 13436 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.293069 13436 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.295281 13436 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:23.296406 13436 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.171082 13440 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.298765 13440 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:23.278448 13322 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.299512 13322 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:23.302955 11410 consensus_meta.cc:287] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.000s
I20260709 13:16:23.303347 11410 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:23.305904 10592 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:23.288278 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1675) took 1246 ms. Trace:
I20260709 13:16:23.289219 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1682) took 1054 ms. Trace:
I20260709 13:16:23.289997 13421 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:23.292520 13313 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:23.329157 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.313560 10664 rpcz_store.cc:276] 0709 13:16:22.234666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.701881 (+467215us) service_pool.cc:224] Handling call
0709 13:16:22.702350 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.723574 (+ 21224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.723609 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.853779 (+130170us) log.cc:844] Serialized 548 byte log entry
0709 13:16:23.212857 (+359078us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:23.212904 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.212989 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.289031 (+ 76042us) raft_consensus.cc:1685] finished
0709 13:16:23.289050 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.289168 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":299087,"threads_started":1,"wal-append.queue_time_us":374684}
I20260709 13:16:23.346891 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1694) took 1027 ms. Trace:
I20260709 13:16:23.347324 10664 rpcz_store.cc:276] 0709 13:16:22.319402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.345881 (+1026479us) service_pool.cc:224] Handling call
0709 13:16:23.346236 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.346458 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.346493 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.346564 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:23.346613 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.346679 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.346812 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.277599 12850 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:16:23.360877 13246 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:23.362341 13374 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.189380 11413 rpcz_store.cc:276] 0709 13:16:21.703091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.733789 (+ 30698us) service_pool.cc:224] Handling call
0709 13:16:22.519540 (+785751us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:22.551154 (+ 31614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.551470 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:22.551750 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.902756 (+351006us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.915630 (+ 12874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.925509 (+  9879us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:22.927392 (+  1883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.931830 (+  4438us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.940532 (+  8702us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3673,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":7165,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":13294,"spinlock_wait_cycles":28668800,"thread_start_us":303654,"threads_started":2,"wal-append.queue_time_us":98842}
I20260709 13:16:23.367417 13374 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:23.313501 10667 rpcz_store.cc:276] 0709 13:16:22.041403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.564181 (+522778us) service_pool.cc:224] Handling call
0709 13:16:22.564481 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:22.631769 (+ 67288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.631801 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:22.647633 (+ 15832us) log.cc:844] Serialized 52 byte log entry
0709 13:16:22.863589 (+215956us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.863629 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.863690 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.287909 (+424219us) raft_consensus.cc:1685] finished
0709 13:16:23.287939 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.288166 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64143,"raft.queue_time_us":97510,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7975,"thread_start_us":215532,"threads_started":1,"wal-append.queue_time_us":538495}
W20260709 13:16:23.375950 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46083.1us
W20260709 13:16:23.378268 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 70819.9us
W20260709 13:16:23.256745 12825 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.000s
I20260709 13:16:23.383154 10667 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:23.379475 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:23.388343 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:23.390763 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:23.403236 10668 consensus_meta.cc:287] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.000s
I20260709 13:16:23.403770 10668 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:23.411947 10663 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:23.002106 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 60871.2us
I20260709 13:16:23.425427 13429 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:23.444043 10667 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:23.445200 10741 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 13:16:23.452602 10664 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:23.456929 10741 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:23.462560 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:23.463224 10594 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:23.433308 13076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.013s
W20260709 13:16:23.433383 13428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.017s
I20260709 13:16:23.470791 10667 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:23.401872 13374 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:23.471844 10664 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:23.421234 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.390234 12825 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.479168 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:23.479316 10668 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:23.471132 13076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.013s
I20260709 13:16:23.488277 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:23.487979 13309 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:23.458894 13246 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:23.472345 13428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.018s
I20260709 13:16:23.489545 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:23.523780 10739 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.477352 13362 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.473646 13440 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:23.506562 10741 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:23.507448 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:23.507109 13246 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.507725 13444 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:23.483398 13374 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:23.514117 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:23.533044 10738 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:23.515466 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.518388 13369 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:23.520651 13313 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:23.521189 13442 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:23.477982 13423 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
I20260709 13:16:23.482715 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:23.522841 10740 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:23.668673 10740 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:23.525058 10742 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.525964 10594 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:23.526918 10587 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:16:23.541450 10662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.066s	sys 0.126s
I20260709 13:16:23.545341 13441 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:23.545806 13429 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:23.670953 10662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.066s	sys 0.126s
I20260709 13:16:23.672672 11413 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:23.675983 11415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 358) took 1607 ms (client timeout 1607 ms). Trace:
W20260709 13:16:23.687959 11415 rpcz_store.cc:269] 0709 13:16:22.069069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.069259 (+   190us) service_pool.cc:224] Handling call
0709 13:16:23.675719 (+1606460us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400518bd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:23.675889 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308163456}
I20260709 13:16:23.693687 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:23.705000 10593 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:23.712558 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 522956us
I20260709 13:16:23.716185 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:23.717218 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:23.545228 13322 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:23.767807 13459 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:23.678188 13419 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:23.800518 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:23.715711 13421 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.532327 13362 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.793188 10740 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:23.807688 10665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.008s	sys 0.020s
I20260709 13:16:23.546643 13440 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:23.821307 10665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.020s
I20260709 13:16:23.672408 13423 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.840312 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1679) took 1603 ms. Trace:
W20260709 13:16:23.840760 10634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.052s	sys 0.139s
W20260709 13:16:23.841421 10634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.053s	sys 0.139s
I20260709 13:16:23.842060 13362 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:23.840706 10665 rpcz_store.cc:276] 0709 13:16:22.218544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.567091 (+348547us) service_pool.cc:224] Handling call
0709 13:16:22.608721 (+ 41630us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:22.662422 (+ 53701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.662451 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:22.671710 (+  9259us) log.cc:844] Serialized 52 byte log entry
0709 13:16:23.007726 (+336016us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:23.154346 (+146620us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.821788 (+667442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.821883 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.821930 (+    47us) raft_consensus.cc:1685] finished
0709 13:16:23.821949 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.822101 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66698,"prepare.queue_time_us":146676,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5748,"raft.queue_time_us":200651,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":10502,"thread_start_us":955037,"threads_started":2,"wal-append.queue_time_us":544039}
I20260709 13:16:23.846545 11417 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:23.677469 13442 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.798264 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:23.546979 13444 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.817001 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:23.901058 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.695161 13441 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:23.904695 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:23.905784 10740 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.905306 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:23.964144 10738 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:23.965435 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:23.971026 13423 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:23.990751 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:23.915875 13243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.003s	sys 0.010s
I20260709 13:16:23.838184 13419 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:23.921697 13458 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.012382 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:23.972266 13247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.009s	sys 0.015s
I20260709 13:16:23.996881 11414 raft_consensus.cc:2393] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:24.017716 10740 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:23.847239 13421 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:24.019253 10708 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.583s (SENT)
W20260709 13:16:24.009443 13243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.003s	sys 0.010s
W20260709 13:16:24.023710 13345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.018s
I20260709 13:16:23.997781 13428 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.018188 10740 pending_rounds.cc:85] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 2
I20260709 13:16:24.028653 10740 pending_rounds.cc:107] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:24.029004 10740 raft_consensus.cc:2889] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:24.029587 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.018589 13247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.010s	sys 0.015s
I20260709 13:16:24.024132 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1693) took 1705 ms. Trace:
W20260709 13:16:24.029563 13345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.018s
W20260709 13:16:24.040855 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 491459us
I20260709 13:16:23.920912 13374 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:24.050107 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 47087.7us
I20260709 13:16:24.026929 13423 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.034940 10661 rpcz_store.cc:276] 0709 13:16:22.319141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.194863 (+875722us) service_pool.cc:224] Handling call
0709 13:16:23.213663 (+ 18800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.226111 (+ 12448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.226143 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.226186 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:23.226231 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.021717 (+795486us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54000c4c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:24.021777 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.024076 (+  2299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23286528}
I20260709 13:16:24.024694 13243 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:24.034337 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.019s
W20260709 13:16:24.064725 10708 leader_election.cc:336] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.584s (SENT)
I20260709 13:16:24.031124 13426 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.068077 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 176598us
W20260709 13:16:24.068231 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.019s
W20260709 13:16:24.064036 10737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.005s	sys 0.013s
W20260709 13:16:24.080324 10737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.005s	sys 0.013s
I20260709 13:16:24.067587 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:24.041992 13186 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:24.082774 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 390446us
I20260709 13:16:24.083724 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:24.084610 10664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.013s	sys 0.025s
W20260709 13:16:24.085091 10739 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
W20260709 13:16:24.086423 10664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.013s	sys 0.026s
I20260709 13:16:24.087093 10739 raft_consensus.cc:2410] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:24.018786 13458 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.068998 13464 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:24.091483 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.092808 10739 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:24.069518 12825 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.095503 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:24.080874 13247 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.098423 10738 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:24.124091 13247 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:24.126057 13448 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.865s	user 0.014s	sys 0.011s
I20260709 13:16:24.126196 13247 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.040324 13428 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:24.128165 13428 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.099766 10740 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:24.103399 10742 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:24.105710 13423 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:24.094276 13464 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:24.130990 13464 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.132181 13370 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.132385 13464 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.132715 13370 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:24.133811 13468 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:24.106817 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:24.134317 13468 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.135182 10635 leader_election.cc:400] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 6.
W20260709 13:16:24.109790 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58984us
I20260709 13:16:24.135439 13042 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.136060 13042 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.110472 13419 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:24.110808 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.136667 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.137881 13421 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.138046 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 438) took 1560 ms. Trace:
I20260709 13:16:24.138392 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:24.138854 13441 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.139801 13246 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.140336 13246 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.140664 13246 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.141009 13246 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.141606 11411 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:24.107404 13451 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:16:24.111686 10735 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.008s	sys 0.021s
W20260709 13:16:24.148732 10735 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.021s
I20260709 13:16:24.112469 11414 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:24.097167 13186 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.129720 10740 pending_rounds.cc:85] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 6
I20260709 13:16:24.184852 10740 pending_rounds.cc:107] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:16:24.185194 10740 raft_consensus.cc:2889] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.113190 13243 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:24.116094 11410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 359) took 1902 ms (client timeout 1767 ms). Trace:
I20260709 13:16:24.110466 13474 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.116125 13458 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.117509 13473 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:24.121441 13253 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:24.082060 13426 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.135470 10635 leader_election.cc:403] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:24.111335 13444 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:24.136355 10708 leader_election.cc:336] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.612s (SENT)
I20260709 13:16:24.136376 13042 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:24.138408 11416 rpcz_store.cc:276] 0709 13:16:22.577958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.578099 (+   141us) service_pool.cc:224] Handling call
0709 13:16:22.578331 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.861259 (+282928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.137842 (+1276583us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54005181d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:24.137995 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493048192}
I20260709 13:16:24.171319 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:24.136348 13468 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.120818 10492 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:24.190841 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.190900 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.194590 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.195865 13440 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.210053 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:24.213735 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:24.213179 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 366854us
I20260709 13:16:24.218588 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1707) took 1292 ms. Trace:
I20260709 13:16:24.220582 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1702) took 1660 ms. Trace:
I20260709 13:16:24.226357 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:24.220938 10663 rpcz_store.cc:276] 0709 13:16:22.560180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.445606 (+885426us) service_pool.cc:224] Handling call
0709 13:16:23.445859 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.476660 (+ 30801us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:23.539345 (+ 62685us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.220303 (+680958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.220345 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.220386 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.220444 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.220535 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7014,"prepare.queue_time_us":226234,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":828160,"thread_start_us":409445,"threads_started":1}
I20260709 13:16:24.226593 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.218946 10668 rpcz_store.cc:276] 0709 13:16:22.926059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.480355 (+554296us) service_pool.cc:224] Handling call
0709 13:16:23.480637 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.480852 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:23.982749 (+501897us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.218284 (+235535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.218332 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.218379 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.218441 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.218538 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58329,"prepare.queue_time_us":279910,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"thread_start_us":518601,"threads_started":2}
I20260709 13:16:24.227440 10589 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:24.229123 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.230218 10589 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:24.231002 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.232686 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:24.235247 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 139850us
I20260709 13:16:24.208918 13441 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.205938 13042 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.238503 10706 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:24.236490 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.032s	sys 0.012s
I20260709 13:16:24.239647 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:24.611279 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.032s	sys 0.012s
I20260709 13:16:24.287739 12980 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.605528 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:24.606217 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.240352 13474 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.271431 12849 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:24.271239 13468 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.216799 11411 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:24.210800 13473 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.236357 13440 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.260854 13458 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.606587 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1691) took 2288 ms. Trace:
I20260709 13:16:24.631150 11418 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:24.630508 10662 rpcz_store.cc:276] 0709 13:16:22.318614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.946509 (+627895us) service_pool.cc:224] Handling call
0709 13:16:22.946899 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.947332 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.947377 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.948022 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.678646 (+730624us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.678680 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.678750 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.606401 (+927651us) raft_consensus.cc:1685] finished
0709 13:16:24.606421 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.606535 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":374,"thread_start_us":730198,"threads_started":1,"wal-append.queue_time_us":898397}
I20260709 13:16:24.633523 11413 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:24.623966 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:24.634744 12825 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.634913 13374 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:24.635485 13374 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:24.635236 12825 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.635877 13442 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.636536 13374 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.638754 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1744) took 1150 ms. Trace:
I20260709 13:16:24.639106 10734 rpcz_store.cc:276] 0709 13:16:23.488230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.509814 (+ 21584us) service_pool.cc:224] Handling call
0709 13:16:23.510070 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.982355 (+472285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.982386 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.982429 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.982469 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.638546 (+656077us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54001586d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:24.638588 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.638694 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909407104}
I20260709 13:16:24.619027 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1732) took 1169 ms. Trace:
W20260709 13:16:24.607223 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 368740us
W20260709 13:16:24.644611 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.645092 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.192471 11410 rpcz_store.cc:269] 0709 13:16:22.213793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.221823 (+  8030us) service_pool.cc:224] Handling call
0709 13:16:24.115859 (+1894036us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400033754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:24.116001 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729667456}
I20260709 13:16:24.634066 13458 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:24.607918 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 471541us
I20260709 13:16:24.310191 10492 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 5, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 5 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:24.293855 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 158799us
I20260709 13:16:24.609477 11416 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:24.609882 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 383094us
I20260709 13:16:24.377270 13429 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.240037 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:24.612485 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 369199us
I20260709 13:16:24.620748 12849 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.621762 13345 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.621526 13468 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.618315 13322 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.622478 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:24.679176 11417 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:24.607573 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:24.651376 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:24.618243 13477 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.386s	user 0.000s	sys 0.009s
I20260709 13:16:24.613191 12980 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.641310 10735 rpcz_store.cc:276] 0709 13:16:23.449630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.462501 (+ 12871us) service_pool.cc:224] Handling call
0709 13:16:23.485013 (+ 22512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.521753 (+ 36740us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:24.149130 (+627377us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.618714 (+469584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.618762 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.618809 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.618864 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.618975 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2819,"prepare.queue_time_us":152262,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":11657,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":5504,"thread_start_us":907999,"threads_started":2}
I20260709 13:16:24.664570 13426 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.637310 12825 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.666570 13473 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.646281 13246 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.668641 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:24.672992 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 427252us
I20260709 13:16:24.673859 13345 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:24.679373 10708 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.622s (SENT)
I20260709 13:16:24.681599 11413 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:24.667151 13429 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.687182 11414 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.678498 13468 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.716446 13484 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.678870 13322 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.678457 13458 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.711043 13440 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:24.721756 10590 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:24.669117 12849 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:24.694967 13441 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 6.
I20260709 13:16:24.741583 13421 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.741828 13429 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.736826 13484 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.743342 13186 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.743441 12980 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.713089 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:24.724154 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:24.744314 13484 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.744760 10667 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:24.719930 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:24.745693 13486 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:24.746127 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 91740.6us
I20260709 13:16:24.746399 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1746) took 1257 ms. Trace:
W20260709 13:16:24.747375 10708 leader_election.cc:336] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.703s (SENT)
I20260709 13:16:24.747938 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:24.715305 13426 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:24.748586 13440 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:24.748915 13426 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:24.749851 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.750790 13440 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:24.750912 13426 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:24.751057 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:24.748917 13442 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.751655 10593 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.752768 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.730947 13462 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:16:24.731778 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63207.9us
I20260709 13:16:24.732426 13253 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:24.729341 13322 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.739710 13246 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:24.740119 13482 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.802170 13482 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:24.731794 13464 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.003s
I20260709 13:16:24.722580 13345 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:24.748100 13466 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.486s	user 0.008s	sys 0.011s
I20260709 13:16:24.751459 13440 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.756961 11414 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:24.746891 10741 rpcz_store.cc:276] 0709 13:16:23.488819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.673107 (+184288us) service_pool.cc:224] Handling call
0709 13:16:23.714804 (+ 41697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.031399 (+316595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.031428 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.067470 (+ 36042us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.212594 (+145124us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.212630 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.212692 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.746217 (+533525us) raft_consensus.cc:1685] finished
0709 13:16:24.746235 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.746350 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7596,"raft.queue_time_us":293793,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":9314,"thread_start_us":372599,"threads_started":2,"wal-append.queue_time_us":631501}
I20260709 13:16:24.728193 12825 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:16:24.910346 13490 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:16:24.800501 13436 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:24.740684 10492 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 4 to 6, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 6 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.813071 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:24.923306 10589 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:24.929437 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:24.746162 13486 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.938012 13486 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.719502 13478 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:16:24.941450 10492 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 4, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:16:24.749091 10708 leader_election.cc:336] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.713s (SENT)
I20260709 13:16:24.947075 10492 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 3, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.956498 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1758) took 1443 ms. Trace:
I20260709 13:16:24.956944 10739 rpcz_store.cc:276] 0709 13:16:23.513164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.104623 (+591459us) service_pool.cc:224] Handling call
0709 13:16:24.104895 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.112299 (+  7404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.112327 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.112768 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.609914 (+497146us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.609955 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.610019 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.956254 (+346235us) raft_consensus.cc:1685] finished
0709 13:16:24.956281 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.956436 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6801,"raft.queue_time_us":6896,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":148419,"threads_started":1,"wal-append.queue_time_us":537390}
I20260709 13:16:24.918813 13436 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:24.986730 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:24.999012 10593 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.000365 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:24.946118 13440 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:25.026512 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 307064us
W20260709 13:16:25.049754 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 300666us
I20260709 13:16:25.037142 10492 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:25.002487 13309 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.155s	user 0.015s	sys 0.004s
W20260709 13:16:25.022921 13042 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.000s
I20260709 13:16:25.022433 13440 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:25.027787 13464 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:25.052927 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 396537us
I20260709 13:16:25.049346 13246 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.061554 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 338341us
I20260709 13:16:25.065125 10559 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:25.061426 10492 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 3, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 3 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:25.063160 10708 connection.cc:256] RPC call timeout handler was delayed by -1.0297964769999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 13:16:25.071998 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:25.056939 13423 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.061766 13440 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.057627 13498 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.077077 10492 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:25.060066 13426 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.055397 13497 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.060233 13473 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:25.073426 13468 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.105598 13468 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.106381 13436 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.107558 13468 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.107721 13436 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.108105 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:25.108917 13474 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.109273 13474 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.109630 13474 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.083017 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 258) took 2484 ms. Trace:
I20260709 13:16:25.084012 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1686) took 2787 ms. Trace:
I20260709 13:16:25.090157 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 435) took 2555 ms. Trace:
I20260709 13:16:25.082697 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1840) took 2276 ms. Trace:
I20260709 13:16:25.069747 13246 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.115506 10492 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 2, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:16:25.093643 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 139059us
I20260709 13:16:25.095552 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.117137 11416 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:25.095964 13426 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.096616 13498 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.060111 13042 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.090817 13423 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.086484 13253 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.074311 13482 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.074409 13464 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:25.127898 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:25.128432 11418 raft_consensus.cc:2376] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8. Re-sending same reply.
I20260709 13:16:25.110647 10592 rpcz_store.cc:276] 0709 13:16:22.593096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.593374 (+   278us) service_pool.cc:224] Handling call
0709 13:16:22.593613 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.306841 (+713228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.077518 (+1770677us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:25.077659 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637166848}
I20260709 13:16:25.114439 10587 rpcz_store.cc:276] 0709 13:16:22.801288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.834340 (+ 33052us) service_pool.cc:224] Handling call
0709 13:16:22.834622 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.670625 (+836003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.077092 (+1406467us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002a8854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:25.077254 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591620992}
I20260709 13:16:25.090946 13078 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.120252 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:25.121661 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:25.131278 11416 raft_consensus.cc:2410] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:25.111505 10660 rpcz_store.cc:276] 0709 13:16:22.292733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.789829 (+497096us) service_pool.cc:224] Handling call
0709 13:16:22.790096 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.519209 (+729113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.519252 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.519734 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.068909 (+549175us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:24.068960 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.076347 (+1007387us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54002c01d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:25.076405 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.076446 (+    41us) raft_consensus.cc:1685] finished
0709 13:16:25.076459 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.079620 (+  3161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1600,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":1675729152,"thread_start_us":548773,"threads_started":1,"wal-append.queue_time_us":688022}
I20260709 13:16:25.132804 11416 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:25.134907 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.129952 13055 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.142714 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.142948 13055 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.144892 13486 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.145383 13078 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:25.145834 13078 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.146950 13423 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.147511 13506 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.147982 13506 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.134182 10492 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:25.151422 10666 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:25.154390 12825 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:25.154784 13499 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:25.154877 13506 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:25.154441 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:25.145116 13055 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.153388 13423 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.159409 13253 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:25.160106 12980 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:25.114980 11409 rpcz_store.cc:276] 0709 13:16:22.535119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.542407 (+  7288us) service_pool.cc:224] Handling call
0709 13:16:22.561725 (+ 19318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.152526 (+590801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.079492 (+1926966us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54005daa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:25.090099 (+ 10607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118762240}
I20260709 13:16:25.160665 12980 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.185573 13426 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.185698 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:25.155794 13498 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.186470 12980 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:25.173242 13483 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.560s	user 0.010s	sys 0.006s
W20260709 13:16:25.172371 13445 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.911s	user 0.008s	sys 0.028s
I20260709 13:16:25.163344 12850 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:25.164201 13310 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:25.190376 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:25.191569 13078 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.186123 13426 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.195914 13474 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.196733 13504 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.197234 13504 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:25.197736 13496 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:25.198014 13474 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:25.171165 13464 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.153427 13503 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:16:25.215145 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.215407 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.215744 10593 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:25.217104 10586 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.218602 10589 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:25.200079 13345 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.113881 13473 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.201491 13504 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.224406 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:25.202782 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:25.203421 13419 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.204380 13369 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.205499 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:25.226446 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:25.206266 13480 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.945s	user 0.018s	sys 0.008s
W20260709 13:16:25.207957 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.206516 12849 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:25.167078 13042 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:25.203775 13246 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:25.179289 13055 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.201560 13429 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.228374 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.229096 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:25.238430 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.227779 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.224190 13078 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.180753 13440 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.272846 10706 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:25.271664 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.182534 13322 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.278365 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.240871 13423 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.290385 13440 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:25.281464 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.283082 10586 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:25.245814 13426 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:25.295598 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 48229.4us
I20260709 13:16:25.296236 10592 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:25.301438 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.301920 11417 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:16:25.302008 10663 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.301457 10593 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:25.303396 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.304096 10663 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:25.304610 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.305308 10742 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.237649 13369 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.307862 13369 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.183866 13253 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.304250 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.320628 10737 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.320698 10742 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:25.318974 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.319473 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.319764 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.321509 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.322266 10665 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:25.321394 10662 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.323938 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.324611 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.324092 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.325891 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.326829 10741 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:25.327026 10740 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:25.327705 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.330312 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.330756 10660 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:25.332320 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.333102 10668 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.255409 13474 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:16:25.334357 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.318768 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.335120 10669 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.335059 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.336012 10734 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:25.255355 13243 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:16:25.339648 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.340086 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.337818 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.338003 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.338646 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.295014 13367 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:25.343070 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.343777 10740 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.340543 10742 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:25.341619 10665 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.296973 13426 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.344744 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.301890 13429 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:25.350288 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.347832 10735 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:25.349123 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.353380 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.354108 10668 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:25.354557 13345 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:25.355744 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.352377 10660 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:25.359947 10669 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.362475 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.362938 10741 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:25.334256 13246 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:25.364897 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.369591 10587 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:25.321089 13042 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:25.372349 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.374096 10592 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:25.376343 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.376937 10739 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:25.380939 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.380999 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.352972 13426 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:25.385290 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 146821us
I20260709 13:16:25.385990 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.386463 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.387498 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.387687 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.361888 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:25.387915 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1745) took 1899 ms. Trace:
I20260709 13:16:25.396127 10663 raft_consensus.cc:2393] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:25.403164 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.398644 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1839) took 2598 ms. Trace:
W20260709 13:16:25.359293 11412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 301) took 1648 ms (client timeout 1581 ms). Trace:
I20260709 13:16:25.396001 10739 raft_consensus.cc:2410] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:25.406487 10669 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:25.405469 10591 rpcz_store.cc:276] 0709 13:16:22.800585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.800844 (+   259us) service_pool.cc:224] Handling call
0709 13:16:22.909568 (+108724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.914542 (+  4974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.398382 (+2483840us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002c92d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:25.398567 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248855296}
I20260709 13:16:25.406805 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.407112 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.396369 13422 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:16:25.410635 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:25.410562 13422 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:25.412497 13498 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:25.412845 13498 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:25.349501 13367 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.408113 10665 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:25.413645 13498 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.408711 10662 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.415179 13498 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.415882 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.415122 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.417480 13440 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.415165 13367 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:25.417680 13419 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.418141 13440 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.418681 13419 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.419090 13419 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.419860 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.420439 13440 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:25.420886 10743 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:25.420809 13055 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:25.421460 13513 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:16:25.417524 10665 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.421758 13055 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:25.423024 13422 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.423408 13422 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:25.423507 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.424444 13369 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:25.424207 13422 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.424819 13369 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:25.425357 13422 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.406857 13482 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:16:25.406776 11412 rpcz_store.cc:269] 0709 13:16:23.708125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.713956 (+  5831us) service_pool.cc:224] Handling call
0709 13:16:25.355608 (+1641652us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194e9c 00007f4254194a5b 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:25.356509 (+   901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826496}
I20260709 13:16:25.425585 13369 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:25.426934 13369 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.429558 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:25.429986 10734 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.419911 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.431546 10735 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:25.431703 10740 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:25.432019 10667 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.421928 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.432600 10743 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:25.439343 13486 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:25.439159 13429 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.378557 13042 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.442025 13322 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:25.448114 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.449738 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.450606 10743 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:25.450749 13367 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.450960 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 255) took 1235 ms. Trace:
I20260709 13:16:25.451370 13367 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.451339 10666 rpcz_store.cc:276] 0709 13:16:24.215877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.215996 (+   119us) service_pool.cc:224] Handling call
0709 13:16:25.450749 (+1234753us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b540012f054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:25.450869 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125743872}
I20260709 13:16:25.451963 10740 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:25.452855 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.453186 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.453672 10669 raft_consensus.cc:2410] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:25.453956 11409 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:25.425632 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.458868 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.459892 10735 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:25.460651 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.461913 10740 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:25.463400 10737 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:25.464859 10737 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:25.465721 12849 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.466306 12849 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:25.467420 13465 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.842s	user 0.005s	sys 0.010s
I20260709 13:16:25.468528 12849 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.468973 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1709) took 2500 ms. Trace:
I20260709 13:16:25.387303 13497 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.461134 10735 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:25.480790 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:25.403931 10736 rpcz_store.cc:276] 0709 13:16:23.488512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.531828 (+ 43316us) service_pool.cc:224] Handling call
0709 13:16:23.672745 (+140917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.718980 (+ 46235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.719022 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.800899 (+ 81877us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.080639 (+279740us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:24.094831 (+ 14192us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.110479 (+ 15648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.110554 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.205550 (+1094996us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:25.380646 (+175096us) raft_consensus.cc:1685] finished
0709 13:16:25.387718 (+  7072us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.387863 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15442,"prepare.queue_time_us":12131,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":334044,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":15388,"spinlock_wait_cycles":7776000,"thread_start_us":188644,"threads_started":1,"wal-append.queue_time_us":355747}
I20260709 13:16:25.465181 10737 pending_rounds.cc:85] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:25.482316 10737 pending_rounds.cc:107] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:16:25.483055 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.390967 13246 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:25.488816 10737 raft_consensus.cc:2917] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:16:25.493577 10737 raft_consensus.cc:2889] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.489073 13243 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.490245 13370 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:25.469462 10664 rpcz_store.cc:276] 0709 13:16:22.968571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.480607 (+512036us) service_pool.cc:224] Handling call
0709 13:16:23.491300 (+ 10693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.515873 (+ 24573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.515909 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.516363 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.091363 (+575000us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:24.122428 (+ 31065us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.122914 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.123020 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.467158 (+1344138us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b240028aeb8. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420b09d 00007f4256e3d10e 00007f4256e5488c 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221
0709 13:16:25.468656 (+  1498us) raft_consensus.cc:1685] finished
0709 13:16:25.468759 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.468917 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30467,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":10209,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"spinlock_wait_cycles":58486016,"thread_start_us":570241,"threads_started":1,"wal-append.queue_time_us":694762}
I20260709 13:16:25.491232 11382 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:25.492183 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.495925 10739 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:25.489038 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.496977 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.497026 10663 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.497802 10740 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:25.498836 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:25.502655 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:25.615100 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.563223 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.504036 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:25.618800 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 73264.2us
I20260709 13:16:25.619390 11414 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:25.543097 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:25.620229 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.536351 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 169554us
I20260709 13:16:25.503400 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.631250 10736 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:25.542990 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.632515 10669 raft_consensus.cc:2376] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8. Re-sending same reply.
I20260709 13:16:25.617708 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.637061 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:25.581208 10663 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.641273 10585 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:25.629050 10742 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:25.521517 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.644569 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.645510 10663 raft_consensus.cc:2410] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:25.643496 10664 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.601260 13042 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:25.956162 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.956526 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.881695 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:25.955046 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.731338 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.666713 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:25.967587 10664 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.847858 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.493254 13322 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:25.661814 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.969005 10740 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:25.828316 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.958334 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:25.977716 11414 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.790009 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.542680 13468 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.691610 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:25.978638 10739 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:25.790192 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.668033 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.788348 10667 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.597520 13473 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:25.956530 13426 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.003s
W20260709 13:16:25.981367 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 312773us
W20260709 13:16:25.981707 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 290169us
I20260709 13:16:25.837985 10666 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:25.991472 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.992781 10738 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:16:25.837844 13506 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.861613 11410 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:25.998509 10664 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:25.666920 13345 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:25.994422 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:25.860102 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:25.877568 13042 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.998435 10738 pending_rounds.cc:85] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 8
I20260709 13:16:26.001638 10740 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:26.011683 10738 pending_rounds.cc:107] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:26.012001 10738 raft_consensus.cc:2889] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.001652 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.731690 13440 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.311s
I20260709 13:16:26.010281 11381 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:25.499476 13243 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:25.980684 13468 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.012609 10660 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:25.806962 13281 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.689983 13474 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.314s
I20260709 13:16:26.004871 10735 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:26.014487 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:26.015508 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:26.021970 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:26.022171 10666 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.991178 13369 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.015585 10665 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:26.016469 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:25.611373 13419 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.019562 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:26.023918 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:26.023762 13281 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.025121 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:26.025978 13281 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:26.027465 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.028723 10660 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.012552 13345 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:26.030539 10660 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.573727 13246 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.037132 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:26.022991 10664 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:26.029141 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:26.022408 10594 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.036298 11414 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:26.031579 10660 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.010308 13497 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.005986 13506 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:26.095095 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 55612.7us
I20260709 13:16:26.010644 13367 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:26.000953 13426 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:26.017283 11412 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:26.466645 10666 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:26.557652 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.096254 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:26.559900 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 294) took 1082 ms. Trace:
I20260709 13:16:26.561087 10734 rpcz_store.cc:276] 0709 13:16:25.477513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.018870 (+541357us) service_pool.cc:224] Handling call
0709 13:16:26.559837 (+540967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.018867 13468 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:26.539705 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 46503.3us
I20260709 13:16:26.491087 10594 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:16:26.453064 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.579619 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.007s
W20260709 13:16:26.579977 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.007s
I20260709 13:16:26.580207 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:26.580979 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.031536 13322 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.563441 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:26.588019 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:26.589653 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.590042 10662 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:26.123096 10663 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10.
I20260709 13:16:26.598731 10737 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.121451 13423 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:26.636695 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:26.641233 10662 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:26.295035 13345 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:26.093187 13464 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.563s
I20260709 13:16:26.337457 13486 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:26.017995 13042 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:26.121645 13281 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.542s
I20260709 13:16:26.585829 13484 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:16:26.581442 13367 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.712703 10738 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.686753 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.714913 10662 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:26.680181 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:26.616714 13482 raft_consensus.cc:2764] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:26.685544 10742 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.698675 13419 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:26.700755 13426 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:26.701601 13527 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:26.717051 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:26.717901 13506 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:26.718612 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:26.669418 13423 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.695099 13055 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.724177 13055 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.702625 13484 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:26.707558 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:26.709023 13533 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:16:26.613227 13497 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:26.709554 13542 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:26.709573 13345 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:26.710319 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:26.716032 10737 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:26.718132 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 372) took 1246 ms. Trace:
I20260709 13:16:26.720546 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.719166 10734 raft_consensus.cc:2376] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7. Re-sending same reply.
I20260709 13:16:26.723416 13423 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:26.728564 10740 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:26.746618 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:26.746856 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:26.747387 10740 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.744387 10662 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:26.747905 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:26.737747 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:26.758085 10742 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:26.759487 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:26.760689 10738 raft_consensus.cc:2368] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7.
I20260709 13:16:26.766454 10740 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:26.773257 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.774662 10662 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
W20260709 13:16:26.776036 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 211062us
I20260709 13:16:26.776934 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:26.777731 10743 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.777801 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:26.742326 10593 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:26.781540 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:26.784403 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.785564 10662 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:26.786321 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.786814 10662 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:26.787535 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.788403 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.789007 10662 raft_consensus.cc:2393] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:26.789624 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.790493 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:26.808794 11381 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.697s (SENT) [suppressed 37 similar messages]
I20260709 13:16:26.873152 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:26.874092 10662 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:26.874967 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:26.875557 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 97840.1us
I20260709 13:16:26.876622 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:26.879086 10662 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 4: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:26.693763 13486 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:26.770787 13419 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:26.758352 13426 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.896683 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:26.898075 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.026s
W20260709 13:16:26.900130 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.005s	sys 0.026s
I20260709 13:16:26.900504 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:26.740024 13484 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:26.901193 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.898376 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:26.904831 10662 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:26.886252 13429 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:26.895367 13528 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.564s	user 0.000s	sys 0.001s
I20260709 13:16:26.913036 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1397) took 1442 ms. Trace:
I20260709 13:16:26.758966 13345 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:26.886891 13537 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:26.873471 13506 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:16:26.957099 11415 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
W20260709 13:16:26.909679 13531 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.788s	user 0.000s	sys 0.001s
I20260709 13:16:26.955415 13537 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:26.973083 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:26.921252 13429 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:26.952111 10591 rpcz_store.cc:276] 0709 13:16:25.470471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.470571 (+   100us) service_pool.cc:224] Handling call
0709 13:16:25.496258 (+ 25687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.617098 (+120840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.617140 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.690122 (+ 72982us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.914515 (+224393us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.914566 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.914654 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.942390 (+ 27736us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4800002958. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:16:26.910020 (+967630us) raft_consensus.cc:1685] finished
0709 13:16:26.910048 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.912972 (+  2924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9767,"raft.queue_time_us":145952,"raft.run_cpu_time_us":2630,"raft.run_wall_time_us":294278,"spinlock_wait_cycles":25170304,"thread_start_us":106975,"threads_started":1,"wal-append.queue_time_us":229621}
I20260709 13:16:26.909586 13419 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:26.974345 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 192902us
I20260709 13:16:26.996520 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:26.996685 10590 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.008s	sys 0.012s
W20260709 13:16:26.997143 10590 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.008s	sys 0.012s
I20260709 13:16:26.911360 13539 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:26.993475 10585 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.956231 13542 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.997840 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:26.992623 11412 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.975591 13426 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.995291 13429 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.011890 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:27.012759 10585 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.998716 13506 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:27.021567 13506 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:27.022742 13506 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.024317 13506 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.030606 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:26.997334 13545 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.071516 10585 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:27.074496 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:27.063596 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 165795us
I20260709 13:16:27.055007 11412 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:27.009519 13489 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:27.096464 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:27.097141 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 99358us
W20260709 13:16:27.081822 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.010203 13423 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.041307 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1319) took 1573 ms. Trace:
I20260709 13:16:27.041028 13549 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.071080 13042 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.072199 13553 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.108001 10739 rpcz_store.cc:276] 0709 13:16:25.467513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.982573 (+515060us) service_pool.cc:224] Handling call
0709 13:16:26.004386 (+ 21813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.021867 (+ 17481us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:26.122506 (+100639us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.040988 (+918482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.041040 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.041088 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.041151 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.041256 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155592,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":6935,"raft.queue_time_us":81742,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":37586,"spinlock_wait_cycles":106685824,"thread_start_us":544063,"threads_started":2,"wal-append.queue_time_us":607219}
I20260709 13:16:27.008325 13542 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.011040 13426 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.122534 13545 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.123054 13549 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:27.126191 10586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.007s
I20260709 13:16:27.102630 13055 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.100762 13489 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:27.131201 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.137380 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1715) took 1123 ms. Trace:
I20260709 13:16:27.137701 13553 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.153873 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.154548 10669 rpcz_store.cc:276] 0709 13:16:26.014440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.014572 (+   132us) service_pool.cc:224] Handling call
0709 13:16:26.018618 (+  4046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.337523 (+318905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.337552 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.481898 (+144346us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.998256 (+516358us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:26.998313 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.998405 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.137161 (+138756us) raft_consensus.cc:1685] finished
0709 13:16:27.137181 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.137327 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":574412,"raft.run_cpu_time_us":4941,"raft.run_wall_time_us":16074,"spinlock_wait_cycles":41600,"thread_start_us":737155,"threads_started":2,"wal-append.queue_time_us":518172}
W20260709 13:16:27.159082 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.007s
I20260709 13:16:26.745388 11409 rpcz_store.cc:276] 0709 13:16:25.471481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.480286 (+  8805us) service_pool.cc:224] Handling call
0709 13:16:25.492114 (+ 11828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.500646 (+  8532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.500697 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.501300 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.783086 (+281786us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:25.818216 (+ 35130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.828761 (+ 10545us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.717898 (+889137us) raft_consensus.cc:1685] finished
0709 13:16:26.717924 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.718071 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":867,"raft.queue_time_us":42091,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7539,"thread_start_us":211507,"threads_started":1,"wal-append.queue_time_us":513439}
I20260709 13:16:27.113356 13497 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.113039 13550 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.151139 13243 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:27.150753 10586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.007s
I20260709 13:16:27.130654 13345 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.163904 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.121953 13556 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:27.169806 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.007s
I20260709 13:16:27.168839 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:27.155076 13369 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.116s	user 0.010s	sys 0.002s
I20260709 13:16:27.161237 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.158962 13042 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.161655 13486 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.204804 10743 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:27.193704  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.189338 13550 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.114710 13419 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.153899 13545 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.182893 13555 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:27.219822 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 155503us
I20260709 13:16:27.172891 13559 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.207157 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 110785us
I20260709 13:16:27.218973 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.227957 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.228910 13422 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.107702 13537 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.162678 13538 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:16:27.229787 13559 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.231755 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.235605 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.236930 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.191576 13246 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.235307 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:27.183194 13563 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.198872 13243 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:27.258451 10742 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:27.258785 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:27.204432 13345 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.219128 13369 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.262796 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.263690 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.259434 10735 raft_consensus.cc:2376] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9. Re-sending same reply.
I20260709 13:16:27.271353 10587 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:27.277809 10664 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:16:27.280141 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48494.2us
W20260709 13:16:27.279948 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 44698.2us
I20260709 13:16:27.281054 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:27.290346 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1968) took 1987 ms (client timeout 2157 ms). Trace:
W20260709 13:16:27.290970 10661 rpcz_store.cc:269] 0709 13:16:25.302779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.302980 (+   201us) service_pool.cc:224] Handling call
0709 13:16:27.290097 (+1987117us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54000c4754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.290272 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555290880}
I20260709 13:16:27.256589 13484 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.274085 13478 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:27.296092 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.295759 13542 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.306741 11382 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.265574 13558 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.239378 13555 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.307122 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.313100 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.315886 10587 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:27.322894 13369 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:27.322986 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.323396 13369 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.323839 13369 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.324515 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.326576 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.328223 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.304600 13042 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.335808 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.337570 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:27.309120 13568 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:27.305946 13571 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.328061 13055 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.345270 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:27.346503 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 127651us
I20260709 13:16:27.271508 13563 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.307241 13572 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:27.309823 13556 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.329234 13246 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.339275 13560 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.316648 13558 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.278266 13345 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:27.396303 13569 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:16:27.353756 13539 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.357187 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:27.335912 13422 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.411582 13422 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:27.412269 13422 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.412720 13559 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.273214 13489 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.349677 10588 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:27.413655 13559 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:27.413894 13489 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.414005 13559 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.414924 13559 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.338708 13497 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:27.417500 13570 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:16:27.418049 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.339287 13042 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.420210 13545 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.420233 13042 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.379741 13426 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:27.408118 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51043.2us
I20260709 13:16:27.422435 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:27.356060 13572 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:27.434340 13572 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.435798 13572 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.312951 13478 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.438880 13478 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.440662 10594 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:27.447192 13573 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.447803 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.449532 13576 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.450467 13345 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.449218 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:27.452479 13555 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.398495 13558 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.454087 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:27.455060 13576 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:27.456588 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.457494 13345 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.457973 13345 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:27.458446 13345 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:27.459398 13468 consensus_meta.cc:287] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.003s
I20260709 13:16:27.459957 13468 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.398986 13482 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:27.461988 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.462699 13482 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:27.463879 13482 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:27.467705 13322 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.867s	user 0.004s	sys 0.004s
I20260709 13:16:27.468546 13322 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.363538 13246 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.513893 13246 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.472081 13563 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.515816 13563 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.516275 13563 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.351547 13562 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.517690 13562 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:27.518796 13576 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.403332 13055 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.519472 13055 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.519882 13055 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:27.477942 13561 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:16:27.364465 13556 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.348963 13571 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.522847 13571 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:27.432858 13484 consensus_queue.cc:1175] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fac2164a6f874d7dbd29db83a7cf019b" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:27.523883 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.481356 13573 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.531204 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1400) took 1533 ms. Trace:
I20260709 13:16:27.531524 10590 rpcz_store.cc:276] 0709 13:16:25.997604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.997760 (+   156us) service_pool.cc:224] Handling call
0709 13:16:26.012221 (+ 14461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.012409 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:26.997662 (+985253us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.258972 (+261310us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.530701 (+271729us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b18001e5740. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287
0709 13:16:27.530824 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.530881 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:27.530943 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.531021 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.531149 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":890791,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1935,"raft.queue_time_us":55366,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":18570,"spinlock_wait_cycles":59884160,"thread_start_us":1189133,"threads_started":3,"wal-append.queue_time_us":349856}
W20260709 13:16:27.533102 13535 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.793s	user 0.000s	sys 0.002s
W20260709 13:16:27.534437 13543 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.559s	user 0.002s	sys 0.000s
I20260709 13:16:27.535264 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 270) took 2165 ms. Trace:
I20260709 13:16:27.537046 13253 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.535627 10586 rpcz_store.cc:276] 0709 13:16:25.369860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.369998 (+   138us) service_pool.cc:224] Handling call
0709 13:16:25.382819 (+ 12821us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:25.383363 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:25.430810 (+ 47447us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.448995 (+ 18185us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b1800034720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:25.925943 (+476948us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b1800034720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:26.013890 (+ 87947us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.021503 (+  7613us) log.cc:844] Serialized 52 byte log entry
0709 13:16:26.021684 (+   181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:26.592200 (+570516us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.189661 (+597461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.189898 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.532569 (+342671us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:27.535047 (+  2478us) raft_consensus.cc:1685] finished
0709 13:16:27.535070 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.535197 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79998,"prepare.queue_time_us":1001492,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":129239,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":16530,"spinlock_wait_cycles":689435008,"thread_start_us":1154944,"threads_started":3,"wal-append.queue_time_us":1052806}
W20260709 13:16:27.543841 13530 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.813s	user 0.002s	sys 0.000s
W20260709 13:16:27.559857 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.560590 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1308) took 2196 ms (client timeout 1510 ms). Trace:
W20260709 13:16:27.561164 10741 rpcz_store.cc:269] 0709 13:16:25.364086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.364199 (+   113us) service_pool.cc:224] Handling call
0709 13:16:27.560163 (+2195964us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540014b254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.560411 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4143887360}
I20260709 13:16:27.562662 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.565699 13576 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.566097 13576 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.568564 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1726) took 1527 ms. Trace:
I20260709 13:16:27.572969 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:27.578100 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1861) took 1556 ms (client timeout 1876 ms). Trace:
W20260709 13:16:27.578625 10593 rpcz_store.cc:269] 0709 13:16:26.021356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.021798 (+   442us) service_pool.cc:224] Handling call
0709 13:16:27.577908 (+1556110us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003ff7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.578034 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336050944}
I20260709 13:16:27.538861 13578 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:16:27.568953 10665 rpcz_store.cc:276] 0709 13:16:26.041653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.092893 (+ 51240us) service_pool.cc:224] Handling call
0709 13:16:26.305836 (+212943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.306765 (+   929us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:26.873886 (+567121us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.567627 (+693741us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b180044b2a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a
0709 13:16:27.568070 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.568258 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.568303 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.568353 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.568412 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.568513 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":655701,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":1828,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":184,"spinlock_wait_cycles":2053376,"thread_start_us":514889,"threads_started":2,"wal-append.queue_time_us":198388}
I20260709 13:16:27.581786 13484 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.453200 13555 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.482861 13575 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:27.584192 10586 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:27.583966 13575 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:27.557400 13532 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.827s	user 0.002s	sys 0.000s
I20260709 13:16:27.586328 11417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 373) took 1972 ms. Trace:
I20260709 13:16:27.586648 11417 rpcz_store.cc:276] 0709 13:16:25.614351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.614494 (+   143us) service_pool.cc:224] Handling call
0709 13:16:25.614790 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.616536 (+  1746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.616577 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.647526 (+ 30949us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.990525 (+342999us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:25.990582 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.990666 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.556690 (+1566024us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:27.586057 (+ 29367us) raft_consensus.cc:1685] finished
0709 13:16:27.586076 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.586277 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1378,"raft.queue_time_us":1638,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":15144,"spinlock_wait_cycles":659824896,"thread_start_us":259597,"threads_started":1,"wal-append.queue_time_us":306692}
I20260709 13:16:27.589499 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.537528 13281 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:27.558046 13536 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.827s	user 0.004s	sys 0.001s
I20260709 13:16:27.594399 13281 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.596421 13253 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.484907 13539 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:27.446262 13042 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.499348 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1729) took 1166 ms. Trace:
I20260709 13:16:27.606380 10664 rpcz_store.cc:276] 0709 13:16:26.332707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.604538 (+271831us) service_pool.cc:224] Handling call
0709 13:16:26.639912 (+ 35374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.296917 (+657005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.499036 (+202119us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54002d9954. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:27.499274 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465010432}
I20260709 13:16:27.508070 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1993) took 1552 ms. Trace:
I20260709 13:16:27.607807 13042 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.607683 10663 rpcz_store.cc:276] 0709 13:16:25.956147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.956285 (+   138us) service_pool.cc:224] Handling call
0709 13:16:27.507878 (+1551593us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003ab1d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.508004 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357010816}
W20260709 13:16:27.511030 13541 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.609s	user 0.000s	sys 0.001s
I20260709 13:16:27.609359 13539 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.610710 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1318) took 2143 ms. Trace:
I20260709 13:16:27.611177 10736 rpcz_store.cc:276] 0709 13:16:25.467195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.980855 (+513660us) service_pool.cc:224] Handling call
0709 13:16:26.002000 (+ 21145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.009089 (+  7089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.009133 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.009698 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.436690 (+426992us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.776962 (+340272us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.062955 (+285993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.063029 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.510356 (+447327us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:27.610378 (+100022us) raft_consensus.cc:1685] finished
0709 13:16:27.610502 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.610648 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112430,"prepare.queue_time_us":225654,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":387135,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":200745,"spinlock_wait_cycles":294799616,"thread_start_us":743909,"threads_started":3,"wal-append.queue_time_us":713813}
I20260709 13:16:27.489028 13549 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.488314 13553 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:27.511688 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 1963) took 2217 ms (client timeout 1635 ms). Trace:
W20260709 13:16:27.617765 10667 rpcz_store.cc:269] 0709 13:16:25.294098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.294199 (+   101us) service_pool.cc:224] Handling call
0709 13:16:27.511486 (+2217287us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400181354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.511601 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254036864}
I20260709 13:16:27.512517 10668 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:27.468592 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.619800 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 1978) took 2233 ms. Trace:
I20260709 13:16:27.620198 10668 rpcz_store.cc:276] 0709 13:16:25.386422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.386546 (+   124us) service_pool.cc:224] Handling call
0709 13:16:27.512114 (+2125568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.618714 (+106600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.619580 (+   866us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b5400181350. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:27.619739 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4887520128}
I20260709 13:16:27.589452 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.577153 13537 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.582428 13484 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:27.624173 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78780.3us
W20260709 13:16:27.624055 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 155502us
I20260709 13:16:27.626044 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.626845 13549 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.627197 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.627486 13549 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.627961 13549 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.627839 13345 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.628298 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.628364 13549 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.631001 10667 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:27.631063 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:27.632261 10743 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:27.632717 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.638311 13253 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.628908 13575 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.643967 13243 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:27.629827 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:27.630019 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:27.660279 10741 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:27.665627 10668 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:27.666759 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.667332 10668 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:27.484140 13468 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.668376 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.669037 10668 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:27.670126 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.670710 10668 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:27.650591 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.629241 13473 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.645015 10665 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.629354 13555 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.643778 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:27.631026 13429 consensus_meta.cc:287] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
W20260709 13:16:27.638794 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 114970us
W20260709 13:16:27.695793 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 52895.1us
W20260709 13:16:27.697032 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53364.9us
I20260709 13:16:27.703806 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.704602 11417 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:27.626525 13367 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.738873 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.641095 13550 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:27.741542 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:27.741883 11413 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:27.675599 13473 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.762073 13473 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.701025 13429 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.701068 12850 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:27.690442 13555 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.701246 13564 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.701357 13553 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.467783 13422 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:27.741863 13534 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.754302 13281 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:27.800590 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.800288 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.764066 13429 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:27.810694 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 503972us
I20260709 13:16:27.765611 12850 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.823398 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:27.709306 13253 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:16:27.829784 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 429481us
W20260709 13:16:27.834957 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 489710us
I20260709 13:16:27.836555 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.837230 11412 raft_consensus.cc:2393] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:16:27.837528 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.837833 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.838029 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:27.838407 10590 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:27.838268 13367 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.839287 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:27.839192 13367 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.840102 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.840425 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:27.841578 13367 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:27.839335 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 503571us
I20260709 13:16:27.843067 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.843437 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:27.843816 13367 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.844192 11412 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:27.826844 13505 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.754392 13547 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:16:27.789470 13555 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:27.854388 10708 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.560s (SENT)
I20260709 13:16:27.854944 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:27.760416 13575 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:16:27.776437 13550 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:16:27.821691 13573 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:27.868093 10708 leader_election.cc:336] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.685s (SENT)
I20260709 13:16:27.874581 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:27.861195 10633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.005s	sys 0.012s
W20260709 13:16:27.878754 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.005s	sys 0.012s
I20260709 13:16:27.878562 10665 raft_consensus.cc:2410] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:27.879937 13589 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.880585 13589 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.846616 13310 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.844180 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:27.892777 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48663.3us
I20260709 13:16:27.893999 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.875468 13553 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:27.896842 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58069.4us
I20260709 13:16:27.848095 13484 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:27.898983 10708 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.999s (SENT)
I20260709 13:16:27.911008 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:27.912197 10708 leader_election.cc:336] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.006s (SENT)
I20260709 13:16:27.912607 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:27.913623 10708 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.015s (SENT)
I20260709 13:16:27.913990 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.915432 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:27.874539 13464 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.875906 13568 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:27.930617 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53599.5us
I20260709 13:16:27.923583 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:27.945796 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.892278 13310 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:27.873724 13486 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:27.801807 13564 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:27.953691 10708 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.089s (SENT)
I20260709 13:16:27.948127 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:27.947484 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:27.896471 13572 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.949601 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:27.827823 13243 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:27.930572 13369 consensus_meta.cc:287] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.001s
I20260709 13:16:27.914979 13556 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:27.874416 13549 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.930317 13423 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.930860 13367 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:27.979432 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:27.933432 13440 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.827423 13534 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:27.940745 13474 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:27.984814 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 291144us
I20260709 13:16:27.993667 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:27.951496 13560 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.995414 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:28.069068 10736 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:27.894918 13462 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:16:27.997363 10743 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:27.997473 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 355544us
W20260709 13:16:27.998394 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 50983us
I20260709 13:16:28.080103 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:27.999243 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49718.1us
I20260709 13:16:27.957978 13538 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.960852 13310 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:28.037145 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.037569 10741 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.038053 10663 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:27.983147 13572 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:27.945106 13464 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:28.033210 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 52924.1us
I20260709 13:16:28.081748 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:28.095963 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:28.084288 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51461.8us
I20260709 13:16:28.097219 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:28.005913 13042 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:28.031394 13367 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.032781 13429 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.001470 13369 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:28.127262 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:28.127501 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:28.052682 13426 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.064000 13423 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:28.064236 13539 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.132592 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:28.044749 13547 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:16:28.099386 11415 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:28.135926 10741 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
W20260709 13:16:28.140094 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43687.6us
I20260709 13:16:28.088804 13538 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:28.097710 13572 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.095738 13419 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.092558 13586 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:28.187067 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 233401us
I20260709 13:16:28.181061 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:28.183014 11411 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
W20260709 13:16:28.188619 10708 leader_election.cc:336] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.157s (SENT)
W20260709 13:16:28.189709 10708 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.190s (SENT)
I20260709 13:16:28.190205 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:28.139372 13560 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.145634 13367 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.136442 13422 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:28.191258 10668 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.131919 13583 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:28.281366 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.155530 13055 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.005s
I20260709 13:16:28.143168 13589 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:28.093150 13553 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:16:28.161350 13426 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:28.267303 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 86330us
W20260709 13:16:28.266549 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 200631us
I20260709 13:16:28.312101 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:28.314194 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:28.184929 13538 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.271996 12825 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.273028 13573 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:28.272826 13612 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:28.274927 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:28.284951 11382 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:28.287407 10741 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:28.342840 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58001.5us
W20260709 13:16:28.248333 13567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.018s
I20260709 13:16:28.348441 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.184106 13042 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:28.179180 13429 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:28.191897 13539 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:28.186997 13377 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.334s
I20260709 13:16:28.275368 13186 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:28.287190 13560 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:16:28.264353 13591 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:28.320058 10740 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:28.185514 13584 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.386s
I20260709 13:16:28.380580 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.377671 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:28.248080 13586 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:28.351724 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:28.382876 13559 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.967s	user 0.011s	sys 0.011s
I20260709 13:16:28.295235 13484 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:28.340443 13426 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.383675 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:28.377578 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 187887us
W20260709 13:16:28.681658 10708 leader_election.cc:336] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.243s (SENT)
I20260709 13:16:28.681985 10590 raft_consensus.cc:2410] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:28.682077 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:28.338591 13423 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:28.352013 13567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.008s	sys 0.018s
W20260709 13:16:28.684823 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 371012us
I20260709 13:16:28.479028 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:28.685642 10667 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:28.340238 12825 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:28.421653 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:28.099153 13568 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:28.351351 13489 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.484923 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.359720 12850 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:28.468302 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.635939 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 342032us
I20260709 13:16:28.345209 13575 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.630924 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.537621 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:28.709054 10664 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
I20260709 13:16:28.298049 13551 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:16:28.351423 13614 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:28.347460 11410 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:28.425523 13042 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:28.341830 13055 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:28.479069 13587 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:28.538049 13560 consensus_queue.cc:1243] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:28.659230 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 490035us
I20260709 13:16:28.666579 10735 raft_consensus.cc:2393] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:28.647634 13542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.005s
I20260709 13:16:28.675796 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.676501 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:28.682471 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:28.685037 10708 leader_election.cc:336] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.756s (SENT)
I20260709 13:16:28.783187 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:28.554319 13461 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.527s
I20260709 13:16:28.669535 13564 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:28.673427 13464 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:28.706588 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:28.648883 10587 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:28.862510 10662 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:28.709511 10664 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:28.751603 13042 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:28.753577 13590 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.487s	user 0.001s	sys 0.000s
I20260709 13:16:28.862540 10667 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:28.680199 13369 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:28.758291 10635 leader_election.cc:400] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7.
I20260709 13:16:28.689551 12825 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.892256 10635 leader_election.cc:403] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.687681 13553 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.696808 13563 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:28.683540 13559 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:28.754084 13587 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:28.769589 13586 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:28.763675 13602 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:16:28.767213 13592 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:16:28.865839 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:28.760710 13542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.003s	sys 0.006s
W20260709 13:16:28.764487 13593 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.540s	user 0.007s	sys 0.000s
W20260709 13:16:28.763383 13585 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.558s	user 0.000s	sys 0.001s
W20260709 13:16:28.767730 13596 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
W20260709 13:16:28.765228 13613 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
W20260709 13:16:28.769999 13604 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:16:28.751389 13614 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.768258 13611 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.458s	user 0.000s	sys 0.001s
W20260709 13:16:28.766566 13598 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:16:28.890156 10591 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.004s
W20260709 13:16:29.065229 10591 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.004s	sys 0.004s
W20260709 13:16:28.894183 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.753304 13489 raft_consensus.cc:697] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:28.750972 13534 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:28.765843 13608 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
W20260709 13:16:28.772652 13595 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.617s	user 0.000s	sys 0.001s
W20260709 13:16:28.773005 13246 consensus_meta.cc:287] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.259s	user 0.006s	sys 0.001s
W20260709 13:16:28.907815 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 149644us
I20260709 13:16:29.071969 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:28.909485 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:28.749462 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:29.074568 10667 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:29.075174 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 266) took 1159 ms. Trace:
I20260709 13:16:29.075519 10667 rpcz_store.cc:276] 0709 13:16:27.915771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.909171 (+993400us) service_pool.cc:224] Handling call
0709 13:16:29.075107 (+165936us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:28.992887 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 284566us
I20260709 13:16:28.995579 13575 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:28.998677 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1744) took 1348 ms. Trace:
W20260709 13:16:29.003084 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 320748us
W20260709 13:16:29.004104 13599 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.383s	user 0.001s	sys 0.008s
I20260709 13:16:29.004766 13547 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:29.005450 13584 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.084159 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:29.064891 13614 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:29.086416 13571 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.563s	user 0.014s	sys 0.000s
I20260709 13:16:29.102059 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1733) took 1585 ms. Trace:
I20260709 13:16:29.102775 10666 rpcz_store.cc:276] 0709 13:16:27.516505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.518541 (+  2036us) service_pool.cc:224] Handling call
0709 13:16:27.518828 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.519020 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.519044 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.519464 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.823677 (+304213us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:27.823712 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.823782 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.101783 (+1278001us) raft_consensus.cc:1685] finished
0709 13:16:29.101806 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.101972 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":303893,"threads_started":1,"wal-append.queue_time_us":420414}
W20260709 13:16:29.013702 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 328657us
W20260709 13:16:29.108079 10708 leader_election.cc:336] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.975s (SENT)
I20260709 13:16:29.082224 13246 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:28.892911 13605 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.607s	user 0.001s	sys 0.000s
W20260709 13:16:29.017510 10741 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.003s	sys 0.014s
I20260709 13:16:29.019043 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 279) took 1015 ms. Trace:
W20260709 13:16:29.023525 10586 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.004s	sys 0.014s
I20260709 13:16:28.894068 13322 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.109025 13627 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.030435 10665 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:28.763685 13565 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.356s
I20260709 13:16:28.965049 13564 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:29.014443 13587 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.764583 13607 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.644s
I20260709 13:16:29.022235 13464 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.020318 13369 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.076866 10668 rpcz_store.cc:276] 0709 13:16:27.649803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.672433 (+ 22630us) service_pool.cc:224] Handling call
0709 13:16:27.672707 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.270149 (+597442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.998404 (+728255us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400182c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:28.998610 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192021248}
I20260709 13:16:29.077167 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:29.073895 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:29.082863 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.084033 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 662384us
I20260709 13:16:29.082044 13586 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:29.110702 10742 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:29.116858 10741 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.003s	sys 0.014s
I20260709 13:16:29.113364 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:29.111155 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 305) took 1874 ms. Trace:
I20260709 13:16:29.117527 10664 rpcz_store.cc:276] 0709 13:16:28.003889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.863561 (+859672us) service_pool.cc:224] Handling call
0709 13:16:29.018968 (+155407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.109244 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 460) took 1522 ms. Trace:
I20260709 13:16:29.108613 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:29.105052 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.120337 10586 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.005s	sys 0.014s
I20260709 13:16:29.120551 13377 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.121743 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1731) took 1606 ms. Trace:
I20260709 13:16:29.122064 10739 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:29.007473 13549 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:29.092725 13478 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:29.093393 13584 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.122076 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1732) took 1605 ms. Trace:
W20260709 13:16:29.122260 10632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.024s	sys 0.025s
I20260709 13:16:29.097379 13539 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:29.256482 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1725) took 3219 ms. Trace:
I20260709 13:16:29.256696 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.258574 10632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.061s	sys 0.062s
W20260709 13:16:29.266130 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 1.18606e+06us
I20260709 13:16:29.265586 10664 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:16:29.267177 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 277) took 1310 ms (client timeout 1705 ms). Trace:
W20260709 13:16:29.267634 10664 rpcz_store.cc:269] 0709 13:16:27.956357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.253734 (+1297377us) service_pool.cc:224] Handling call
0709 13:16:29.267128 (+ 13394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.264444 10666 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:29.258529 10669 rpcz_store.cc:276] 0709 13:16:27.516204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.516774 (+   570us) service_pool.cc:224] Handling call
0709 13:16:27.517070 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.517402 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.517434 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.517872 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.811367 (+293495us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:27.811417 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.811501 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.121846 (+1310345us) raft_consensus.cc:1685] finished
0709 13:16:29.121864 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.122011 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4113,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":293103,"threads_started":1,"wal-append.queue_time_us":757560}
I20260709 13:16:29.261524 10667 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:29.268697 10666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 274) took 1317 ms (client timeout 1708 ms). Trace:
W20260709 13:16:29.268926 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 267) took 1352 ms (client timeout 1709 ms). Trace:
W20260709 13:16:29.269168 10666 rpcz_store.cc:269] 0709 13:16:27.951132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.104706 (+1153574us) service_pool.cc:224] Handling call
0709 13:16:29.268573 (+163867us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:29.269362 10667 rpcz_store.cc:269] 0709 13:16:27.916039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.082587 (+1166548us) service_pool.cc:224] Handling call
0709 13:16:29.268871 (+186284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:29.262816 11381 leader_election.cc:336] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.709s (SENT)
I20260709 13:16:29.257869 11414 rpcz_store.cc:276] 0709 13:16:27.586896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.587006 (+   110us) service_pool.cc:224] Handling call
0709 13:16:27.587272 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.587564 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.587588 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.588016 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.944051 (+356035us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.944116 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.944224 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.003386 (+1059162us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:29.099493 (+ 96107us) raft_consensus.cc:1685] finished
0709 13:16:29.099530 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.109174 (+  9644us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38323,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":11981184,"thread_start_us":355597,"threads_started":1,"wal-append.queue_time_us":788477}
I20260709 13:16:29.241209 10734 rpcz_store.cc:276] 0709 13:16:27.236492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.236608 (+   116us) service_pool.cc:224] Handling call
0709 13:16:27.264199 (+ 27591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.307300 (+ 43101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.307333 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.310586 (+  3253us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.810092 (+499506us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:27.810147 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.810232 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.110943 (+1300711us) raft_consensus.cc:1685] finished
0709 13:16:29.110966 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.111096 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42708,"raft.queue_time_us":81918,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10289,"thread_start_us":470989,"threads_started":1,"wal-append.queue_time_us":645389}
I20260709 13:16:29.265221 10660 rpcz_store.cc:276] 0709 13:16:26.037034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.120790 (+ 83756us) service_pool.cc:224] Handling call
0709 13:16:26.556381 (+435591us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.556784 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.556822 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.595579 (+ 38757us) log.cc:844] Serialized 52 byte log entry
0709 13:16:27.546224 (+950645us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b1800322000. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:27.890047 (+343823us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.940998 (+ 50951us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.941234 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.941339 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.772033 (+830694us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:29.256225 (+484192us) raft_consensus.cc:1685] finished
0709 13:16:29.256249 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.256418 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23983,"prepare.queue_time_us":53673,"raft.queue_time_us":105950,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":19556,"spinlock_wait_cycles":57979648,"thread_start_us":343612,"threads_started":1,"wal-append.queue_time_us":1365648}
W20260709 13:16:29.280483 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 167219us
W20260709 13:16:29.272776 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 164730us
I20260709 13:16:29.258733 10661 rpcz_store.cc:276] 0709 13:16:27.515873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.516008 (+   135us) service_pool.cc:224] Handling call
0709 13:16:27.516313 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.516656 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.516697 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.517242 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.889670 (+372428us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:27.889707 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.889792 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.121559 (+1231767us) raft_consensus.cc:1685] finished
0709 13:16:29.121578 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.121694 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4634,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":371997,"threads_started":1,"wal-append.queue_time_us":574251}
W20260709 13:16:29.176823 13474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.003s	sys 0.025s
W20260709 13:16:29.250340 13558 consensus_meta.cc:287] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.796s	user 0.013s	sys 0.000s
W20260709 13:16:29.109927 13616 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.025s
I20260709 13:16:29.118930 13547 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:29.391327 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:29.328434 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:29.435884 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 358770us
W20260709 13:16:29.256884 13473 consensus_meta.cc:287] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.492s	user 0.009s	sys 0.001s
I20260709 13:16:29.438612 10664 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.255358 13377 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:29.446440 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:29.446909 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118804us
I20260709 13:16:29.393728 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.248000 13586 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:29.217733 13631 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:29.391475 13474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.005s	sys 0.037s
I20260709 13:16:29.445688 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:29.226254 13562 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:29.456501 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:29.220093 13322 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.271071 13549 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:29.271706 13628 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:16:29.448025 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 258) took 1698 ms (client timeout 1947 ms). Trace:
I20260709 13:16:29.400956 13429 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.450088 13377 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.246236 13055 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.149487 13568 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.421525 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1794) took 1079 ms. Trace:
W20260709 13:16:29.327996 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 254170us
I20260709 13:16:29.242239 13575 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:29.454005 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126045us
W20260709 13:16:29.392988 13616 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.016s	sys 0.030s
W20260709 13:16:29.441160 11409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.023s	sys 0.073s
I20260709 13:16:29.455372 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:29.187903 13560 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.458555 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.110790 13571 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:29.432451 13626 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:16:29.397221 13612 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:29.414740 13468 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.443912 13486 raft_consensus.cc:2764] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:29.401762 13578 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:29.395902 13186 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:29.391547 13640 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:29.470892 10668 rpcz_store.cc:269] 0709 13:16:27.749561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.311888 (+1562327us) service_pool.cc:224] Handling call
0709 13:16:29.447960 (+136072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.449734 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:29.266218 13564 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.280489 13369 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.477131 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:29.440585 13558 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.257184 13246 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:29.271167 13539 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.485010 10742 rpcz_store.cc:276] 0709 13:16:28.341848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.685104 (+343256us) service_pool.cc:224] Handling call
0709 13:16:28.706672 (+ 21568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.263748 (+557076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.421235 (+157487us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54003309d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:29.421447 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928720768}
I20260709 13:16:29.457844 13559 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.220557 13489 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.446470 13473 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.524168 10594 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:29.523245 13568 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.573643 13586 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.776005 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:29.785729 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:29.714406 10664 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:29.610631 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1791) took 1269 ms. Trace:
I20260709 13:16:29.547684 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:29.471894 13322 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.787806 10594 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:29.620734 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:29.754974 10736 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:29.791417 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.789220 10741 rpcz_store.cc:276] 0709 13:16:28.341119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.343383 (+  2264us) service_pool.cc:224] Handling call
0709 13:16:28.343737 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.271477 (+927740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.271513 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.271972 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.484954 (+212982us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:29.547270 (+ 62316us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.547495 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.547571 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.556614 (+  9043us) raft_consensus.cc:1685] finished
0709 13:16:29.556634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.610537 (+ 53903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2295,"prepare.queue_time_us":62618,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":302174,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":29153,"spinlock_wait_cycles":4268928,"thread_start_us":1123545,"threads_started":2,"wal-append.queue_time_us":281473}
W20260709 13:16:29.792100 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 269) took 1875 ms (client timeout 1947 ms). Trace:
W20260709 13:16:29.792462 10668 rpcz_store.cc:269] 0709 13:16:27.916643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.619544 (+1702901us) service_pool.cc:224] Handling call
0709 13:16:29.792048 (+172504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.694669 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:29.789044 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 275) took 1837 ms (client timeout 1783 ms). Trace:
W20260709 13:16:29.793749 10664 rpcz_store.cc:269] 0709 13:16:27.951327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.376595 (+1425268us) service_pool.cc:224] Handling call
0709 13:16:29.788978 (+412383us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:29.794914 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 307146us
I20260709 13:16:29.797739 10661 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:16:29.523803 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 76338.3us
W20260709 13:16:29.801563 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 260) took 2004 ms (client timeout 2034 ms). Trace:
W20260709 13:16:29.802090 10661 rpcz_store.cc:269] 0709 13:16:27.796804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.442881 (+1646077us) service_pool.cc:224] Handling call
0709 13:16:29.801513 (+358632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.803303 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.485277 13429 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.790436 10594 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.557588 13550 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.829963 10594 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.806319 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.806202 13474 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:29.736202 13587 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.736585 13607 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.810181 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:29.810789 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1745) took 2160 ms (client timeout 1579 ms). Trace:
I20260709 13:16:29.811190 13639 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:29.811717 13630 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:16:29.456539 13631 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:29.573103 13367 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.287s	user 0.004s	sys 0.003s
I20260709 13:16:29.817370 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.776719 13643 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 13:16:29.820156 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:29.867213 11411 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:29.532683 13576 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.966s	user 0.008s	sys 0.006s
I20260709 13:16:29.828095 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.612589 13612 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:29.612154 13578 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:29.612462 13468 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:29.548092 13623 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.533041 13556 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.612430 13186 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:29.781805 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44884 (request call id 382) took 1095 ms. Trace:
W20260709 13:16:29.860572 10662 rpcz_store.cc:269] 0709 13:16:27.650119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.650321 (+   202us) service_pool.cc:224] Handling call
0709 13:16:29.810601 (+2160280us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002da854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:29.810716 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727434624}
I20260709 13:16:29.862020 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.889407 10668 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:29.889990 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 257) took 2149 ms (client timeout 2206 ms). Trace:
W20260709 13:16:29.890302 10668 rpcz_store.cc:269] 0709 13:16:27.740717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.813583 (+2072866us) service_pool.cc:224] Handling call
0709 13:16:29.889939 (+ 76356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.889430 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.863744 10664 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:29.629630 13345 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.865810 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.892360 10661 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:29.892791 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 259) took 2110 ms (client timeout 2245 ms). Trace:
W20260709 13:16:29.893086 10661 rpcz_store.cc:269] 0709 13:16:27.782645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.821479 (+2038834us) service_pool.cc:224] Handling call
0709 13:16:29.892742 (+ 71263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.893959 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.872288 13654 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:16:29.787499 13549 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.787273 13246 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:29.805660 13423 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.822331 13635 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:16:29.741801 13559 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.878577 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:29.819408 13651 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.901968 10742 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.878832 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:29.902510 10741 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.632056 13539 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.883247 10594 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:29.891669 10662 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:16:29.910265 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 262) took 2081 ms (client timeout 2246 ms). Trace:
I20260709 13:16:29.895787 11411 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:29.894552 10661 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
W20260709 13:16:29.896194 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 271) took 1950 ms (client timeout 2034 ms). Trace:
I20260709 13:16:29.893587 13648 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:29.884359 13623 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.901151 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:29.864283 13573 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:29.716950 13640 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.869864 13367 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.912112 13624 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.910626 10662 rpcz_store.cc:269] 0709 13:16:27.828502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.889169 (+2060667us) service_pool.cc:224] Handling call
0709 13:16:29.910214 (+ 21045us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:29.911775 10664 rpcz_store.cc:269] 0709 13:16:27.945638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.817131 (+1871493us) service_pool.cc:224] Handling call
0709 13:16:29.896142 (+ 79011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.910760 10741 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:29.618000 13547 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.815061 13560 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.926872 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.911646 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 276) took 1955 ms (client timeout 2245 ms). Trace:
W20260709 13:16:29.935585 10661 rpcz_store.cc:269] 0709 13:16:27.956091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.893715 (+1937624us) service_pool.cc:224] Handling call
0709 13:16:29.911597 (+ 17882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.936681 10662 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:16:29.937572 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 278) took 1975 ms (client timeout 2246 ms). Trace:
W20260709 13:16:29.938133 10662 rpcz_store.cc:269] 0709 13:16:27.961938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.926628 (+1964690us) service_pool.cc:224] Handling call
0709 13:16:29.937470 (+ 10842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.940107 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1790) took 1605 ms. Trace:
I20260709 13:16:29.942387 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.943925 10742 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:29.940461 10737 rpcz_store.cc:276] 0709 13:16:28.334767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.334942 (+   175us) service_pool.cc:224] Handling call
0709 13:16:28.335282 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.630971 (+295689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.631015 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.646624 (+ 15609us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.073514 (+426890us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.073550 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.073612 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.939933 (+866321us) raft_consensus.cc:1685] finished
0709 13:16:29.939954 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.940059 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39600,"raft.queue_time_us":299300,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":14494,"thread_start_us":676031,"threads_started":2,"wal-append.queue_time_us":560665}
I20260709 13:16:29.947835 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:29.918640 13537 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 2.293s	user 0.008s	sys 0.004s
I20260709 13:16:29.945696 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:29.947919 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.949303 10742 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:29.956108 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:29.944186 10741 raft_consensus.cc:2393] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:29.866820 13550 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.912732 13055 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:29.888811 13556 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.956116 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.960382 10742 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:29.877472 13607 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.961159 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:29.879549 13576 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:29.934486 13584 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.914084 13651 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.906095 13423 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.912271 13559 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.943523 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1750) took 2292 ms. Trace:
I20260709 13:16:29.906240 13246 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.906368 13549 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.902235 13468 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.916081 13578 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:29.961827 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:30.340446 10741 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:30.010283 10660 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:30.341252 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:30.007905 10665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 273) took 2057 ms (client timeout 1525 ms). Trace:
I20260709 13:16:30.342607 10741 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:16:30.342669 10665 rpcz_store.cc:269] 0709 13:16:27.950895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.960187 (+  9292us) service_pool.cc:224] Handling call
0709 13:16:30.007690 (+2047503us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54002c01d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:30.007824 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200016256}
I20260709 13:16:30.006611 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1796) took 1664 ms. Trace:
I20260709 13:16:29.973485 10737 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:30.344125 10736 rpcz_store.cc:276] 0709 13:16:28.343492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.064618 (+721126us) service_pool.cc:224] Handling call
0709 13:16:29.081341 (+ 16723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.805171 (+723830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.006339 (+201168us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54001586d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:30.006542 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548591872}
W20260709 13:16:30.326619 11381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.007s
W20260709 13:16:30.345366 11381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.008s
I20260709 13:16:29.974030 10664 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:30.345897 10737 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:16:30.345938 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 560253us
I20260709 13:16:30.346817 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:30.340586 10662 rpcz_store.cc:276] 0709 13:16:27.651560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.942851 (+2291291us) service_pool.cc:224] Handling call
0709 13:16:29.943092 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.943241 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.943276 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.943313 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.943344 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.943392 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.943478 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.346170 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1747) took 2695 ms. Trace:
I20260709 13:16:30.349073 10664 rpcz_store.cc:276] 0709 13:16:27.650714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.942101 (+2291387us) service_pool.cc:224] Handling call
0709 13:16:29.973801 (+ 31700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.345962 (+372161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.346122 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.350317 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.351142 10664 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:30.351778 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1784) took 2034 ms. Trace:
I20260709 13:16:30.353466 10738 rpcz_store.cc:276] 0709 13:16:28.317386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.317541 (+   155us) service_pool.cc:224] Handling call
0709 13:16:28.317901 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.381080 (+ 63179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.381111 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.381552 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.809169 (+1427617us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b180039c400. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:29.952221 (+143052us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:29.952746 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.952821 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.351521 (+398700us) raft_consensus.cc:1685] finished
0709 13:16:30.351539 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.351727 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15558,"raft.queue_time_us":66585,"raft.run_cpu_time_us":20344,"raft.run_wall_time_us":134040,"spinlock_wait_cycles":135574912,"thread_start_us":194396,"threads_started":2,"wal-append.queue_time_us":1866969}
I20260709 13:16:30.355471 10738 pending_rounds.cc:85] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 3
I20260709 13:16:30.355751 10738 pending_rounds.cc:107] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:30.355993 10738 raft_consensus.cc:2889] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:30.349258 11381 connection.cc:256] RPC call timeout handler was delayed by -1.0327355579997857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 13:16:29.954340 13648 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.950469 13186 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:29.944989 13624 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:30.470875 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.618404 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:30.590216 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 232978us
I20260709 13:16:30.466878 10735 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:30.730685 10665 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:30.379182 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.998070 13555 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 2.115s	user 0.008s	sys 0.004s
I20260709 13:16:30.357858 13571 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:30.261015 13627 consensus_meta.cc:287] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.099s	user 0.008s	sys 0.002s
W20260709 13:16:29.997540 10543 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.020s	sys 0.008s
I20260709 13:16:30.344411 13550 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:30.121904 13310 consensus_meta.cc:287] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 2.023s	user 0.008s	sys 0.004s
I20260709 13:16:30.429909 13322 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:29.958249 13563 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.332757 12825 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.317s	user 0.011s	sys 0.000s
W20260709 13:16:30.324795 13377 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:16:30.463487 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:30.425240 13560 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.481921 13559 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.482198 13666 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:30.432118 13669 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.421963 13667 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:30.729405 13423 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.735785 13482 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.735685 11381 leader_election.cc:336] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.947s (SENT)
I20260709 13:16:30.835732 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:30.836839 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 101173us
W20260709 13:16:30.837590 11381 leader_election.cc:336] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.034s (SENT)
I20260709 13:16:30.838048 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:30.839295 11381 leader_election.cc:336] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.206s (SENT)
I20260709 13:16:30.839807 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:30.156863 13426 consensus_meta.cc:287] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.464s	user 0.011s	sys 0.000s
W20260709 13:16:30.155187 13657 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 13:16:30.003465 13566 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:16:30.152467 13572 consensus_meta.cc:287] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.959s	user 0.010s	sys 0.001s
I20260709 13:16:30.422083 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:29.998194 13658 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:30.739060 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:30.195298 13660 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:16:30.095790 13632 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
W20260709 13:16:30.045342 13649 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:16:30.148422 13538 consensus_meta.cc:287] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.796s	user 0.009s	sys 0.000s
I20260709 13:16:30.780714 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:30.198264 13645 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:16:30.153769 13631 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:30.430074 13042 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.465s	user 0.010s	sys 0.000s
I20260709 13:16:30.161178 13369 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:30.690876 13655 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.259s	user 0.001s	sys 0.001s
I20260709 13:16:30.342343 13539 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.812822 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.895063 10665 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:30.731496 13578 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.724141 13468 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.821605 12825 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.005987 13587 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.427876 13556 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:30.365945 13584 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:30.427165 13558 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:29.888700 11409 rpcz_store.cc:276] 0709 13:16:28.685969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.688241 (+  2272us) service_pool.cc:224] Handling call
0709 13:16:28.750700 (+ 62459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.757387 (+  6687us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:28.779740 (+ 22353us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.715488 (+935748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.753951 (+ 38463us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:29.781452 (+ 27501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.781562 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.781732 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6473,"prepare.queue_time_us":3736,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":78771,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":753991,"threads_started":1,"wal-append.queue_time_us":728371,"wal-append.run_cpu_time_us":1026,"wal-append.run_wall_time_us":1001066}
I20260709 13:16:30.898248 12825 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.733449 13474 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:30.480656 13607 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.898854 13474 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.900993 13474 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:30.812009 10543 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.296s	user 0.034s	sys 0.016s
I20260709 13:16:30.901432 13651 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.737180 13623 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:29.977697 13055 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:30.813048 13614 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.690s	user 0.017s	sys 0.000s
I20260709 13:16:30.782204 13627 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7.
I20260709 13:16:30.812659 13186 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.903821 13614 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.905921 13614 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.906688 10668 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:30.824290 13377 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:30.907399 13601 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 2.355s	user 0.000s	sys 0.006s
I20260709 13:16:30.908663 13377 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:30.908740 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 270) took 2975 ms (client timeout 2206 ms). Trace:
W20260709 13:16:30.909183 10668 rpcz_store.cc:269] 0709 13:16:27.932938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.890863 (+1957925us) service_pool.cc:224] Handling call
0709 13:16:30.908561 (+1017698us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b5400368154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:30.908675 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276398464}
W20260709 13:16:30.866580 11381 leader_election.cc:336] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.245s (SENT)
I20260709 13:16:30.814363 13310 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.743528 13555 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.919915 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:30.920477 10665 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.920893 13055 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:30.921072 13555 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:30.870559 10664 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:30.922204 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.922725 10664 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:30.735895 13648 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:30.923439 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:30.924109 10664 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:30.924804 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.925146 13648 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:30.925547 10664 raft_consensus.cc:2410] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:30.835012 13559 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.843876 13550 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:30.889966 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:30.822191 13563 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.834801 13666 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.845031 13426 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.834384 13667 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:30.874023 13538 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.853040 13482 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:30.870070 13572 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.822141 10741 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:30.902629 13624 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:30.913818 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 295506us
I20260709 13:16:30.914028 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:30.865753 13489 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.896368 13042 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:30.923463 10740 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:30.844238 13322 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.841351 13669 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:31.013541 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 146985us
I20260709 13:16:31.013484 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:30.972658 10587 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:31.017993 11381 leader_election.cc:336] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.246s (SENT)
I20260709 13:16:30.942502 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.018507 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:31.018939 10668 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:31.019755 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.020516 13648 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:31.020754 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:31.016855 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 140083us
I20260709 13:16:30.932022 10665 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:31.001910 13549 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.023172 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.016105 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1329) took 1192 ms. Trace:
W20260709 13:16:30.970394 13645 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:31.023818 10741 rpcz_store.cc:276] 0709 13:16:29.823883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.343554 (+519671us) service_pool.cc:224] Handling call
0709 13:16:31.016058 (+672504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.024124 10665 raft_consensus.cc:2410] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:31.025883 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.026916 10664 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:31.029161 10668 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:31.030663 10662 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:31.045234 13310 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.017309 13550 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:31.045811 13650 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.068s	user 0.005s	sys 0.010s
I20260709 13:16:31.048830 13639 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:31.049263 13639 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.053838 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1738) took 3417 ms. Trace:
I20260709 13:16:31.054344 10663 rpcz_store.cc:276] 0709 13:16:27.636149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.636275 (+   126us) service_pool.cc:224] Handling call
0709 13:16:27.636512 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.090437 (+453925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.053520 (+2963083us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400322b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:31.053748 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873480064}
I20260709 13:16:31.056201 10663 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:31.056936 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1753) took 3404 ms. Trace:
I20260709 13:16:31.059988 13473 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:31.067866 13564 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.071796 13640 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:31.022890 13055 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.016379 13667 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.057305 10663 rpcz_store.cc:276] 0709 13:16:27.652364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.055558 (+3403194us) service_pool.cc:224] Handling call
0709 13:16:31.055975 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.056650 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.056878 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.022680 13627 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.024123 13651 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:31.089457 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1342) took 1261 ms. Trace:
I20260709 13:16:31.097240 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1754) took 3444 ms. Trace:
I20260709 13:16:31.096117 13669 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.028537 13559 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:31.109310 10665 rpcz_store.cc:276] 0709 13:16:27.652632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.096405 (+3443773us) service_pool.cc:224] Handling call
0709 13:16:31.096727 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.096923 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.096950 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.096996 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.097035 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.097088 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.097186 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.108785 10738 rpcz_store.cc:276] 0709 13:16:29.827931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.354976 (+527045us) service_pool.cc:224] Handling call
0709 13:16:30.355261 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:30.464505 (+109244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.464552 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:30.722918 (+258366us) log.cc:844] Serialized 52 byte log entry
0709 13:16:30.896671 (+173753us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.078945 (+182274us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.079514 (+   569us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.089028 (+  9514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.089130 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.089183 (+    53us) raft_consensus.cc:1685] finished
0709 13:16:31.089201 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.089389 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82551,"prepare.queue_time_us":114775,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":1278,"raft.queue_time_us":41798,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":32867,"thread_start_us":179649,"threads_started":2,"wal-append.queue_time_us":243214}
I20260709 13:16:31.100742 13576 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:31.116595 10663 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:31.117200 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1755) took 3464 ms. Trace:
I20260709 13:16:31.117511 10663 rpcz_store.cc:276] 0709 13:16:27.652887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.110516 (+3457629us) service_pool.cc:224] Handling call
0709 13:16:31.116280 (+  5764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.116972 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.117151 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.118920 13559 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.121106 13559 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.127086 10665 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:31.128621 13482 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:31.130815 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1416) took 1683 ms. Trace:
I20260709 13:16:31.131168 10587 rpcz_store.cc:276] 0709 13:16:29.448125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.448422 (+   297us) service_pool.cc:224] Handling call
0709 13:16:29.463309 (+ 14887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.018303 (+1554994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.130617 (+112314us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400169254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:31.130763 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3470683520}
I20260709 13:16:31.113152 13651 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.131716 13572 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.133164 13538 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.133425 13651 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.133755 10669 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.134320 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 263) took 3285 ms. Trace:
I20260709 13:16:31.134610 10669 rpcz_store.cc:276] 0709 13:16:27.848500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.133310 (+3284810us) service_pool.cc:224] Handling call
0709 13:16:31.133604 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.134107 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.134260 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:31.136865 13663 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.977s	user 0.000s	sys 0.015s
I20260709 13:16:31.101910 13055 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.130638 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 256) took 3429 ms. Trace:
I20260709 13:16:31.141032 10665 rpcz_store.cc:276] 0709 13:16:27.701298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.113799 (+3412501us) service_pool.cc:224] Handling call
0709 13:16:31.126937 (+ 13138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.127479 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.130590 (+  3111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.102162 13627 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.153193 13426 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.157143 13666 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.157658 10666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:31.158360 10666 raft_consensus.cc:606] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:31.158699 10666 raft_consensus.cc:614] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.159861 10666 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:31.160025 13055 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.161782 13667 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.163676 13639 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.164222 13667 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:31.164664 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.165580 13478 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.166566 13478 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.167037 13478 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.169813 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 281) took 3041 ms. Trace:
I20260709 13:16:31.170173 10586 rpcz_store.cc:276] 0709 13:16:28.128272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.128483 (+   211us) service_pool.cc:224] Handling call
0709 13:16:28.142880 (+ 14397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.143076 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:29.255107 (+1112031us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.045346 (+1790239us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:31.169456 (+124110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.169521 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.169571 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.169659 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.169761 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1711049,"prepare.queue_time_us":956584,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"spinlock_wait_cycles":28507392,"thread_start_us":1314621,"threads_started":2,"wal-append.queue_time_us":658615}
I20260709 13:16:31.173978 10665 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:31.174278 10665 pending_rounds.cc:85] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 4
I20260709 13:16:31.174465 10665 pending_rounds.cc:107] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:31.174660 10665 raft_consensus.cc:2889] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:31.209398 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 1.769e+06us
I20260709 13:16:31.212090 10557 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:31.218358 10588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1872) took 2731 ms (client timeout 2592 ms). Trace:
W20260709 13:16:31.218807 10588 rpcz_store.cc:269] 0709 13:16:28.486517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.537369 (+ 50852us) service_pool.cc:224] Handling call
0709 13:16:31.218164 (+2680795us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540016b054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:31.218280 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841179904}
I20260709 13:16:31.176252 13281 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.221199 13627 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.225309 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 280) took 3135 ms. Trace:
I20260709 13:16:31.225589 10666 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:31.225689 10591 rpcz_store.cc:276] 0709 13:16:28.100192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.127263 (+ 27071us) service_pool.cc:224] Handling call
0709 13:16:28.139396 (+ 12133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.139600 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:29.065673 (+926073us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.441735 (+376062us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.070697 (+1628962us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b180038c860. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:31.156591 (+ 85894us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180038c860. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287 00007f42572d4208
0709 13:16:31.225005 (+ 68414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.225054 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.225104 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.225163 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.225261 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1847120,"prepare.queue_time_us":940805,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":1906105,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7594,"spinlock_wait_cycles":9143808,"thread_start_us":1151498,"threads_started":3,"wal-append.queue_time_us":480134}
I20260709 13:16:31.228073 10665 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:31.231181 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.42968e+06us
I20260709 13:16:31.233820 13627 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.234611 13422 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.235625 13422 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:31.235966 13422 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:31.237963 13253 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:31.239375 13681 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:16:31.240438 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 261) took 3417 ms. Trace:
I20260709 13:16:31.240888 10663 rpcz_store.cc:276] 0709 13:16:27.822872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.118219 (+3295347us) service_pool.cc:224] Handling call
0709 13:16:31.118533 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.125041 (+  6508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.125083 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.129385 (+  4302us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.155641 (+ 26256us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:31.155679 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.155741 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.240207 (+ 84466us) raft_consensus.cc:1685] finished
0709 13:16:31.240225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.240368 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5986,"raft.queue_time_us":6152,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4541,"thread_start_us":25871,"threads_started":1,"wal-append.queue_time_us":26172}
I20260709 13:16:31.229231 13506 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:31.242609 13506 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:31.246322 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:31.248695 13253 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:31.248839 13478 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.249261 13578 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:31.251652 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1749) took 3600 ms. Trace:
I20260709 13:16:31.270663 10661 rpcz_store.cc:276] 0709 13:16:27.651297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.941869 (+2290572us) service_pool.cc:224] Handling call
0709 13:16:30.908677 (+966808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.908836 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.908858 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.908894 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:30.908940 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.908991 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.251502 (+342511us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400368150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:31.251600 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184140160}
I20260709 13:16:31.252081 13566 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:31.254338 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.275640 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.276324 10589 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:31.276520 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.277421 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:31.255497 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:31.256018 13614 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.258728 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.281140 10591 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:31.281538 10594 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:31.282284 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.283044 10594 raft_consensus.cc:2410] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:31.259783 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:31.284546 11411 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:31.261686 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.262378 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.274524 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.275092 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:31.277977 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:31.280483 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.288893 10589 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:31.292130 10588 raft_consensus.cc:2368] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:31.292750 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.286648 10586 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:31.300349 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.303388 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:31.269877 13578 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:31.301110 10588 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:31.307044 10586 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:31.307878 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.311941 10589 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:31.312660 13468 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:16:31.316450 13468 consensus_queue.cc:1243] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:31.316675 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.317420 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.318602 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.318507 10586 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.319027 13614 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:31.319193 10661 raft_consensus.cc:2376] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7. Re-sending same reply.
I20260709 13:16:31.319438 13614 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:31.320046 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.320175 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.313156 13669 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.320254 13614 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.320932 13669 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.321681 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.321990 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.322273 10664 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:31.323074 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.323179 13669 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:31.323549 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.309469 13461 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:31.324364 13461 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:31.325126 13461 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.326063 13461 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:31.328256 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:31.329453 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 73576.5us
I20260709 13:16:31.330453 10661 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:31.316468 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.330775 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:31.325654 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:31.317420 10663 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:31.331292 10665 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:31.323556 10664 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.332690 11381 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:31.335019 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:31.337605 13648 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.313086 13578 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:31.312844 13666 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:31.312929 13591 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:31.336122 13426 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:31.313097 13627 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.336905 13068 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:31.344909 13468 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.347147 13612 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:31.387245 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56874.4us
I20260709 13:16:31.388353 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.335834 13651 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:31.389004 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:31.247417 13506 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.420239 11381 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:31.395933 13648 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.419277 10663 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:31.335065 13586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.031s	sys 0.022s
I20260709 13:16:31.412457 10664 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:31.336479 13669 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:31.393275 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51657.1us
I20260709 13:16:31.406270 13614 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.419494 13468 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:31.429998 13586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.032s	sys 0.023s
I20260709 13:16:31.426994 13669 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.424116 13648 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.434242 13612 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.480865 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.482086 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.482693 10664 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:31.483367 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.483884 10664 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:31.484622 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.445591 13468 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.424444 13489 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.459137 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.490065 10663 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:31.490907 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.405689 13478 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:31.410501 13639 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.429423 13550 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.496114 13550 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.496605 13550 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.500172 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.412992 13666 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.501542 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.502326 10664 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:31.502982 13666 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.503180 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.476946 13669 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.477454 13651 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:31.505892 13651 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.507894 13651 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:31.478895 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.509240 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.510258 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.417966 13591 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:31.454771 13462 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.512713 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:31.486577 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2031) took 1134 ms. Trace:
I20260709 13:16:31.513640 11410 raft_consensus.cc:2410] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:31.513789 10668 rpcz_store.cc:276] 0709 13:16:30.351828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.020540 (+668712us) service_pool.cc:224] Handling call
0709 13:16:31.486293 (+465753us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b54000c2954. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:31.486494 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17303808}
I20260709 13:16:31.493297 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.515606 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:31.516203 10663 raft_consensus.cc:2368] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
I20260709 13:16:31.517046 10663 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:31.514192 13591 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:31.421819 13627 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:31.539366 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.542186 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:31.553655 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.557389 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:31.557969 10742 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:31.567238 10664 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.567356 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:31.570984 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:31.573966 13478 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.574492 13478 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.574892 13478 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.579531 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:31.583547 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:31.584334 10742 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:31.537039 13322 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:31.568912 13620 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.572330 13591 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:32.018060 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.022543 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.025588 13648 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.020s
I20260709 13:16:32.026018 13648 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.029556 13648 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:32.068276 11382 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.593s (SENT) [suppressed 39 similar messages]
I20260709 13:16:32.082042 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2022) took 1796 ms. Trace:
W20260709 13:16:32.083801 10663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.004s
W20260709 13:16:32.084179 10663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.004s
I20260709 13:16:32.083318 10666 rpcz_store.cc:276] 0709 13:16:30.317774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.160623 (+842849us) service_pool.cc:224] Handling call
0709 13:16:31.160897 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.225987 (+ 65090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.080769 (+854782us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54000c3854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.081274 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148242176}
I20260709 13:16:32.089028 10663 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.093767 10663 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:32.097057 10708 connection.cc:256] RPC call timeout handler was delayed by -2.0576774529999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25920000000000004s for a response
W20260709 13:16:32.099686 10708 connection.cc:256] RPC call timeout handler was delayed by -2.0000774529999035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2656s for a response
W20260709 13:16:32.100083 10708 connection.cc:256] RPC call timeout handler was delayed by -1.9673759709999104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:16:32.101444 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1798) took 3645 ms. Trace:
I20260709 13:16:32.101971 10740 rpcz_store.cc:276] 0709 13:16:28.455495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.175735 (+720240us) service_pool.cc:224] Handling call
0709 13:16:29.176099 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.012103 (+1836004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.100841 (+1088738us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540014b754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.101182 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4018151808}
I20260709 13:16:32.104163 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.106093 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.108935 10742 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:32.110401 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:32.111281 10742 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:32.120972 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 310) took 3428 ms. Trace:
I20260709 13:16:32.121552 10734 rpcz_store.cc:276] 0709 13:16:28.692312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.442538 (+750226us) service_pool.cc:224] Handling call
0709 13:16:29.458231 (+ 15693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.739948 (+281717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.739992 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.740048 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:29.740106 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.119215 (+2379109us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002be654. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.119968 (+   753us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.120749 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647258368}
W20260709 13:16:32.128039 10708 connection.cc:256] RPC call timeout handler was delayed by -1.4598920819998966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:16:32.128822 10708 connection.cc:256] RPC call timeout handler was delayed by -1.3725920819997555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:16:32.129068 10708 connection.cc:256] RPC call timeout handler was delayed by -1.3581920819999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:16:32.115247 11382 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.112609 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:32.115867 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:32.139523 13648 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.140518 13648 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.140054 10741 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:32.141445 13648 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.148192 10742 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
W20260709 13:16:32.156280 10708 connection.cc:256] RPC call timeout handler was delayed by -1.1574920819998624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:16:32.156709 10708 connection.cc:256] RPC call timeout handler was delayed by -1.1419810800000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:16:32.157334 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:32.158092 13708 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.158366 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:32.159091 13708 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.160179 13186 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:32.160661 13186 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:32.162271 13322 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:32.164436 13281 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:32.164752 13322 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.165062 13281 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.165361 13648 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.166471 13186 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.168184 13648 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.169143 13186 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.165271 13322 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.170147 13322 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.174484 11382 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:32.178610 13281 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.174783 13708 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.178915 13422 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.180227 13648 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:32.181774 13648 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.182219 13648 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.181173 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.178074 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.193691 13422 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:32.195147 13505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.011s	sys 0.005s
W20260709 13:16:32.195556 13505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.011s	sys 0.005s
I20260709 13:16:32.203286 13489 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.203799 13489 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:32.205543 13708 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.185766 13281 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:32.209475 13710 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:32.209883 13694 raft_consensus.cc:1064] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:16:32.210336 13710 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.206350 13708 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.207942 13712 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.205060 13489 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.213299 13710 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.215543 13708 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.216490 13712 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.223631 13708 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.217250 13489 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.220788 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:32.226478 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.228483 10741 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.213642 13694 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.224335 13708 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:32.234596 13708 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.236730 13506 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:32.237217 13550 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.009s
I20260709 13:16:32.237213 10741 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:32.217931 13482 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.242694 13568 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.240047 13550 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:31.612700 13591 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.273514 13591 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:32.275225 13550 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:32.275678 13478 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.003s
I20260709 13:16:32.276157 13478 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.278704 13478 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:32.279363 13710 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:32.280510 13612 consensus_meta.cc:287] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.009s
I20260709 13:16:32.281656 10592 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:32.272617 13648 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:32.288470 13468 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.751s	user 0.015s	sys 0.001s
I20260709 13:16:32.281606 13322 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:32.284198 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 63557.4us
I20260709 13:16:32.291558 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.299531 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1340) took 2471 ms. Trace:
W20260709 13:16:32.307330 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.305918 13468 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.314631 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.315972 13648 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.300068 10737 rpcz_store.cc:276] 0709 13:16:29.827455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.346892 (+519437us) service_pool.cc:224] Handling call
0709 13:16:30.347137 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.347515 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.347542 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.364741 (+ 17199us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.712071 (+347330us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:30.858820 (+146749us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.859118 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.859212 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.294344 (+1435132us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b180021f5e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:32.298886 (+  4542us) raft_consensus.cc:1685] finished
0709 13:16:32.299030 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.299285 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3733,"prepare.queue_time_us":254372,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":10274,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":101116,"spinlock_wait_cycles":6521344,"thread_start_us":159148,"threads_started":2,"wal-append.queue_time_us":212714}
I20260709 13:16:32.311257 13712 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.317827 13716 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.317780 13712 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:32.318482 13716 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.319065 13716 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.320143 13712 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:32.324273 13322 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.326206 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.326792 10737 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.326891 13708 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:32.329054 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.329655 10742 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:32.338932 10708 leader_election.cc:336] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 2.235s (SENT)
I20260709 13:16:32.339496 10708 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:32.340554 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.343854 10737 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:32.344676 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1752) took 4692 ms. Trace:
I20260709 13:16:32.345055 10660 rpcz_store.cc:276] 0709 13:16:27.652064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.004860 (+2352796us) service_pool.cc:224] Handling call
0709 13:16:30.010017 (+  5157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.341888 (+331871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.344236 (+2002348us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b54002c01d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:32.344481 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10809088}
I20260709 13:16:32.347450 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2013) took 2081 ms. Trace:
I20260709 13:16:32.348631 13468 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.345548 10742 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:32.347816 10669 rpcz_store.cc:276] 0709 13:16:30.266047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.135762 (+869715us) service_pool.cc:224] Handling call
0709 13:16:31.136079 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.136413 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.136443 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.136924 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.166467 (+ 29543us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b18001196e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1
0709 13:16:31.166611 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.249359 (+ 82748us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.249545 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.250017 (+   472us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.002681 (+752664us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18001196e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:32.346968 (+344287us) raft_consensus.cc:1685] finished
0709 13:16:32.346995 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.347244 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142348,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":2957,"raft.queue_time_us":4543,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9802,"spinlock_wait_cycles":58181888,"thread_start_us":101398,"threads_started":2,"wal-append.queue_time_us":19409}
I20260709 13:16:32.348757 13716 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.353698 13708 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.357766 13506 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.358137 13716 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.358408 13506 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.360630 13506 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.361470 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:32.362262 10737 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.381050 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1795) took 4038 ms. Trace:
I20260709 13:16:32.381644 10735 rpcz_store.cc:276] 0709 13:16:28.342085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.858547 (+516462us) service_pool.cc:224] Handling call
0709 13:16:28.908158 (+ 49611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.731057 (+1822899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.380384 (+1649327us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001ce8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.380819 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3584110336}
I20260709 13:16:32.388167 10737 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:16:32.431443 13547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.286s	user 0.015s	sys 0.021s
W20260709 13:16:32.431898 13547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.286s	user 0.015s	sys 0.022s
I20260709 13:16:32.436019 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.437542 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.438179 10660 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.441114 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.442521 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.443778 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:32.444092 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.445832 13563 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.445247 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.446578 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:32.446972 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.447460 10666 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:32.447956 13563 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.448554 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.449728 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:31.610639 13620 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.452033 13620 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.454607 10666 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:32.457993 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.456933 10660 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:32.461621 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.463289 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.466954 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:32.471002 13578 consensus_meta.cc:287] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.057s	user 0.014s	sys 0.002s
I20260709 13:16:32.471527 13578 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.473625 10593 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 5.
I20260709 13:16:32.474258 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.475817 13623 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.476323 13623 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:32.477200 13623 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:32.481026 13669 consensus_meta.cc:287] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.975s	user 0.003s	sys 0.007s
I20260709 13:16:31.575095 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.482579 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.494236 13669 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.494678 13622 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:32.495066 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 919863us
I20260709 13:16:32.496634 10660 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:32.492533 13578 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:32.497608 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.519831 13622 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.521126 10559 leader_election.cc:400] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
I20260709 13:16:32.521452 10559 leader_election.cc:403] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:16:32.505390 10667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.002s	sys 0.007s
I20260709 13:16:32.513468 13563 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.514810 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.517561 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1800) took 3866 ms. Trace:
I20260709 13:16:32.523520 13563 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.524501 13547 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:32.527017 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.527374 13586 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.528076 13042 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:32.528697 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.528759 13563 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:32.529526 10667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.002s	sys 0.010s
I20260709 13:16:32.523885 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.533397 10660 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.523010 13620 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.536283 13547 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
I20260709 13:16:32.538540 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1777) took 1064 ms. Trace:
I20260709 13:16:32.536878 13620 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.540019 10666 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:32.540732 13620 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.522868 10739 rpcz_store.cc:276] 0709 13:16:28.651477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.243340 (+591863us) service_pool.cc:224] Handling call
0709 13:16:29.244184 (+   844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.447461 (+203277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.447492 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.830733 (+1383241us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800443080. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a
0709 13:16:30.831806 (+  1073us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2c0006cc38. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:30.832433 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.867069 (+ 34636us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:30.867106 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.517033 (+1649927us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540036d8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.517095 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.517158 (+    63us) raft_consensus.cc:1685] finished
0709 13:16:32.517169 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.517397 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4668,"raft.queue_time_us":5050,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4883,"spinlock_wait_cycles":489504384,"thread_start_us":34189,"threads_started":1,"wal-append.queue_time_us":34197,"wal-append.run_cpu_time_us":2351,"wal-append.run_wall_time_us":1013491}
I20260709 13:16:32.541246 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.549789 10666 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:32.549727 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:32.550948 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.551167 13642 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.551645 13642 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.542692 10667 rpcz_store.cc:276] 0709 13:16:31.474426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.516925 (+ 42499us) service_pool.cc:224] Handling call
0709 13:16:31.517156 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.517425 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:31.539766 (+ 22341us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.530584 (+990818us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.537953 (+  7369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.538034 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:32.538181 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.538292 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.538480 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51987,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":101,"raft.queue_time_us":7335,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":189,"thread_start_us":989974,"threads_started":1,"wal-append.queue_time_us":269999}
I20260709 13:16:32.552057 13642 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.552575 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.552636 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.553422 10667 raft_consensus.cc:2368] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:16:32.555181 13665 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:32.556200 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.557394 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.558063 10669 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:32.558169 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.558914 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.557570 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:32.559463 10669 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:32.560293 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:32.561132 10560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.012s	sys 0.007s
W20260709 13:16:32.561723 10560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.013s	sys 0.007s
I20260709 13:16:32.561757 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.561240 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.563442 10667 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:32.563885 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.564744 10667 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:32.567900 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:32.575410 10590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.006s	sys 0.022s
I20260709 13:16:32.576731 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:32.577586 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:32.578373 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:32.594027 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.582688 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:32.583132 13711 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
W20260709 13:16:32.592299 10661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.009s	sys 0.035s
W20260709 13:16:32.599596 10661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.011s	sys 0.036s
I20260709 13:16:32.601567 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1763) took 1141 ms. Trace:
I20260709 13:16:32.601998 10661 rpcz_store.cc:276] 0709 13:16:31.459744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.510948 (+ 51204us) service_pool.cc:224] Handling call
0709 13:16:31.511242 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:31.511596 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.511624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:31.512142 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:16:32.600326 (+1088184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:32.600810 (+   484us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.601124 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.601221 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.601260 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:32.601272 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.601498 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3186,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":183,"thread_start_us":1087596,"threads_started":1,"wal-append.queue_time_us":294807}
I20260709 13:16:32.592082 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.605507 13468 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.605849 11411 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:32.606087 13468 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.592669 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.608337 13468 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:32.611444 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.612548 10585 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:32.592326 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.613888 11414 raft_consensus.cc:2368] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:32.614607 11409 raft_consensus.cc:2393] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:16:32.615227 10590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.007s	sys 0.023s
I20260709 13:16:32.615700 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:32.617748 12825 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.011s	sys 0.020s
I20260709 13:16:32.618104 10589 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.616189 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 291) took 1343 ms. Trace:
I20260709 13:16:32.604591 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:32.618180 12825 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.011s	sys 0.020s
I20260709 13:16:32.625048 13461 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.624986 13068 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:32.561125 10669 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:32.625162 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54703.9us
I20260709 13:16:32.630084 10661 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:32.631776 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800136960 after lost signal to thread 9492
I20260709 13:16:32.634811 11409 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:32.637897 13042 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:32.638669 13042 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.645705 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.646584 10585 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.656939 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.657552 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.657931 10594 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.659268 13572 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.659708 13572 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:32.660629 13572 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.641090 13684 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:32.662642 13684 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:32.625689 13622 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.663787 13684 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.666415 13377 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:32.668560 13377 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:32.669571 13506 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:32.671044 13506 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:32.671451 13506 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:32.672178 13639 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.672361 13506 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.672737 13639 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.674146 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1426) took 1376 ms. Trace:
I20260709 13:16:32.674764 13639 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:32.674697 11382 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.620046 10590 rpcz_store.cc:276] 0709 13:16:31.272900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.287662 (+ 14762us) service_pool.cc:224] Handling call
0709 13:16:31.301583 (+ 13921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.301836 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:31.329947 (+ 28111us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.615671 (+1285724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.615749 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:32.615863 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.615959 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.616120 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21940,"prepare.queue_time_us":91257,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":31704,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":1268198,"threads_started":2,"wal-append.queue_time_us":219833,"wal-append.run_cpu_time_us":1222,"wal-append.run_wall_time_us":1010229}
I20260709 13:16:32.676950 10661 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:32.677381 13641 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:32.677892 13641 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:32.678257 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:32.678864 13641 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.680080 10669 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:32.681715 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.674496 10592 rpcz_store.cc:276] 0709 13:16:31.297440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.299046 (+  1606us) service_pool.cc:224] Handling call
0709 13:16:31.299388 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.283895 (+984507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.673914 (+390019us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540008aa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.674093 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257544448}
I20260709 13:16:32.682518 11415 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:32.676982 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.683450 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1331) took 2858 ms. Trace:
I20260709 13:16:32.683799 10736 rpcz_store.cc:276] 0709 13:16:29.824470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.345274 (+520804us) service_pool.cc:224] Handling call
0709 13:16:30.462992 (+117718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.465175 (+  2183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.465216 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.374875 (+1909659us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b2c0006cc38. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:32.375502 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.415779 (+ 40277us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:32.416428 (+   649us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.416664 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.631134 (+214470us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b540036ced4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:32.631167 (+    33us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.631194 (+    27us) raft_consensus.cc:1685] finished
0709 13:16:32.631201 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.683295 (+ 52094us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":192,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"spinlock_wait_cycles":595431680,"thread_start_us":39864,"threads_started":1,"wal-append.queue_time_us":52159}
I20260709 13:16:32.685750 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:32.686408 10739 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:32.687093 13639 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.689731 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.690824 13639 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:32.692741 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:32.657092 10585 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:32.695693 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:32.700477 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.704098 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:32.706128 13547 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:32.719458 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 155715us
I20260709 13:16:32.724088 10660 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:32.700779 13639 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.724781 10669 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.760350 13547 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:32.883566 13547 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.889441 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.893410 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 473) took 1367 ms. Trace:
I20260709 13:16:32.893951 11410 rpcz_store.cc:276] 0709 13:16:31.525749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.537429 (+ 11680us) service_pool.cc:224] Handling call
0709 13:16:32.531837 (+994408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.532394 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:32.532810 (+   416us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.814973 (+282163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.821953 (+  6980us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:32.831255 (+  9302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.892959 (+ 61704us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.893162 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":12710,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3322,"thread_start_us":196099,"threads_started":1}
I20260709 13:16:32.818770 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.896900 11409 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:32.897574 13506 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.899657 13461 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.817961 13367 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:32.818109 10706 connection.cc:256] RPC call timeout handler was delayed by -2.5889861499997551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:16:32.817735 13724 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:16:32.799058 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.701269 13464 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:32.794914 10664 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.227s	user 0.015s	sys 0.003s
I20260709 13:16:32.800254 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:32.918154 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 289) took 1654 ms (client timeout 2026 ms). Trace:
I20260709 13:16:32.919754 13685 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:32.922611 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:32.923960 13566 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.928804 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:32.928325 13656 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:32.930478 11381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.016s	sys 0.012s
I20260709 13:16:32.928371 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:32.935051 13684 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.845707 10594 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:32.781874 13482 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:32.703384 13322 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.802758 10660 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:32.881134 13713 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:16:32.714109 13572 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:32.948839 10593 rpcz_store.cc:269] 0709 13:16:31.263844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.263957 (+   113us) service_pool.cc:224] Handling call
0709 13:16:32.917850 (+1653893us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540037ffd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:32.918053 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713923456}
W20260709 13:16:32.958022 10706 connection.cc:256] RPC call timeout handler was delayed by -2.4962861499998326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:16:32.973078 10706 connection.cc:256] RPC call timeout handler was delayed by -2.4880293979999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25920000000000004s for a response
W20260709 13:16:32.973567 10706 connection.cc:256] RPC call timeout handler was delayed by -2.4304293979998874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2656s for a response
W20260709 13:16:32.973963 10706 connection.cc:256] RPC call timeout handler was delayed by -2.3884148610000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:16:32.974332 10706 connection.cc:256] RPC call timeout handler was delayed by -2.324386149999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 13:16:32.974731 10706 connection.cc:256] RPC call timeout handler was delayed by -2.3029148610000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:16:32.975245 10706 connection.cc:256] RPC call timeout handler was delayed by -2.2012148610001532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:16:32.975631 10706 connection.cc:256] RPC call timeout handler was delayed by -1.9357148609999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:16:32.976153 10706 connection.cc:256] RPC call timeout handler was delayed by -1.8120632879999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:16:32.976557 10706 connection.cc:256] RPC call timeout handler was delayed by -1.7140162739999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:16:32.976926 10706 connection.cc:256] RPC call timeout handler was delayed by -1.3486656399998083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:16:32.977276 10706 connection.cc:256] RPC call timeout handler was delayed by -1.1308551609997721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:16:32.959406 13656 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.952138 10664 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:32.971242 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.984652 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:32.990547 11409 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:32.997365 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:32.956830 13648 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:16:32.960153 13566 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.980418 13656 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:32.981894 13322 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.032733 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:33.033720 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 89979.1us
I20260709 13:16:32.972229 13642 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:32.968196 13464 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.043843 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:33.045291 11381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.016s	sys 0.013s
I20260709 13:16:32.980999 13482 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:32.995203 13683 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:33.028563 13506 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.037705 13322 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.049659 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:33.052269 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 124107us
I20260709 13:16:33.040714 13468 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:33.049858 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.063731 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:33.076750 11409 raft_consensus.cc:2410] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:33.067207 13694 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:33.075542 13573 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.084475 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.085167 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.067011 13468 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:33.098213 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.099941 10666 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.067466 11410 raft_consensus.cc:2376] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10. Re-sending same reply.
I20260709 13:16:33.103619 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.121608 10663 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:33.124305 13726 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:16:33.124935 10665 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:33.129854 13731 log.cc:927] Time spent T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:16:33.132661 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.133832 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.134444 10661 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:33.135417 13576 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.135726 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.136644 10661 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:33.086769 13694 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.142132 10660 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:16:33.143716 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 72779us
I20260709 13:16:33.103030 13639 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:33.148959 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 147881us
I20260709 13:16:33.143402 13367 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.154865 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 116797us
I20260709 13:16:33.158782 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.160966 13464 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.164624 11418 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:33.169616 13648 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:33.170146 13648 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.171109 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 472) took 1783 ms. Trace:
I20260709 13:16:33.171440 11418 rpcz_store.cc:276] 0709 13:16:31.387263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.387481 (+   218us) service_pool.cc:224] Handling call
0709 13:16:31.410608 (+ 23127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.169680 (+1759072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.170834 (+  1154us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54006801d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:33.171057 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4032980224}
I20260709 13:16:33.172156 13648 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.175431 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.176266 13468 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.181803 13566 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.183960 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.189463 13482 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.120268 13656 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.192970 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:33.206447 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49206.9us
I20260709 13:16:33.208218 13669 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.157416 13367 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.189961 13642 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.157625 13639 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.210032 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.210156 13642 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.210587 13620 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:33.211017 13620 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.211205 13573 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.211396 13620 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.211627 13573 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:33.211722 13639 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.212081 13573 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.206881 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.185746 13694 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.226549 13694 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.228632 10668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.647s	user 0.002s	sys 0.022s
I20260709 13:16:33.229127 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 320) took 1123 ms. Trace:
I20260709 13:16:33.211037 10708 leader_election.cc:400] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
W20260709 13:16:33.209525 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.214053 10706 leader_election.cc:400] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:33.230019 10708 leader_election.cc:403] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.230690 10706 leader_election.cc:403] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.235244 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:33.237100 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5ac0 after lost signal to thread 10526
I20260709 13:16:33.229559 10740 rpcz_store.cc:276] 0709 13:16:32.107203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.115317 (+  8114us) service_pool.cc:224] Handling call
0709 13:16:32.115685 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.272148 (+156463us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:32.291100 (+ 18952us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.350054 (+ 58954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.350109 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:32.350164 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.228911 (+878747us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540028df54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:33.228956 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.229073 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33397,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1138,"raft.queue_time_us":14709,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"spinlock_wait_cycles":358865152,"thread_start_us":54357,"threads_started":2,"wal-append.queue_time_us":60594}
I20260709 13:16:33.238010 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:33.239228 10666 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:33.241614 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.242195 10741 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
W20260709 13:16:33.245162 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec120 after lost signal to thread 10618
W20260709 13:16:33.245509 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec2a0 after lost signal to thread 10619
I20260709 13:16:33.246876 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:33.248195 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.250053 10666 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.252321 13576 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.255851 13246 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:33.256968 13322 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:33.257548 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46674.6us
I20260709 13:16:33.258456 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:33.259052 13322 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.260030 13623 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.261734 13246 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.262409 13246 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:33.263127 13246 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:33.263860 13367 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:33.264577 13737 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:33.264981 13737 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:33.265784 13737 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.266968 13737 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:33.269515 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56365.8us
I20260709 13:16:33.274642 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.244205 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.275768 13623 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:16:33.272188 13576 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:33.277297 13623 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:33.278687 13623 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:33.279548 13623 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.278270 13576 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.282434 13042 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.286960 10661 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:33.287843 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58295.6us
W20260709 13:16:33.289124 10668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.708s	user 0.002s	sys 0.023s
I20260709 13:16:33.289080 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.291687 10666 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:33.294021 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 60406.5us
I20260709 13:16:33.294278 13489 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:33.294765 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:33.297677 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2030) took 2946 ms (client timeout 1805 ms). Trace:
W20260709 13:16:33.298043 10662 rpcz_store.cc:269] 0709 13:16:30.351516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.889464 (+537948us) service_pool.cc:224] Handling call
0709 13:16:33.297248 (+2407784us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540012f554. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:33.297482 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238408448}
I20260709 13:16:33.300562 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.301115 10663 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.301769 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.301964 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.310570 10740 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.302893 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1771) took 1830 ms (client timeout 2232 ms). Trace:
I20260709 13:16:33.294814 13489 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:33.297170 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.315028 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.311164 10664 rpcz_store.cc:269] 0709 13:16:31.472757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.502926 (+ 30169us) service_pool.cc:224] Handling call
0709 13:16:33.302694 (+1799768us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54000d2fd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:33.302815 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145993472}
W20260709 13:16:33.327442 10523 debug-util.cc:398] Leaking SignalData structure 0x7b08000dee60 after lost signal to thread 10693
I20260709 13:16:33.329857 10660 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:33.331915 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 88168.9us
I20260709 13:16:33.334115 10660 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:33.333969 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:33.335322 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080032f820 after lost signal to thread 10767
I20260709 13:16:33.297696 13639 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:33.340441 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800405700 after lost signal to thread 11442
W20260709 13:16:33.344060 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800405720 after lost signal to thread 11443
W20260709 13:16:33.344638 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800405920 after lost signal to thread 13369
I20260709 13:16:33.326352 13669 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:33.349143 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 102326us
W20260709 13:16:33.350518 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800405be0 after lost signal to thread 13549
I20260709 13:16:33.330623 13461 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:33.326417 13648 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.341084 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:33.342199 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 82455.3us
W20260709 13:16:33.353765 10523 debug-util.cc:398] Leaking SignalData structure 0x7b0800405de0 after lost signal to thread 13584
W20260709 13:16:33.354220 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79651.2us
I20260709 13:16:33.354168 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:33.356384 13550 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:33.356556 13683 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:33.346146 13639 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:33.347533 13669 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:33.364950 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.365906 13742 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:33.366065 13620 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.366465 13742 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:33.367020 10557 leader_election.cc:336] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Timed out: RequestConsensusVote RPC to 127.9.68.68:35619 timed out after 1.554s (SENT)
I20260709 13:16:33.367370 13742 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.368155 13620 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.367460 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:33.371759 10523 debug-util.cc:398] Leaking SignalData structure 0x7b080033c300 after lost signal to thread 13668
I20260709 13:16:33.362236 13550 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:33.374346 13550 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.375813 13550 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.380541 13572 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:33.380968 13572 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.384516 13639 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.391681 10740 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:33.381346 13572 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.355235 13684 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:33.398085 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.400060 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.402282 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.405721 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.406354 13186 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:33.406786 13186 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.406898 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.407562 10739 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.407802 13186 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.409915 12825 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.411938 12825 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:33.412856 12825 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.413164 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.386662 13743 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:33.412878 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.414106 13623 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.361405 13648 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:33.413247 12825 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.414826 13648 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.415366 12825 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.369542 13669 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.416940 12825 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.417925 13684 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.420014 13684 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:33.422222 10740 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:33.422274 13736 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:33.422889 13736 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.423659 13736 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.424989 13736 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.435438 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.425426 13489 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.459801 10735 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.461054 10738 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.461431 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.462236 10591 raft_consensus.cc:2410] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:33.462687 10738 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [2.4-7.6]
I20260709 13:16:33.463356 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.466174 10663 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:33.467764 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.476331 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.409224 13186 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.485988 10738 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:33.485831 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.492830 10661 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:33.494043 11415 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:33.485162 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.434602 13641 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.501143 10742 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.490126 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.501813 10665 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.502902 10737 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:33.504030 10735 raft_consensus.cc:2368] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
W20260709 13:16:33.506699 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71342.9us
I20260709 13:16:33.507519 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.513922 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.514659 10591 raft_consensus.cc:2368] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
I20260709 13:16:33.517789 13576 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.518471 13576 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.399009 13573 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.525992 13573 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.526778 10740 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:33.527281 13641 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:33.528335 13641 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.531610 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1765) took 2071 ms. Trace:
I20260709 13:16:33.532025 13669 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.387200 13683 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.498929 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.531975 10668 rpcz_store.cc:276] 0709 13:16:31.460243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.514786 (+ 54543us) service_pool.cc:224] Handling call
0709 13:16:31.538613 (+ 23827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.538807 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:33.291570 (+1752763us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.486353 (+194783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.497286 (+ 10933us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:33.502048 (+  4762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.502123 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.531560 (+ 29437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30950,"prepare.queue_time_us":87099,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":10882,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9303,"thread_start_us":1831245,"threads_started":2,"wal-append.queue_time_us":172107}
I20260709 13:16:33.535211 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.505929 11414 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:33.538352 10665 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:33.534742 10734 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 4.
I20260709 13:16:33.540633 11409 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:33.471200 13482 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:16:33.546782 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.555233 13648 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.565503 13743 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.566926 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.568375 13669 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:33.582201 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 72919.5us
I20260709 13:16:33.583961 10591 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:33.586885 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.594245 10742 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:33.594329 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.595144 10734 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.597915 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.598989 10589 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:33.609431 10739 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:33.610956 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.619980 10743 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.627071 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.606904 13042 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:33.640419 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:33.643043 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.643728 10591 raft_consensus.cc:2368] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:33.645970 10734 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:33.642879 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.645118 10665 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:33.663420 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.647382 13683 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.670360 10706 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.672451 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:33.662624 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.667963 10662 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:33.668123 10736 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.657958 13573 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:33.677806 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.678025 13737 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.678437 13743 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:33.685642 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.686379 13627 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.682778 13746 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.661011 13747 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.692073 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.690353 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.717342 10586 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:33.710217 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.647933 13742 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:33.711632 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.688776 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.654402 13042 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.717250 10589 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:33.690366 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.710599 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.736063 10736 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:33.736303 10585 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:33.742930 11415 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:33.744088 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.746150 13641 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:33.746774 13641 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:33.747892 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 85375.6us
I20260709 13:16:33.801515 11409 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:33.714699 13746 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.716805 13576 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.802608 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:33.804154 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.716993 13573 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:33.807449 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 142338us
I20260709 13:16:33.808449 13742 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:33.809178 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.809684 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:33.810029 13683 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.810542 11412 raft_consensus.cc:2410] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:33.810868 13683 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:33.811409 10560 leader_election.cc:400] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
I20260709 13:16:33.811772 10560 leader_election.cc:403] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.811878 13683 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:33.812403 13683 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:33.812491 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 140136us
I20260709 13:16:33.812736 12825 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.802840 13572 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.813364 10706 leader_election.cc:400] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:33.813717 10706 leader_election.cc:403] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.814793 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.813225 13683 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.816119 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.816486 13683 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.817457 13648 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.805585 13746 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.814888 13572 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:33.812012 13641 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:33.819873 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.823053 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.811292 10593 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:33.823608 10586 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:33.779412 13322 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.823657 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.802963 13737 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.827654 13486 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.827610 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.842231 10590 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:33.828321 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.828612 13573 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.829439 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.833577 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.834458 10661 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:33.834829 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.837383 12825 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:33.839490 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 59628.4us
W20260709 13:16:33.844362 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 95727.7us
I20260709 13:16:33.848392 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.846433 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.848977 10593 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:33.840343 13567 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:33.855737 10589 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:33.851732 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.853390 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:33.851622 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 142273us
W20260709 13:16:33.859380 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.856825 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.843750 13377 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.863818 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.862726 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:33.850749 12825 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.871500 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:33.875687 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.876412 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.883757 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.884745 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.885749 10589 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:33.890275 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:33.890689 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.891287 13246 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:33.892046 13246 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:33.892882 13751 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:33.894287 13246 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.895358 10735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:33.895990 13068 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:33.896396 10735 raft_consensus.cc:606] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.896952 10735 raft_consensus.cc:614] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:33.859699 13641 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.851490 13762 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:33.896476 13068 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.863463 13576 raft_consensus.cc:2764] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:33.847347 13684 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:33.866420 13482 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.847795 13322 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:33.851627 13746 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.881479 12825 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.872951 13377 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.865423 13743 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.912470 10741 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:33.901862 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.907500 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.875733 13567 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:33.910665 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.903213 13186 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:33.864463 13648 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:33.914752 10742 raft_consensus.cc:2410] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:33.863595 13627 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:33.863365 13572 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:16:33.908543 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48395.6us
I20260709 13:16:33.915266 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.928269 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.928635 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.930368 10587 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:33.925601 10635 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.528s (SENT)
I20260709 13:16:33.942006 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.933677 13042 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:33.915494 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.920506 13068 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.946661 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:33.944979 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.951911 13648 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:33.919816 13322 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:33.940325 11379 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.905423 13737 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:33.959300 10736 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:33.967383 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.959555 10735 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:33.968814 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.959568 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.961866 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.965602 11418 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:33.966109 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:33.966502 10585 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.967389 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:33.969488 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.977046 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:33.981899 13068 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.982154 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:33.982787 13186 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:33.983726 13186 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:33.984678 10739 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:33.986006 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:33.990679 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:33.991978 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:33.992208 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51966.9us
I20260709 13:16:33.992735 10589 raft_consensus.cc:2410] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:33.992391 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.992898 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:33.993216 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.993817 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.915336 13377 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.993953 11379 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:33.984889 10591 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:33.918402 13684 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.003554 13684 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:34.004631 13684 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.005564 10743 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.006096 13684 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.006409 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.007671 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.995730 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.996097 10589 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:34.008373 10743 raft_consensus.cc:2410] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:33.996235 13572 consensus_queue.cc:1243] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer e71e2e44af1e46d8a8423ae08646bc22 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:33.996646 13419 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.996866 13482 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.997283 13489 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:33.998330 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54066.5us
I20260709 13:16:33.998734 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:33.926561 13620 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:34.001335 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.002046 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.009142 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.009199 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.010236 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.016506 10587 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:34.017172 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.029515 10742 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:34.030901 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63595.4us
I20260709 13:16:34.056571 10735 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:34.031970 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 55072.2us
I20260709 13:16:34.061108 10585 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:34.061797 10594 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:34.062651 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.066617 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.028827 13627 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.068557 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.011453 13419 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:34.030525 13669 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:34.101630 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.094604 10737 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:34.095072 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 169501us
I20260709 13:16:34.072119 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.100878 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.030220 13620 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:34.055673 13482 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:34.106603 10741 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:34.109655 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.110493 10742 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.111132 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.112040 10734 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.104187 10743 raft_consensus.cc:2376] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6. Re-sending same reply.
I20260709 13:16:34.099639 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.065874 13612 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:34.016451 13506 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:16:34.126677 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.135129 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.135833 10742 raft_consensus.cc:2368] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8.
I20260709 13:16:34.136574 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.070865 13694 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:16:34.149195 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.150050 10735 raft_consensus.cc:2410] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:34.145510 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.150970 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.147222 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.157015 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.157737 10742 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:34.158380 10743 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.158607 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.161571 10742 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:34.131843 13612 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:34.165899 10742 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:34.151566 10734 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:34.171028 10737 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
W20260709 13:16:34.171568 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 101830us
W20260709 13:16:34.179610 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 114237us
I20260709 13:16:34.155215 11410 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:34.156445 13506 consensus_queue.cc:1243] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:34.184762 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.185827 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.199990 13042 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:34.200416 13042 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:34.177582 13612 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:34.201761 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.201859 10743 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:34.206580 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.211621 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106505us
W20260709 13:16:34.212846 10635 leader_election.cc:336] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.608s (SENT)
I20260709 13:16:34.213785 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.214685 13774 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:34.216284 10635 leader_election.cc:336] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.511s (SENT)
I20260709 13:16:34.216864 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.218654 13774 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:34.220175 10635 leader_election.cc:336] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.519s (SENT)
W20260709 13:16:34.221415 10635 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.659s (SENT)
I20260709 13:16:34.221978 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.222995 13774 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:34.224781 10635 leader_election.cc:336] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.698s (SENT)
I20260709 13:16:34.225672 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.228205 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:34.181733 13468 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.182745 13746 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:34.189607 10741 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:34.197168 13486 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6.
I20260709 13:16:34.262214 13627 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:34.176776 13620 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.262857 13627 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.263425 13620 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.265638 13627 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:34.229188 10667 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:34.260380 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.261433 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:34.272614 10632 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:34.273826 13758 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:16:34.273880 13772 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:34.201458 13683 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:34.278860 10635 leader_election.cc:336] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.629s (SENT)
I20260709 13:16:34.192209 13419 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.279862 13468 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.113451 13567 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.282330 12825 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.142797 13737 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.288625 13747 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:34.230278 13547 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.265903 10743 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:34.267339 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.326985 11382 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.330621 10734 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.332679 13656 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.308516 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:34.333896 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 55079.2us
W20260709 13:16:34.334481 10635 leader_election.cc:336] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.679s (SENT)
I20260709 13:16:34.334818 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:34.335850 10635 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.724s (SENT)
I20260709 13:16:34.336210 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.315614 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.337855 13669 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.338521 13669 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.338892 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.339177 13669 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.339470 13468 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:34.339895 13669 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.341017 10586 raft_consensus.cc:2393] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:34.248698 13622 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:16:34.341980 12825 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:34.339479 10742 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:34.313308 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 132335us
I20260709 13:16:34.318800 10662 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:34.323367 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.324913 10665 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:34.325994 10661 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:34.307660 13683 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:34.308674 13482 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:34.422408 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:34.396905 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77136us
W20260709 13:16:34.378711 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 170028us
I20260709 13:16:34.433624 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.434301 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:34.391777 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48334.9us
I20260709 13:16:34.434338 10585 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:34.330183 13627 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:34.396528 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 47663.8us
I20260709 13:16:34.439947 10587 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:34.429306 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.363395 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.440881 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.393049 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:34.444290 10661 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:34.323174 13747 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:34.484956 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 50751.4us
I20260709 13:16:34.485744 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.441385 10743 raft_consensus.cc:2376] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5. Re-sending same reply.
I20260709 13:16:34.451057 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.486683 10742 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
W20260709 13:16:34.459964 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.402249 13781 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.475865 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:34.259078 13042 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.357052 13419 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.484845 10585 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:34.475896 13774 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.342919 13547 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:34.474335 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.357002 13622 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:34.506564 10661 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:34.507014 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:34.507402 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:34.507577 10666 raft_consensus.cc:2376] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7. Re-sending same reply.
W20260709 13:16:34.509892 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 174057us
I20260709 13:16:34.510980 10664 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:34.511933 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:34.512713 13464 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:34.513055 13464 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:34.495982 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.515806 10741 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:34.422366 13486 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.497745 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 182217us
I20260709 13:16:34.445447 10737 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.397783 13468 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:16:34.521543 13787 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:34.522159 13787 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:34.522282 13773 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.340s	user 0.006s	sys 0.000s
I20260709 13:16:34.523109 13787 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.524290 10591 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:34.358772 13683 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.525490 13683 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.527127 10736 raft_consensus.cc:2376] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6. Re-sending same reply.
I20260709 13:16:34.530551 13746 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.499271 10742 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:16:34.499498 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 59086.1us
I20260709 13:16:34.532514 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:34.500510 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.485620 13627 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:34.422628 13778 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:16:34.502548 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.517189 12825 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:34.513432 13464 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.518424 10739 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:34.534072 10590 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:34.564919 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.581374 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.592669 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.593585 10590 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:34.594451 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:34.594946 10590 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:34.599428 13377 consensus_meta.cc:287] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.006s
I20260709 13:16:34.599846 13377 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.603817 13464 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:34.534513 10635 leader_election.cc:336] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.827s (SENT)
I20260709 13:16:34.535991 10585 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:34.605238 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.605749 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:34.606202 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 71748.6us
I20260709 13:16:34.606513 10585 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:34.606797 10635 leader_election.cc:336] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.864s (SENT)
I20260709 13:16:34.607317 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:34.607710 10635 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Timed out: RequestConsensusVote RPC to 127.9.68.67:32771 timed out after 1.940s (SENT)
I20260709 13:16:34.608117 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.608716 10585 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:34.537703 10706 leader_election.cc:400] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6.
W20260709 13:16:34.609740 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 77814.3us
I20260709 13:16:34.610339 10706 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:34.610471 13738 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:34.610829 13464 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:34.611478 13464 raft_consensus.cc:2764] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:34.611510 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:34.534017 13506 consensus_queue.cc:1175] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "18f1a9f5e66846dba474825fb5b2b784" responder_term: 7 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:34.538493 10660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:34.613579 10660 raft_consensus.cc:606] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:34.614281 10660 raft_consensus.cc:614] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:34.538712 13486 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.541790 13322 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:34.503901 13622 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:34.519587 13782 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:16:34.539775 13783 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.546132 13482 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.548497 10734 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:34.548822 13042 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:34.549919 13627 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.550963 13639 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:34.633911 12825 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:34.634433 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.552919 13747 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.556372 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.558636 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:34.559903 11410 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:34.560534 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:34.612844 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.629638 10743 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 5: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:34.641090 10587 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:34.632232 10662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:34.632683 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.641856 10662 raft_consensus.cc:606] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:34.632930 13464 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.639149 13776 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.633528 13783 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.657763 10589 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:34.639950 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 119227us
I20260709 13:16:34.632706 13774 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.641907 10741 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.642349 10662 raft_consensus.cc:614] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:34.635308 13639 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.636832 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:34.632759 13419 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.643543 10587 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:34.643661 13622 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.644416 13612 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.632567 13550 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:16:34.655939 13623 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.646171 13486 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:34.706022 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 93236.5us
I20260709 13:16:34.708103 10740 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:34.720162 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:34.620481 10742 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:34.718343 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 81617.5us
I20260709 13:16:34.651228 13567 raft_consensus.cc:2764] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:34.721956 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.744225 10706 leader_election.cc:400] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:34.746362 10740 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:34.712510 13639 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.720681 10743 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:34.712327 13792 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:34.653460 13641 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:16:34.749990 13776 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:34.722079 13738 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.861120 10741 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:34.770020 10734 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:34.759958 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:34.818360 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.861092 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:34.795322 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:34.797827 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:34.908115 10666 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.795797 10665 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:34.856940 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:34.865196 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 148901us
I20260709 13:16:34.911958 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.770138 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.769852 10662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:34.757365 10590 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:34.764882 10592 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:34.786929 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:34.914778 10742 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.772353 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:34.920374 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 160487us
I20260709 13:16:34.921268 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:34.928707 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.907531 10668 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:34.760083 13777 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:34.771425 13612 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:34.934952 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.936885 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:34.937654 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 185054us
I20260709 13:16:34.872906 13656 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:34.948505 10635 leader_election.cc:400] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8.
I20260709 13:16:34.950448 10635 leader_election.cc:403] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:34.885407 13792 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:34.765982 13377 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:34.931473 13774 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.897621 13788 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.756392 13486 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.178s
I20260709 13:16:34.957991 10666 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:34.924453 13567 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:34.879822 13778 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:16:34.770406 13489 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
I20260709 13:16:34.975026 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:34.922284 13738 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:34.924279 13623 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:34.979000 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 122143us
I20260709 13:16:34.931047 13776 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.778942 13639 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.984647 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:34.938723 13419 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.986090 10742 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:34.987071 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 204685us
I20260709 13:16:34.982582 13669 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:34.982964 13656 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.976202 13572 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8.
I20260709 13:16:34.991437 13547 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.770020 13791 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.256s
I20260709 13:16:34.979950 13792 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:34.993399 13486 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.975764 13777 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:34.998082 13785 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.984053 13612 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:35.006534 13778 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.949153 13737 raft_consensus.cc:2764] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:16:35.011188 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62863.7us
I20260709 13:16:35.029035 13684 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.055117 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.011014 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:35.014731 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.019338 13766 raft_consensus.cc:2764] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:16:35.019706 13776 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.011929 13774 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.021694 10667 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:16:35.024550 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.059370 10667 pending_rounds.cc:85] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 7
I20260709 13:16:34.987030 13784 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:16:35.059867 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 135890us
I20260709 13:16:35.050973 13743 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:35.071779 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 87250.4us
I20260709 13:16:35.072760 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:35.067785 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56858.3us
I20260709 13:16:35.050768 13612 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.045812 13486 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.053082 13778 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.071779 13784 consensus_queue.cc:1243] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:35.059685 10667 pending_rounds.cc:107] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:16:35.060705 13567 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.079339 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.074136 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:35.108603 13742 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:35.111039 13742 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.111687 13783 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:35.112414 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.113087 13742 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.114914 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:35.114929 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 103504us
I20260709 13:16:35.112452 13572 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:35.117940 13742 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.118283 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:35.119099 13742 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:35.119457 13742 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:35.119480 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.119921 13550 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:35.108436 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.120093 13742 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.094852 10667 raft_consensus.cc:2889] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.120740 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.116374 13572 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:35.182065 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88206.2us
W20260709 13:16:35.181221 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 60497us
I20260709 13:16:35.183305 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:35.184008 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.125941 13737 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.179546 13068 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:35.078166 13042 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:35.072093 13743 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:35.080327 13612 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:35.187388 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 162907us
W20260709 13:16:35.192188 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 143309us
I20260709 13:16:35.179988 13573 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.120800 13550 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.184870 13648 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:35.213539 13799 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.219s	user 0.004s	sys 0.000s
I20260709 13:16:35.214017 13486 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.196686 13572 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.191079 13419 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:35.194533 13464 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.184514 13738 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.214947 13068 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.185259 13567 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.184751 13762 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.065950 13684 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.237711 13550 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:35.218087 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:35.192932 13743 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.054889 13785 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.217594 13816 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:35.245122 13612 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.225775 13419 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:35.246564 13419 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.246791 13486 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.247090 13743 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.249058 13743 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.232936 13791 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:35.249927 13791 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:35.250173 13777 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.250278 13791 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:35.251256 13791 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.252470 13791 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.245776 13068 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.252112 13612 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:35.252712 13810 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:16:35.231966 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 164216us
I20260709 13:16:35.232347 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.258271 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.258738 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:35.259248 10738 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.245042 13774 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.263653 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.265676 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.266590 13567 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.268292 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.269793 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.271027 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.273840 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.274417 10736 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:35.275084 13827 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.277485 13573 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:35.278759 13419 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:35.288285 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56005.5us
I20260709 13:16:35.261034 13042 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:35.289275 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.252537 13778 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.291992 10559 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.223384 13648 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.293823 13827 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.293826 10585 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:16:35.296262 13801 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260709 13:16:35.297379 13639 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.262691 13656 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:35.299789 10592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 1888) took 1874 ms (client timeout 1550 ms). Trace:
W20260709 13:16:35.309732 10592 rpcz_store.cc:269] 0709 13:16:33.412469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.412652 (+   183us) service_pool.cc:224] Handling call
0709 13:16:35.286717 (+1874065us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002cabd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:35.286837 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993489280}
I20260709 13:16:35.302208 10706 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.305490 10738 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:35.283303 13573 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:35.316977 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.317883 13246 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.318287 13246 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:35.318670 13246 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.306306 13464 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:35.321946 13737 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.324076 13648 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.325301 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.326046 11414 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:35.327466 13823 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:16:35.328948 13827 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.305302 13816 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.331358 13778 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.334007 13776 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.336457 13684 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.340662 13656 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.341363 13656 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.343848 13656 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.311456 13742 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.345433 13639 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.345907 13639 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.345728 13042 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.347908 13639 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.349694 13823 consensus_queue.cc:1243] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:35.304975 13743 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.305557 13774 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.307905 13762 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.355362 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.356257 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.356544 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.356866 10737 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:35.309463 13419 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.357311 10739 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:35.359627 13464 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.360462 13742 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.362418 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.364382 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.366786 10592 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:35.315146 13792 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.400326 10590 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.401499 10738 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:35.403916 13419 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.407034 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.408102 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.409118 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.410420 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.411202 10592 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:35.413846 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:35.415079 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50770.4us
I20260709 13:16:35.416285 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.417688 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:35.431223 13573 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:35.433575 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.437521 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.447994 10587 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:35.412546 13246 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.439399 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.399384 13464 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:35.450451 13042 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.450542 13639 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:35.451719 13246 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.453100 13622 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.453751 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 305) took 1151 ms. Trace:
I20260709 13:16:35.454134 10667 rpcz_store.cc:276] 0709 13:16:34.302162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.303494 (+  1332us) service_pool.cc:224] Handling call
0709 13:16:34.317523 (+ 14029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.187348 (+869825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.453551 (+266203us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54003ab1d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:35.453701 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618656512}
I20260709 13:16:35.466734 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1463) took 1534 ms. Trace:
I20260709 13:16:35.467110 10589 rpcz_store.cc:276] 0709 13:16:33.932084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.008933 (+ 76849us) service_pool.cc:224] Handling call
0709 13:16:34.657431 (+648498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.658262 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.466569 (+808307us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540008aa50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:35.466680 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490706176}
I20260709 13:16:35.469551 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.474478 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:35.476807 10589 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:35.481460 13486 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.482110 13486 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:35.482774 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 66583us
I20260709 13:16:35.483980 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.469270 13786 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:35.484797 13786 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.485698 13786 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.486699 13747 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.486793 13786 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:35.490942 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.475193 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:35.520404 10736 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.541657 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:35.544771 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 172785us
I20260709 13:16:35.522774 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:35.546943 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.503639 10587 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:35.533409 13836 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:35.490671 13656 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.568069 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:35.542497 13627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.007s	sys 0.019s
I20260709 13:16:35.494962 13792 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.523192 13828 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.542783 13760 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.542723 13246 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.574386 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:35.571475 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.495978 13042 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:16:35.549948 13464 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.586318 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.587036 10737 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:35.577036 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.587605 10740 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:35.573990 10738 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:35.573966 13627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.007s	sys 0.020s
I20260709 13:16:35.517493 13781 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:35.573096 13816 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.549583 13572 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.504195 13774 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:16:35.496151 13738 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:16:35.596506 10557 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.577719 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.572273 13791 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.572556 13683 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:35.597739 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.605839 10662 raft_consensus.cc:606] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:35.600488 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.609869 10737 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:35.510437 13821 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:16:35.584012 13790 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:35.614718 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.592782 13567 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.624866 13627 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.592736 13246 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.628229 13246 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.612584 13186 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.629721 13186 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.630046 13486 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.630523 13683 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.631691 13186 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.632557 13683 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.595690 13781 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.633373 13781 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:35.633711 13797 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.753s	user 0.004s	sys 0.000s
I20260709 13:16:35.575482 13656 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.617693 13823 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:35.650383 10587 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:35.636130 13656 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.599574 13778 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:35.636940 13572 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:35.666455 13800 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.900s	user 0.000s	sys 0.002s
I20260709 13:16:35.667387 13572 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.642979 13419 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:35.669888 13419 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:35.677732 13419 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.679275 13419 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.606772 13816 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.642349 13790 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.684646 13816 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.585960 13760 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.685098 13790 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:35.687125 13760 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:35.702586 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 87980.4us
I20260709 13:16:35.703341 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.718523 13792 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.718782 10743 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:35.721117 13807 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:35.722404 11412 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:35.722419 13807 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:35.723033 13807 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:35.724030 10736 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:35.724161 13807 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.724969 13547 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.725488 13807 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.729344 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.730095 10593 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:35.730928 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.731453 10587 raft_consensus.cc:2376] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8. Re-sending same reply.
I20260709 13:16:35.733006 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.742056 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.750765 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.751376 10592 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:35.752346 10635 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.732527 13823 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.737411 13792 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:35.792692 13826 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.497s	user 0.003s	sys 0.000s
I20260709 13:16:35.764614 13572 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.813285 13828 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:35.815490 13828 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.815919 13828 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.816617 13785 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:35.820302 13627 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:35.821303 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:35.824658 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:35.825426 13246 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:35.826773 13815 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:35.827160 13815 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:35.827080 13246 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:35.828109 13815 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.830739 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1915) took 1272 ms. Trace:
I20260709 13:16:35.831089 10585 rpcz_store.cc:276] 0709 13:16:34.558150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.613272 (+ 55122us) service_pool.cc:224] Handling call
0709 13:16:35.287121 (+673849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.306664 (+ 19543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.830566 (+523902us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54002cabd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:35.830689 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539591936}
I20260709 13:16:35.831678 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.832541 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.833503 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.834088 11409 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:35.834906 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.760870 13669 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:35.759578 13791 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.802565 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50776 (request call id 3) took 1033 ms. Trace:
I20260709 13:16:35.861753 10662 rpcz_store.cc:276] 0709 13:16:34.769603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.769748 (+   145us) service_pool.cc:224] Handling call
0709 13:16:35.802397 (+1032649us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000c4c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b3853 00007f425c28160a 00007f42558077d4 00007f4255807762 00007f4255807691 00007f425580760c 00007f42558068c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:35.802479 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591538560}
I20260709 13:16:35.735306 13639 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:35.804703 13781 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:35.752283 13844 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:35.867648 13844 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.868042 13468 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:35.805413 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.869593 10589 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:35.767076 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:35.809659 13833 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.875689 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.872314 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:35.837415 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:35.838313 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.842733 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.062848 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:35.964178 13567 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.820806 13627 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.851927 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.853025 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:35.853523 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:35.860208 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.835454 11418 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:35.862679 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:35.829178 13815 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.764725 13823 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:35.866904 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:35.867031 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:35.870239 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:35.871259 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:35.874217 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:35.977551 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 215618us
I20260709 13:16:35.990424 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1918) took 1431 ms. Trace:
I20260709 13:16:35.977955 13788 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.874770 13833 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:35.986547 13825 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:16:35.986100  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:35.909134 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.051988 10666 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:35.912220 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:36.126223 10664 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.960141 10669 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:35.909235 10589 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:35.827216 13747 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:35.863198 13419 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.989813 13844 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:35.906601 10661 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:36.060273 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 215664us
I20260709 13:16:35.909804 10743 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:36.060961 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 228000us
W20260709 13:16:35.846462 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.078253 10737 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:16:36.065392 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 228032us
I20260709 13:16:36.099908 10668 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:36.100098 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:36.100339 10592 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.130295 10666 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:36.131078 11409 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:36.100517 10591 rpcz_store.cc:276] 0709 13:16:34.558866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.639436 (+ 80570us) service_pool.cc:224] Handling call
0709 13:16:34.639706 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.071373 (+431667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.071419 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.123284 (+ 51865us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.220909 (+ 97625us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:35.236603 (+ 15694us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.255499 (+ 18896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.298316 (+ 42817us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54001e46d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:35.298366 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.792128 (+493762us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:35.990223 (+198095us) raft_consensus.cc:1685] finished
0709 13:16:35.990247 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.990368 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16791,"prepare.queue_time_us":15241,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":9046,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5894,"spinlock_wait_cycles":974597632,"thread_start_us":97205,"threads_started":1,"wal-append.queue_time_us":170426}
I20260709 13:16:36.052322 13760 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.138059 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.051177 13791 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:36.145583 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.145574 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45558.6us
I20260709 13:16:36.147075 10667 raft_consensus.cc:2410] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:36.079597 13762 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.056468 13572 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.059437 13246 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:36.153044 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.159642 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.164124 13656 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:36.164633 13656 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.164966 13823 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.165031 13656 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.162359 13821 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:36.166137 13821 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.168092 13821 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.140058 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:36.180128 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.181562 10660 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:36.182732 10661 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:36.184809 11418 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:36.151407 13816 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.155248 13567 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:36.199139 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.187358 10666 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:36.187410 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:36.204491 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.205809 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:36.206537 10666 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:36.207430 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.158006 13844 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.183904 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:36.221607 10664 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:36.223124 10661 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:36.223137 10669 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:36.144181 13419 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.177191 13766 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.198778 13042 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.156011 13760 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.234786 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.267652 10666 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:36.231508 13844 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:36.240880 10739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.023s	sys 0.026s
W20260709 13:16:36.274537 10739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.023s	sys 0.026s
I20260709 13:16:36.175634 13246 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.263468 10592 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:36.266297 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.278498 10664 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:36.160513 13791 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.214339 13816 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.289387 13760 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.290005 13760 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.290397 13854 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:16:36.291709 13547 consensus_meta.cc:287] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.001s
I20260709 13:16:36.295858 10663 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:36.290393 13760 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.299065 13760 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.242450 13792 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:36.285933 10740 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:36.303984 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.233124 13566 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:36.263710 13766 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.189849 13833 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.273957 13824 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.330324 10664 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:36.332231 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.275152 13737 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:36.338183 10661 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:36.361809 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:36.363233 10742 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:36.375298 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.335225 13766 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.272766 13042 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.339815 13824 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:36.374426 13781 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.335664 13792 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.400259 13572 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:36.400995 13572 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.402185 13816 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.402953 13572 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.403439 13791 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.387887 13824 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.372293 13737 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.387447 13627 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:36.437543 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 277950us
I20260709 13:16:36.438194 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.441113 10560 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.442978 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:36.443655 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 290703us
I20260709 13:16:36.420635 13795 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:36.444796 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.447328 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:36.452836 10706 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.450521 13547 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.395853 13844 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.446759 13566 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.445464 13760 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.445632 13816 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.450749 13777 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:36.455655 13419 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.467536 13547 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.449965 13795 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.479375 13816 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:36.502276 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47057.5us
I20260709 13:16:36.504221 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:36.506896 10742 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:36.510459 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:36.480664 13866 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.484002 13246 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.491950 13547 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.517455 10734 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.519237 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:36.475093 13762 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:16:36.501344 13816 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.482323 13760 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:36.529706 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 76934.6us
I20260709 13:16:36.512401 13861 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:36.526677 13246 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:36.541409 10743 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:36.529403 13042 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.530230 13792 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:36.566018 13870 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:36.566301 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:36.567090 10669 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.570611 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.572024 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.572582 10665 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:36.579332 13760 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.580178 13760 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:36.583837 13848 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.598s	user 0.001s	sys 0.002s
I20260709 13:16:36.585479 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.585634 13747 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.591116 13828 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.591863 13828 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.592417 13828 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.598244 10585 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:36.534287 13786 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.602141 13786 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.602366 13790 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.602725 13786 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.602983 13790 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.534034 13872 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.605228 13872 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.608300 13872 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.534101 13742 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:16:36.611033 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.611554 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:36.612149 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:36.552784 13860 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:16:36.612830 10663 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:36.613826 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1403) took 1041 ms. Trace:
I20260709 13:16:36.614529 13762 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.615103 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.615301 13762 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:36.614179 10739 rpcz_store.cc:276] 0709 13:16:35.572129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.572681 (+   552us) service_pool.cc:224] Handling call
0709 13:16:35.583585 (+ 10904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.654491 (+ 70906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.654547 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.655093 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.274886 (+619793us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.274934 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.275006 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.613604 (+338598us) raft_consensus.cc:1685] finished
0709 13:16:36.613623 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.613772 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4608,"raft.queue_time_us":9195,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3302,"thread_start_us":610138,"threads_started":2,"wal-append.queue_time_us":678452}
I20260709 13:16:36.616356 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.545022 13246 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.618680 13246 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.621811 13865 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:36.622480 13865 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.616926 10667 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:36.628861 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.629524 10667 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:36.630479 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.631207 10667 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:36.564962 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.632745 10662 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:36.635687 10662 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:36.638850 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53528.1us
I20260709 13:16:36.639751 10560 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:36.644164 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.646255 10588 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:36.647796 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:36.648243 10666 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:36.649230 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:36.649812 10585 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:36.649858 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:36.651055 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:36.651714 10592 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:36.652181 10593 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.650482 10590 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:36.655422 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:36.643368  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:36.672672 10490 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 6, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.677954 13627 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:36.678855 13627 consensus_queue.cc:1243] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:36.679409 13627 raft_consensus.cc:993] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: : Instructing follower 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:16:36.680596 13042 raft_consensus.cc:1081] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Signalling peer 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:16:36.686197 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:36.671034 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:36.689692 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:36.653101 13777 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.693300 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.616930 13762 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.708441 13821 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:36.709508 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 173167us
I20260709 13:16:36.538697 13861 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.712423 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:36.719018 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.720323 10662 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:36.708961 13821 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.730835 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.731580 10662 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:16:36.717939 13656 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:16:36.732267 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:36.732604 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:36.714963 13760 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:36.714810 13648 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.703094 13777 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.733644 13821 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.718144 13639 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:36.715097 13489 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:36.735376 13738 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.723311 13790 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:36.751366 13788 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.002s
I20260709 13:16:36.766388 13788 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.739737 13857 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:36.762562 13865 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.769838 13857 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:36.770138 13874 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:36.770800 13874 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.771023 13857 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.772897 13874 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.740165 13760 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.773562 13878 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:36.773555 13760 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.774121 13878 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.774638 13878 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.758491 13572 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.777683 13785 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:36.778028 13572 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.779011 13778 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.779501 13778 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.780259 13572 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.747776 13875 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.781759 13875 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.782231 13875 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.783674 13778 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.785626 13874 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:36.791677 13874 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.788043 13737 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.743806 13877 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:16:36.825013 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.800184 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:36.826522 10660 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:36.819545 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:36.830695 10669 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:36.835932 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:36.836396 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:36.848284 11414 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:36.746740 13656 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.800959 13828 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.794724 13861 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:36.860278 10669 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:36.875118 10669 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:36.851151 13815 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.006s
I20260709 13:16:36.834147 13788 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:16:36.841728 13246 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.888432 13482 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:36.894032 13627 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.858641 13766 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.791010 13878 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.953140 13874 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:36.954674 13878 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.958077 13777 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:36.835165 13824 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:36.974628 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 320420us
I20260709 13:16:36.895987 13816 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:36.985157 13874 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:36.950503 13879 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:36.988721 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.020529 10742 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:36.916440 13627 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:36.995919 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.024188 10590 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:37.018110 10593 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:37.018405 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.025945 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:36.985816 13874 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.022614 10742 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:37.022562 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.027451 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.028287 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.031287 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.032342 10592 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:37.027716 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:36.975730 13788 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.950258 13547 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.040797 10737 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:37.033705 10742 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:37.034737 10739 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:37.035365 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:37.035470 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 395802us
I20260709 13:16:37.033221 10735 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:37.037127 10734 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:37.038146 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.043334 10593 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:37.046669 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.084803 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.018028 13737 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.087767 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:37.088310 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:37.088443 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 44803.6us
W20260709 13:16:37.027053 13566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.016s	sys 0.051s
I20260709 13:16:37.092804 10587 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:37.089138 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.094110 10591 raft_consensus.cc:2410] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:37.090966 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:37.101999 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 55448.5us
I20260709 13:16:37.103523 13762 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.103984 13762 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.104743 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.105084 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.110380 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:37.114405 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.115222 10592 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:37.110102 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:37.096589 13566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.052s
I20260709 13:16:37.132043 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.130278 13889 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.117843 13742 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.048985 13788 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.133549 13778 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.121824 13566 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:37.102246 13815 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:37.102434 13737 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.025393 13879 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.126962 13881 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.129132 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:37.127017 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:37.121469 13865 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:16:37.165345 11382 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:37.173556 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.168573 13881 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.175674 13824 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:37.175958 10591 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:37.161101 10587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:45606
I20260709 13:16:37.176074 13881 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.176535 10587 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.133513 13889 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.176918 10587 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.176833 13865 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.177505 13865 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.178429 13889 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.179299 13865 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.179332 13547 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:37.179991 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.174463 10589 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:16:37.180812 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.184141 13760 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:37.185829 13883 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:37.187247 13874 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.188171 13824 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.188827 13824 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.189486 13816 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:37.190179 13627 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:37.191035 13886 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:16:37.191905 13882 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:37.191282 13824 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.193838 10743 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:37.194144 13766 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.147125 13742 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.195571 13879 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.185714 13656 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:37.198676 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71779us
I20260709 13:16:37.153276 13823 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.149187 13778 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:37.199879 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:37.167148 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 481036us
I20260709 13:16:37.198484 10587 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.207209 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.167006 13246 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.211596 10706 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:37.208004 10742 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:37.213559 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.213790 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.215750 10587 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.197486 13482 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.202032 13778 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.220688 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:37.272742 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64658.1us
I20260709 13:16:37.276863 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:37.201858 13823 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.218698 13844 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:16:37.207294 13884 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:37.290354 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 69737.1us
I20260709 13:16:37.217975 13656 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.270869 13246 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.210785 13648 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:16:37.277060 13881 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:37.210074 13821 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.281252 13823 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.275628 13879 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.212255 13782 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:16:37.283263 13874 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:37.294019 13884 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.216544 13875 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.326347 13656 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.331420 13881 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.331755 13906 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:37.504599 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 172864us
I20260709 13:16:37.339357 13889 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.409426 13874 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.409643 13656 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.405637 13884 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.331558 13246 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.505019 13881 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.298250 13566 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:37.594192 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51104us
I20260709 13:16:37.544106 13889 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.393816 13879 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.592211 13684 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.572588 13760 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:37.608851 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 278713us
I20260709 13:16:37.610710 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:37.506270 11415 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:16:37.612697 13898 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:16:37.616618 13778 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.617625 13905 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.621443 13863 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:16:37.625255 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:37.625804 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:37.601732 13737 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.603670 13889 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.647444 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.649200 13742 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.608070 13788 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.654227 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.654943 10734 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.655457 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.655961 10738 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.654198 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:37.657702 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.658177 10739 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
W20260709 13:16:37.659621 13904 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:37.613008 13896 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:37.660187 13885 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:37.660848 13896 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:37.660702 13885 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.661219 13896 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:37.661612 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:37.662308 10586 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:37.662056 13896 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.663254 13896 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.663998 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.664656 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.665648 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:37.666178 10586 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.666831 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.667934 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:37.669080 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.660214 13876 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:37.671777 13742 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:37.672250 13742 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.673395 13875 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.674252 13742 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:37.674741 13742 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:37.665078 10734 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:37.675158 13742 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.650749 13893 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.676189 13893 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:37.676331 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.676612 13893 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.676782 13906 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:37.677294 13906 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.677557 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.676189 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.678185 13821 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:37.678498 13902 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:16:37.679936 13901 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:37.676604 10586 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:37.677691 13906 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.651182 13905 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:37.693647 13897 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:37.663888 13737 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:37.695933 13907 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:16:37.697659 13903 log.cc:927] Time spent T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:16:37.697475 13656 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:37.700495 13911 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:37.700461 13656 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.702589 13857 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:37.703030 13857 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:37.703060 13879 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:37.704438 13857 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.626417 13878 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:37.705441 13878 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:37.705850 13878 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.707864 13246 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.709085 13874 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.670907 13881 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.715216 13881 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.670943 13833 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.718688 13823 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.625422 13684 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.720765 13684 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.621831 13865 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:16:37.721285 13823 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.678512 10734 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:37.726440 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 72313us
I20260709 13:16:37.727628 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:37.729833 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:37.733574 13905 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.734280 13885 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.734521 13795 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.677112 13742 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:37.737957 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.739297 10739 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:37.743196 10734 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:37.713119 13878 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:37.731335 13656 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.735158 13865 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:37.746749 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.749747 10738 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:37.766500 10734 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:37.766995 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:37.750203 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.767709 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.765067 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.768443 10734 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.769171 10739 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:37.776934 10734 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:37.746356 13815 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:37.772390 13865 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.786707 13865 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.766656 13889 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.791245 13889 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:37.764851 13857 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.798287 13778 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.801014 13893 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.803449 13893 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.798135 13865 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.805557 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.806106 13865 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.806646 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.806743 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.807231 10739 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.807922 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.809194 10734 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:37.810415 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.811913 10734 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:37.744158 13684 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:37.784456 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:37.820175 13823 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:37.838830 10590 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:37.839704 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.872056 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.867802 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:37.875419 13895 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.665s	user 0.000s	sys 0.001s
W20260709 13:16:37.877221 13890 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 13:16:37.820333 13815 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.880334 13915 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.880523 10664 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:37.885584 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:37.886124 11409 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:37.886315 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.887092 10594 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:37.887833 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.879599 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 320) took 1326 ms. Trace:
I20260709 13:16:37.901073 10662 rpcz_store.cc:276] 0709 13:16:36.553242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.736992 (+183750us) service_pool.cc:224] Handling call
0709 13:16:36.737267 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.737784 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.737811 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.738220 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.122449 (+384229us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:37.122502 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.122587 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.876678 (+754091us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:37.879331 (+  2653us) raft_consensus.cc:1685] finished
0709 13:16:37.879350 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.879543 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2614,"raft.queue_time_us":70,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":301132544,"thread_start_us":362552,"threads_started":1,"wal-append.queue_time_us":438143}
I20260709 13:16:37.888463 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:37.903935 10588 raft_consensus.cc:2393] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:37.904019 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:37.889734 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:37.904666 10586 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.889190 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:37.909791 10589 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:37.910983 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.880843 10664 pending_rounds.cc:85] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 2
I20260709 13:16:37.911803 10664 pending_rounds.cc:107] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:37.912132 10664 raft_consensus.cc:2889] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.887820 13786 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:37.913556 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.829720 13889 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.918733 10739 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:37.911834 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.880836 13915 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:37.917223 10586 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:16:37.963076 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51293.3us
I20260709 13:16:37.964134 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.952697 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.964737 10560 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:37.922770 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 54352.7us
I20260709 13:16:37.967917 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:37.970552 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.977120 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:37.981673 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.988565 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:37.965337 13566 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:38.005481 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:37.938004 13875 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:38.006598 10734 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:37.984145 13857 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:38.008255 13857 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.008667 13857 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:38.015352 13899 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.729s	user 0.001s	sys 0.000s
I20260709 13:16:37.978415 13786 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:37.978140 13785 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.977447 13918 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:37.983115 13893 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:37.991122 13888 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:38.002554 13881 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:38.022158 13742 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:38.037643 10585 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:38.036026 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:37.984567 13489 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:16:38.023191 13566 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.968721 13889 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.041656 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:38.042117 13807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.780s	user 0.003s	sys 0.017s
W20260709 13:16:38.044221 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51113.4us
I20260709 13:16:38.029245 13893 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.028420 13786 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:38.044299 13742 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:38.038002 13881 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.024082 13884 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.041213 13566 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:38.053598 13920 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:38.028764 13785 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.046960 13905 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:38.096356 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:38.105441 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:38.103708 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:38.104261 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:38.164631 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.104426 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.166282 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1847) took 1787 ms. Trace:
I20260709 13:16:38.166810 10664 rpcz_store.cc:276] 0709 13:16:36.378417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.378696 (+   279us) service_pool.cc:224] Handling call
0709 13:16:36.390393 (+ 11697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.941559 (+1551166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.166046 (+224487us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003aacd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:38.166207 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3426173312}
I20260709 13:16:38.043519 13916 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:38.028234 13875 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:38.105775 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.069440 13881 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:38.105089 10588 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:38.079743 10742 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:38.164481 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 60860.9us
I20260709 13:16:38.096931 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 499) took 1336 ms. Trace:
I20260709 13:16:38.093963 13762 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:38.047094 13807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.802s	user 0.003s	sys 0.018s
I20260709 13:16:38.165584 10589 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:38.164795 13905 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.076928 13889 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:38.065996 13865 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.054452 13893 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.048822 13906 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.074173 13915 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:38.162377 13821 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:38.095817 13878 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.079455 13884 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:38.172086 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 125749us
I20260709 13:16:38.192987 10706 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:38.175555 11415 rpcz_store.cc:276] 0709 13:16:36.760675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.761436 (+   761us) service_pool.cc:224] Handling call
0709 13:16:36.761705 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.624643 (+862938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.096646 (+472003us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400426b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:38.096865 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492800256}
I20260709 13:16:38.169469 13876 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:38.184635 13905 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.199050 10738 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:38.200839 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:38.173893 13888 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:38.198657 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 319) took 1665 ms. Trace:
I20260709 13:16:38.203312 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.205593 13875 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.201692 10666 rpcz_store.cc:276] 0709 13:16:36.533134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.671755 (+138621us) service_pool.cc:224] Handling call
0709 13:16:36.698908 (+ 27153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.699146 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:36.713442 (+ 14296us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.977364 (+263922us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.894010 (+916646us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b18003cf160. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:38.198241 (+304231us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b18003cf160. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287 00007f42572d4208
0709 13:16:38.198365 (+   124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.198414 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:38.198452 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.198512 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.198610 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1188434,"prepare.queue_time_us":15260,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":76,"raft.queue_time_us":1227679,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":35394,"spinlock_wait_cycles":97764480,"thread_start_us":263231,"threads_started":1,"wal-append.queue_time_us":417948,"wal-append.run_cpu_time_us":1476,"wal-append.run_wall_time_us":1040472}
I20260709 13:16:38.188934 13821 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:38.177179 13857 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.215032 13042 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:38.212787 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.215809 13042 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.216605 10589 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:38.201786 13915 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:38.218313 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2102) took 1605 ms. Trace:
I20260709 13:16:38.080415 13742 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.202972 13828 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.204499 13876 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:38.214870 13572 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.220309 10663 rpcz_store.cc:276] 0709 13:16:36.612900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.792895 (+179995us) service_pool.cc:224] Handling call
0709 13:16:36.793177 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.793503 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.793529 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.824957 (+ 31428us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.131233 (+306276us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:37.159516 (+ 28283us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.051977 (+892461us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4800160158. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:16:38.212338 (+160361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.212427 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.212470 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:38.218056 (+  5586us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.218240 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1233073,"prepare.queue_time_us":55068,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":1072082,"raft.run_cpu_time_us":44405,"raft.run_wall_time_us":1235387,"spinlock_wait_cycles":32667904,"thread_start_us":265695,"threads_started":1,"wal-append.queue_time_us":442513}
I20260709 13:16:38.214895 13627 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.190026 13786 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.232375 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 318) took 1711 ms. Trace:
I20260709 13:16:38.219652 13884 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:38.190340 13865 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.250168 10667 rpcz_store.cc:276] 0709 13:16:36.520941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.650792 (+129851us) service_pool.cc:224] Handling call
0709 13:16:36.651099 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.651337 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:36.651616 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.673361 (+1021745us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18003f31c0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:38.232091 (+558730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.232135 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:38.232181 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.232235 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.232329 (+    94us) inbound_call.cc:177] Queueing success response
0709 13:16:38.240106 (+  7777us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
Metrics: {"mutex_wait_us":411432,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":411908,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":15103104,"thread_start_us":147058,"threads_started":1,"wal-append.queue_time_us":1310692}
I20260709 13:16:38.253122 13042 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.253041 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.251919 10588 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:38.233100 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:38.255370 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:38.233610 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 323) took 1555 ms. Trace:
I20260709 13:16:38.244340 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1885) took 1092 ms. Trace:
I20260709 13:16:38.274458 13042 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:38.275094 13042 consensus_queue.cc:1243] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:38.275559 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:38.276422 13042 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:38.276844 13042 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.277236 13042 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:38.256234 10591 raft_consensus.cc:2368] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:38.248160 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:38.279080 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.280045 10589 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:38.272356 10742 rpcz_store.cc:276] 0709 13:16:37.152383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.213586 (+ 61203us) service_pool.cc:224] Handling call
0709 13:16:38.244191 (+1030605us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54002be154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:38.244286 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989505920}
I20260709 13:16:38.256563 10660 rpcz_store.cc:276] 0709 13:16:36.678284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.850174 (+171890us) service_pool.cc:224] Handling call
0709 13:16:36.874317 (+ 24143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.874525 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:36.874894 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.014828 (+1139934us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:38.233279 (+218451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.233348 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:38.233395 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.233456 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.233558 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1107783,"prepare.queue_time_us":11664,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1735,"raft.queue_time_us":1108496,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":275333376,"thread_start_us":250206,"threads_started":1,"wal-append.queue_time_us":334569}
I20260709 13:16:38.282284 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:38.286767 13567 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:16:38.240607 13921 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
W20260709 13:16:38.300669 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 52574us
I20260709 13:16:38.230984 13788 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.271667 10661 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:38.233798 13419 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:38.230515 13906 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:38.236123 13774 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.238237 13785 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.236012 13833 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.256453 13915 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:38.275337 13778 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:38.257040 13884 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:38.319100 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 114414us
I20260709 13:16:38.249941 13847 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:16:38.236296 13828 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.280452 13792 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:38.271387 13926 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.322345 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:38.333839 10591 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.319397 13874 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.231043 13816 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:16:38.319856 10590 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:38.331360 10706 leader_election.cc:400] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:38.233167 13572 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.324601 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:38.345192 10706 leader_election.cc:403] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:38.318048 13419 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:38.232628 13566 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:38.378438 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47211.1us
I20260709 13:16:38.379804 13042 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.234633 13627 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:38.379333 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:38.325409 13795 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.384508 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.29353e+06us
I20260709 13:16:38.333331 13792 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.396462 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:38.397505 13042 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:38.399602 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 96162.4us
I20260709 13:16:38.320519 13788 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.407675 10632 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:38.324955 13833 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.414610 13042 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:38.415083 13042 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.323678 13774 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.411067 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:38.341614 13874 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.412516 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:38.328508 13906 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:16:38.383498 13419 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.420176 10586 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:38.309798 13821 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.392539 13762 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.392282 13782 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:38.421579 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:38.429939 11415 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:38.422852 10736 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:38.407155 13792 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.332435 13778 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.346138 13926 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.347648 13876 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.407320 13795 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:38.723048 13881 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 13:16:38.724583 13865 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.614251 13893 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.750097 13881 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.726624 13927 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.564826 13915 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.751116 13927 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.752215 13881 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.699873 10591 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:38.612151 13931 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:38.564294 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 152416us
W20260709 13:16:38.573868 13909 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:16:38.754179 13927 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.755748 13944 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:38.756341 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:38.757061 11415 raft_consensus.cc:2368] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
I20260709 13:16:38.757804 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:38.758462 11418 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.430779 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:38.759282 10586 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:38.564622 13547 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:38.582950 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.432893 10587 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:38.427712 13935 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.361s
I20260709 13:16:38.795377 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:38.796242 11412 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEARNER]: Advancing to term 8
W20260709 13:16:38.614061 13928 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:16:38.424479 13874 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.821496 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:38.618855 13930 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 13:16:38.574558 13908 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:16:38.747196 13905 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
I20260709 13:16:38.601943 13572 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:38.826613 10592 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.012s
W20260709 13:16:38.866698 10592 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.001s	sys 0.012s
I20260709 13:16:38.438174 13782 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.583865 13627 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.603060 13567 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.508396 13821 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.618258 13833 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.420982 13791 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:38.615060 13788 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.506147 13937 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.692623 13933 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.687110 13934 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:38.601426 13878 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:38.601482 13857 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.584403 13896 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:38.574178 13940 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.642339 13866 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:38.686743 13566 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:38.826303 13786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.010s	sys 0.005s
I20260709 13:16:38.799338 13547 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.756500 13795 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.602784 13828 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:38.757078 13778 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.421518 13884 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.871887 13782 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:38.873883 13572 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:38.866135 13954 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:38.874104 13567 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.871143 13945 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.878688 13627 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.870358 13905 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.911921 10557 leader_election.cc:400] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
I20260709 13:16:38.988899 10557 leader_election.cc:403] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:38.920504 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:38.937117 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 508837us
I20260709 13:16:38.989761 11415 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:38.949419 13927 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:38.954582 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 386) took 1030 ms. Trace:
I20260709 13:16:38.954507 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:38.953954 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:38.950537 13896 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.995905 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:38.956974 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:38.996526 10662 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:16:38.937763 10588 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.007s
I20260709 13:16:38.895304 13788 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:38.904690 13791 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.970327 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.003s	sys 0.014s
I20260709 13:16:38.971832 10660 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:38.950881 13857 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:38.975566 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:38.962949 13786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.010s	sys 0.005s
I20260709 13:16:38.955327 13833 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:37.776177  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.962891 13943 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.905507 13933 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.961800 13935 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:38.983465 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:38.984388 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:38.910194 13878 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:38.898659 13937 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.986784 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:38.889189 13762 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7.
I20260709 13:16:38.910501 13934 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:38.997473 10588 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.008s	sys 0.007s
I20260709 13:16:38.998116 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:38.999092 13547 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.991173 10743 rpcz_store.cc:276] 0709 13:16:37.923857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.987008 (+ 63151us) service_pool.cc:224] Handling call
0709 13:16:37.987244 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.991684 (+  4440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.991711 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.105246 (+113535us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b2c0006cc38. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:38.105918 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.282279 (+176361us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.282338 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.282428 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.910681 (+628253us) raft_consensus.cc:1685] finished
0709 13:16:38.910704 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.954525 (+ 43821us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4097,"raft.queue_time_us":4195,"spinlock_wait_cycles":12893696,"thread_start_us":169795,"threads_started":1,"wal-append.queue_time_us":225788}
I20260709 13:16:38.968185 13866 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.978130 13572 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:38.980358 13828 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.908285 13419 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.122293 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:39.303506 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.008s	sys 0.027s
W20260709 13:16:39.246161 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 334394us
I20260709 13:16:39.068465 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.305207 10664 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:39.245725 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.247725 11412 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:39.245958 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:39.308275 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.256830 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.261740 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.308951 10662 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:39.309334 10591 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:39.020735 11418 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:39.306608 10586 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:38.984822 13567 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.186836 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:38.980264 13959 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.965058 13940 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.310763 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.352246 10586 raft_consensus.cc:2393] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:39.313627 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:39.304312 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.19659e+06us
I20260709 13:16:39.316620 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:39.310130 10585 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:39.307431 10666 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:39.348745 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.354803 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.355053 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.355923 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:39.358333 10660 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.358632 10591 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:39.357013 10662 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:39.360143 10557 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:39.005220 13952 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:16:39.365058 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.130200 13893 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.359004 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1971) took 1080 ms. Trace:
I20260709 13:16:39.187840 13896 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.368768 10667 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:39.316649 13788 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.342707 13833 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.377945 13788 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.378911 13833 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.379416 13833 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.379482 13937 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:38.990731 13945 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.380208 10664 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:39.380797 10669 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:39.379890 13833 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.315768 13857 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.389216 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 328) took 1285 ms. Trace:
I20260709 13:16:39.317286 13828 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.389613 10590 rpcz_store.cc:276] 0709 13:16:38.103806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.103951 (+   145us) service_pool.cc:224] Handling call
0709 13:16:39.389075 (+1285124us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001abdd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:39.389164 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293220096}
I20260709 13:16:39.391139 13828 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.391959 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:39.315481 13943 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:38.993108 13627 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.362501 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:39.362735 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:39.363507 10557 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:39.358984 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:39.005384 13927 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:39.358361 10666 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:39.005930 13956 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:39.002797 13954 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.315687 13935 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.000547 13926 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:39.395186 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:39.356352 13959 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.381109 13934 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.131026 13964 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:39.130579 13949 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:39.315265 13791 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.499917 10734 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:39.480422 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.424304 10660 raft_consensus.cc:2410] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:39.502126 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:39.502926 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 139484us
W20260709 13:16:39.017107 13929 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.812s	user 0.006s	sys 0.018s
I20260709 13:16:39.368220 13785 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:39.499125 10490 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 6, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.505992 13742 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.506184 13766 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:39.506614 13742 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:39.506740 13766 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.506814 10490 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:39.508658 13042 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.508252 10490 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 4, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.510391 13888 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:39.509886 10490 catalog_manager.cc:5697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 3, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.510705 10667 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:39.510906 13888 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.511590 13627 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.511390 10490 catalog_manager.cc:5697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.512943 13888 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:39.513437 13881 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:39.513921 13881 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:39.515120 13782 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.000s
I20260709 13:16:39.515766 13881 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.515517 13782 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.516649 13961 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.517127 13961 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.518311 13778 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:39.518819 13778 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:39.519186 13961 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.519685 13778 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.520539 11411 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:39.366484 13786 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:39.504664 13964 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:39.521492 13786 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.521726 13888 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:39.521927 13786 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.481462 10737 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:39.515769 10492 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 196) took 35942 ms (client timeout 15000 ms). Trace:
I20260709 13:16:39.358939 13815 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.497255 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.527537 10662 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:39.503964 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 108842us
I20260709 13:16:39.501355 10666 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:39.526630 13042 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.546422 13042 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:39.546833 10708 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.536s (SENT) [suppressed 29 similar messages]
I20260709 13:16:39.450070 13943 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.598344 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.599401 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:39.599867 10662 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.601243 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.602553 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:39.366727 13957 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:16:39.495620 13946 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.528s	user 0.000s	sys 0.001s
I20260709 13:16:39.494968 13905 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:39.485430 13821 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
I20260709 13:16:39.592944 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.627171 10667 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:39.384075 13774 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.533447 13918 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:39.522292 13888 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.461930 13648 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:39.483340 13927 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:39.612461 10665 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.591181 10490 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 6, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.613797 10666 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:39.379474 13933 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.386363 13419 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:39.592164 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46076.4us
I20260709 13:16:39.617079 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1974) took 1294 ms. Trace:
I20260709 13:16:39.384810 13866 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.381938 13945 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.387462 13878 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.597422 13844 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:39.519678 13961 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.629240 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 382257us
I20260709 13:16:39.490732 13935 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.383451 13940 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.610164 13785 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:39.704582 10734 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:39.500926 13954 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.833104 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:39.396173 13572 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.737869 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1941) took 2653 ms. Trace:
W20260709 13:16:39.672281 13792 consensus_meta.cc:287] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.001s
I20260709 13:16:39.530772 13828 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:39.522128 13964 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.764645 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:39.507591 13742 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.627276 13823 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:39.872398 10667 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.854508 10664 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:39.835801 10738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1891) took 2671 ms (client timeout 2233 ms). Trace:
I20260709 13:16:39.874455 13785 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.874425 10490 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), now has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:39.826300 13943 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:16:39.817762 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 270935us
I20260709 13:16:39.824009 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:39.860569 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 467487us
I20260709 13:16:39.524026 13949 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.862313 10660 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:39.860594 10593 rpcz_store.cc:276] 0709 13:16:37.045530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.045626 (+    96us) service_pool.cc:224] Handling call
0709 13:16:37.045879 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.088022 (+ 42143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.088051 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.100049 (+1011998us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b2c00000f48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:38.100537 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.187319 (+ 86782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:38.318515 (+131196us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.321160 (+  2645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.321258 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.016547 (+695289us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:39.698610 (+682063us) raft_consensus.cc:1685] finished
0709 13:16:39.698638 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.698786 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54708,"prepare.queue_time_us":214499,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":7660,"raft.queue_time_us":58544,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":14539,"spinlock_wait_cycles":7785600,"thread_start_us":201805,"threads_started":2,"wal-append.queue_time_us":104388}
W20260709 13:16:39.814064 13966 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:16:39.610412 13881 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.976152 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.695142 13782 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:39.831818 13947 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.877147 10490 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 8, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:39.873721 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 339827us
I20260709 13:16:39.834357 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:39.989537 10669 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
W20260709 13:16:39.873165 10738 rpcz_store.cc:269] 0709 13:16:37.164582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.766633 (+602051us) service_pool.cc:224] Handling call
0709 13:16:39.835559 (+2068926us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54001cd754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:39.835694 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991368576}
I20260709 13:16:39.914534 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:39.916324 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:39.853215 10588 rpcz_store.cc:276] 0709 13:16:38.322337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.322479 (+   142us) service_pool.cc:224] Handling call
0709 13:16:38.322783 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.323014 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:39.304431 (+981417us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.616689 (+312258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.616736 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.616786 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.616857 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.617016 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7799,"prepare.queue_time_us":290537,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":6734,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":45974,"thread_start_us":1260705,"threads_started":2,"wal-append.queue_time_us":534727}
W20260709 13:16:39.990787 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 76350.2us
W20260709 13:16:39.924062 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.982029 10591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.001s	sys 0.044s
W20260709 13:16:39.992169 10591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.001s	sys 0.044s
I20260709 13:16:39.782104 13896 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:39.935508 13888 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:39.873066 13648 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:39.784691 13934 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:39.940711 10667 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:39.948504 10665 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:39.978394 13948 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.020s	user 0.007s	sys 0.004s
I20260709 13:16:39.985301 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:39.813361 13918 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:39.993870 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:39.988319 13567 consensus_meta.cc:287] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 13:16:39.987838 11418 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:39.984467 10632 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:39.985715 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 161549us
I20260709 13:16:39.871611 13866 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.991107 11382 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.022639 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:39.986781 13929 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:16:39.880089 13823 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.005539 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:39.729053 13766 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:40.011495 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.017056 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:39.991050 13876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.028s	sys 0.091s
I20260709 13:16:39.866616 13788 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:16:39.979508 13949 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:39.983035 13943 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:39.978782 13955 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.015s	user 0.000s	sys 0.009s
W20260709 13:16:39.955610 13915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.022s	sys 0.020s
I20260709 13:16:39.983950 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:40.020678 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:40.036346 10667 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:16:40.024050 13946 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:39.983232 13916 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.027035 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.016853 10490 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.031656 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.032151 11415 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:40.008471 13964 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.017858 10586 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
W20260709 13:16:40.051455 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 67045.7us
W20260709 13:16:40.078496 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51569.6us
I20260709 13:16:40.078872 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:40.079238 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.023940 13782 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.974117 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:39.867472 13844 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:39.906124 13792 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.017653 13762 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.983434 13940 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:40.022742 13833 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:39.867318 13961 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.078527 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.032442 13627 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:16:39.991849 13828 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:40.045096 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:39.975605 13881 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.030364 13821 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:40.029695 13876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.028s	sys 0.091s
I20260709 13:16:40.102957 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:40.009999 13896 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.002887 13947 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:39.523293 10492 rpcz_store.cc:269] 0709 13:16:03.573226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.615169 (+ 41943us) service_pool.cc:224] Handling call
0709 13:16:39.515549 (+35900380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:25.646880 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:25.842950 (+196070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:25.853103 (+ 10153us) write_op.cc:435] Acquired schema lock
0709 13:16:25.858215 (+  5112us) tablet.cc:662] Decoding operations
0709 13:16:25.937053 (+ 78838us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:25.937173 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:25.937201 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:25.938266 (+  1065us) tablet.cc:701] Row locks acquired
0709 13:16:25.938332 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:16:25.938520 (+   188us) write_op.cc:270] Start()
0709 13:16:25.938695 (+   175us) write_op.cc:276] Timestamp: P: 1783602985938449 usec, L: 0
0709 13:16:25.938737 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:16:25.939983 (+  1246us) log.cc:844] Serialized 4026 byte log entry
0709 13:16:27.556617 (+1616634us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:28.275113 (+718496us) op_driver.cc:464] REPLICATION: finished
0709 13:16:29.024045 (+748932us) write_op.cc:301] APPLY: starting
0709 13:16:29.066199 (+ 42154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:29.109466 (+ 43267us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:29.109505 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:29.121098 (+ 11593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:29.266168 (+145070us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:16:29.327341 (+ 61173us) write_op.cc:312] APPLY: finished
0709 13:16:29.553552 (+226211us) log.cc:844] Serialized 77 byte log entry
0709 13:16:29.896645 (+343093us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.905656 (+  9011us) write_op.cc:454] Released schema lock
0709 13:16:29.933138 (+ 27482us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:29.998732 (+ 65594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.998763 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2056807,"reported_tablets":41,"spinlock_wait_cycles":11520,"child_traces":[["op",{"apply.queue_time_us":583747,"apply.run_cpu_time_us":115297,"apply.run_wall_time_us":947258,"num_ops":10,"prepare.queue_time_us":81354,"prepare.run_cpu_time_us":39451,"prepare.run_wall_time_us":475451,"raft.queue_time_us":679645,"raft.run_cpu_time_us":94582,"raft.run_wall_time_us":382150,"replication_time_us":2336209,"spinlock_wait_cycles":687221120,"thread_start_us":981695,"threads_started":5,"wal-append.queue_time_us":1184357,"wal-append.run_cpu_time_us":66201,"wal-append.run_wall_time_us":4955273}]]}
W20260709 13:16:40.042166 13915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.023s	sys 0.020s
I20260709 13:16:40.108919 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.034013 13917 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:40.081393 13857 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.098971 13547 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:40.078431 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:40.244153 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 165758us
I20260709 13:16:40.244377 13042 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:40.023795 13934 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.010088 13927 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:40.106797 13943 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.104302 13949 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.029938 13567 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.111492 13791 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.114269 13782 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:40.169606 10490 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 6, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.110056 13959 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.166632 10663 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:40.106243 13971 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.033951 13866 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:40.187706 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:40.191345 13884 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.194765 13572 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.195744 13954 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:40.198872 13956 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.000s
I20260709 13:16:40.198767 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.279569 10490 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 6, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.292265 10585 raft_consensus.cc:2393] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:40.172281 13648 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:40.303788 13956 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
W20260709 13:16:40.305353 13970 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:16:40.203011 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 329) took 3168 ms. Trace:
W20260709 13:16:40.306143 10560 connection.cc:256] RPC call timeout handler was delayed by -1.7472350520001783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:16:40.306361 10661 rpcz_store.cc:276] 0709 13:16:37.033395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.198599 (+165204us) service_pool.cc:224] Handling call
0709 13:16:37.198840 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.220434 (+1021594us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:38.344983 (+124549us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.911175 (+566192us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.955494 (+ 44319us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.955643 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.955677 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.955737 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.201159 (+1245422us) raft_consensus.cc:1685] finished
0709 13:16:40.201178 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.201301 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1160003,"raft.queue_time_us":1345744,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":12678,"thread_start_us":364135,"threads_started":2,"wal-append.queue_time_us":471049}
I20260709 13:16:40.308424 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:40.205169 10662 consensus_meta.cc:287] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
W20260709 13:16:40.206192 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 103292us
I20260709 13:16:40.309507 10662 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:40.105695 13916 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.310114 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:40.310282 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.211959 10594 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:40.213006 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:40.307021 10560 connection.cc:256] RPC call timeout handler was delayed by -1.1370350520001011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:16:40.213696 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:40.245117 13042 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:40.247222 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 206268us
I20260709 13:16:40.122973 13762 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:40.258415 13815 consensus_queue.cc:1175] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e71e2e44af1e46d8a8423ae08646bc22" responder_term: 13 status { last_received { term: 11 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:40.250427 10593 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:40.247821 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:40.210522 13940 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.105911 13781 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:40.255769 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:40.265074 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:40.251570 13967 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.385s	user 0.001s	sys 0.009s
I20260709 13:16:40.269925 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:40.271216 10668 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:40.271687 10587 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:40.264871 13945 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.246289 13949 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.178062 13968 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:16:40.292308 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:40.295761 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:40.298034 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:40.299540 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:40.250875 13935 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:16:40.301095 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:40.301589 13567 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.303354 13782 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.305912 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:40.251303 13917 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:40.540045 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.550550 10560 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.310300 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:40.551116 10586 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
W20260709 13:16:40.401911 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.551820 10662 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:40.537968 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2121) took 1221 ms. Trace:
I20260709 13:16:40.419986 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:40.552707 10660 rpcz_store.cc:276] 0709 13:16:39.317053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.505220 (+188167us) service_pool.cc:224] Handling call
0709 13:16:39.862092 (+356872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.936838 (+ 74746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.537802 (+600964us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001de050. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:40.537918 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577751296}
I20260709 13:16:40.418740 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2111) took 1432 ms. Trace:
I20260709 13:16:40.265808 13927 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.537140 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2106) took 1578 ms. Trace:
I20260709 13:16:40.312103 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:40.432695 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1496) took 2013 ms. Trace:
I20260709 13:16:40.552120 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:40.480095 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.311353 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.367650 10592 rpcz_store.cc:276] 0709 13:16:38.278688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.285816 (+  7128us) service_pool.cc:224] Handling call
0709 13:16:38.286138 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.286371 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:38.867225 (+580854us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.358702 (+491477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.358752 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.358789 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.358846 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.358953 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11207,"prepare.queue_time_us":326943,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7851,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":1575,"thread_start_us":1031621,"threads_started":2}
I20260709 13:16:40.555447 11418 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:16:40.399585 11381 connection.cc:256] RPC call timeout handler was delayed by -1.1001201679998758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:16:40.426656 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:40.407045 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.556813 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:40.552619 10559 connection.cc:256] RPC call timeout handler was delayed by -1.3007027120002022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:16:40.557780 10735 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:40.519066 10589 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:40.270928 13959 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.315987 10742 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:40.860764 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.354398 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1508) took 1097 ms. Trace:
I20260709 13:16:41.354830 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1916) took 1058 ms. Trace:
I20260709 13:16:40.328127 13866 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:40.317461 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:41.188508 13648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.006s	sys 0.011s
I20260709 13:16:40.756224 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:41.365892 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1912) took 1070 ms. Trace:
I20260709 13:16:40.670675 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2109) took 1696 ms. Trace:
I20260709 13:16:41.366802 10742 rpcz_store.cc:276] 0709 13:16:40.295073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.295241 (+   168us) service_pool.cc:224] Handling call
0709 13:16:40.315821 (+ 20580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.365645 (+1049824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.365832 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.395879 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.366786 10743 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:16:40.562958 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.131880 13042 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.725272 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:40.586673 11409 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:40.877262 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.370937 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1511) took 1104 ms. Trace:
I20260709 13:16:41.357757 10594 rpcz_store.cc:276] 0709 13:16:38.419098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.425903 (+  6805us) service_pool.cc:224] Handling call
0709 13:16:38.482810 (+ 56907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:40.311041 (+1828231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.432393 (+121352us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540016b054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:40.432629 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3976036608}
W20260709 13:16:41.218418 10739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.000s	sys 0.019s
I20260709 13:16:40.423254 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:41.373615 10739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.002s	sys 0.021s
I20260709 13:16:41.354292 10663 rpcz_store.cc:276] 0709 13:16:38.959185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.966051 (+  6866us) service_pool.cc:224] Handling call
0709 13:16:38.966344 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.257202 (+1290858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.536823 (+279621us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003ab6d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:40.537071 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680133376}
I20260709 13:16:40.911306 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.356848 10490 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 5, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.355031 10734 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:40.554399 10667 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:40.559157 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:41.375998 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1856) took 1862 ms (client timeout 2138 ms). Trace:
I20260709 13:16:41.376161 10590 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:40.607564 10740 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:16:41.368086 10559 connection.cc:256] RPC call timeout handler was delayed by -1.203502712000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:16:41.376724 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1523) took 1068 ms. Trace:
W20260709 13:16:41.131441 10736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.003s	sys 0.012s
W20260709 13:16:41.377290 10559 connection.cc:256] RPC call timeout handler was delayed by -1.0793027120000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:16:40.609328 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.667752 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:40.559783 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:41.378547 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1510) took 1119 ms. Trace:
I20260709 13:16:41.378588 11411 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
W20260709 13:16:41.377592 10736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.003s	sys 0.018s
I20260709 13:16:41.374301 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1915) took 1078 ms. Trace:
I20260709 13:16:41.375511 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 401) took 1071 ms. Trace:
I20260709 13:16:41.354952 10591 rpcz_store.cc:276] 0709 13:16:40.258838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.860450 (+601612us) service_pool.cc:224] Handling call
0709 13:16:41.354345 (+493895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.380349 10734 rpcz_store.cc:276] 0709 13:16:40.304061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.426377 (+122316us) service_pool.cc:224] Handling call
0709 13:16:41.375459 (+949082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.354508 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.382320 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1527) took 1007 ms. Trace:
I20260709 13:16:41.377266 10590 rpcz_store.cc:276] 0709 13:16:40.308787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.558946 (+250159us) service_pool.cc:224] Handling call
0709 13:16:41.376673 (+817727us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.376416 10667 rpcz_store.cc:269] 0709 13:16:39.513809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.204269 (+690460us) service_pool.cc:224] Handling call
0709 13:16:41.375946 (+1171677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.385288 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.367035 10668 rpcz_store.cc:276] 0709 13:16:38.974493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.974773 (+   280us) service_pool.cc:224] Handling call
0709 13:16:40.670441 (+1695668us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400181854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:40.670607 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223321984}
I20260709 13:16:41.391553 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 349) took 1115 ms. Trace:
I20260709 13:16:41.376762 10741 rpcz_store.cc:276] 0709 13:16:40.296802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.296952 (+   150us) service_pool.cc:224] Handling call
0709 13:16:40.297222 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.610552 (+313330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.610596 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:40.610652 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.610697 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.665997 (+ 55300us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002bf054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:40.666052 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.354779 (+688727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720006912}
I20260709 13:16:40.639099 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.382189 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.369652 13042 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:41.384298 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 824527us
I20260709 13:16:41.394464 11411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 511) took 1438 ms. Trace:
I20260709 13:16:41.379042 10585 rpcz_store.cc:276] 0709 13:16:40.259491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.609070 (+349579us) service_pool.cc:224] Handling call
0709 13:16:41.378497 (+769427us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.384467 10589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 333) took 2376 ms (client timeout 2038 ms). Trace:
I20260709 13:16:40.554139 10665 rpcz_store.cc:276] 0709 13:16:38.986453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.986585 (+   132us) service_pool.cc:224] Handling call
0709 13:16:40.418538 (+1431953us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540012f554. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:40.418668 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686680832}
I20260709 13:16:41.371482 10586 rpcz_store.cc:276] 0709 13:16:40.266474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.551856 (+285382us) service_pool.cc:224] Handling call
0709 13:16:41.370871 (+819015us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.396940 10589 rpcz_store.cc:269] 0709 13:16:38.981116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.982608 (+  1492us) service_pool.cc:224] Handling call
0709 13:16:41.357241 (+2374633us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54002c92d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:41.357381 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296526208}
I20260709 13:16:41.397724 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.397913 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:41.398257 10665 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.398404 10589 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.385546 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.382905 10587 rpcz_store.cc:276] 0709 13:16:40.374573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.586972 (+212399us) service_pool.cc:224] Handling call
0709 13:16:41.382268 (+795296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.386584 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 352) took 1076 ms. Trace:
I20260709 13:16:41.366532 11413 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
W20260709 13:16:41.377892 10559 connection.cc:256] RPC call timeout handler was delayed by -1.0694027120000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:16:41.387288 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.399773 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:41.400023 10559 connection.cc:256] RPC call timeout handler was delayed by -1.0361027120002291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:16:41.400279 10663 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:41.400509 10587 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.400640 10663 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:41.400918 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1521) took 1092 ms. Trace:
I20260709 13:16:41.382876 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 403) took 1026 ms. Trace:
I20260709 13:16:41.401504 10738 rpcz_store.cc:276] 0709 13:16:40.356711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.423036 (+ 66325us) service_pool.cc:224] Handling call
0709 13:16:41.382826 (+959790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.401432 10663 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.402263 13876 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.402433 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.401226 10587 rpcz_store.cc:276] 0709 13:16:40.308307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.399575 (+1091268us) service_pool.cc:224] Handling call
0709 13:16:41.400870 (+  1295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.402905 13876 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.403780 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.050534 13572 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.405385 13973 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.380903 13983 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.405956 13973 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:41.406177 13983 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.406904 13973 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.408304 13983 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:40.558823 13778 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.878782 13985 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.399578 11418 rpcz_store.cc:276] 0709 13:16:40.291143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.292017 (+   874us) service_pool.cc:224] Handling call
0709 13:16:41.367728 (+1075711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.402365 10663 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.409782 13778 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.410833 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.383067 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1918) took 1085 ms. Trace:
I20260709 13:16:41.411988 10735 rpcz_store.cc:276] 0709 13:16:40.297678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.297807 (+   129us) service_pool.cc:224] Handling call
0709 13:16:41.383011 (+1085204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.412858 13042 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.413379 13042 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.413801 13042 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.415524 13042 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.415970 13042 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:41.389650 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 633478us
I20260709 13:16:41.393194 10660 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:41.416621 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:41.417068 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 332) took 1233 ms (client timeout 1525 ms). Trace:
I20260709 13:16:41.417351 10667 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:41.417469 10660 rpcz_store.cc:269] 0709 13:16:40.183252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.592323 (+409071us) service_pool.cc:224] Handling call
0709 13:16:41.417011 (+824688us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.417860 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1855) took 1904 ms (client timeout 2233 ms). Trace:
I20260709 13:16:41.416580 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.393344 13888 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.313386 13844 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:41.418247 10667 rpcz_store.cc:269] 0709 13:16:39.513580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.387761 (+1874181us) service_pool.cc:224] Handling call
0709 13:16:41.417812 (+ 30051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.420156 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.420679 10667 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:40.611193 13847 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:41.421093 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2135) took 1658 ms (client timeout 2096 ms). Trace:
W20260709 13:16:40.973644 13823 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.000s
I20260709 13:16:41.404773 13572 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.469062 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:41.472057 10585 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:41.399610 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1522) took 1091 ms. Trace:
I20260709 13:16:41.411587 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1506) took 1161 ms. Trace:
I20260709 13:16:40.502919 13774 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.472440 10590 rpcz_store.cc:276] 0709 13:16:40.308552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.385334 (+1076782us) service_pool.cc:224] Handling call
0709 13:16:41.399559 (+ 14225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.472560 10594 rpcz_store.cc:276] 0709 13:16:40.250377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.384214 (+1133837us) service_pool.cc:224] Handling call
0709 13:16:41.411531 (+ 27317us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.312597 13874 consensus_meta.cc:287] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.444s	user 0.008s	sys 0.002s
I20260709 13:16:41.381047 13917 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:41.420989 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:41.487588 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 66905.1us
I20260709 13:16:41.487778 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1922) took 1188 ms. Trace:
I20260709 13:16:41.488171 10740 rpcz_store.cc:276] 0709 13:16:40.299048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.299322 (+   274us) service_pool.cc:224] Handling call
0709 13:16:41.487460 (+1188138us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54002be654. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:41.487625 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115454720}
I20260709 13:16:40.318693 13881 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:41.375231 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1509) took 1116 ms. Trace:
I20260709 13:16:41.489223 10593 rpcz_store.cc:276] 0709 13:16:40.259172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.551786 (+292614us) service_pool.cc:224] Handling call
0709 13:16:40.911134 (+359348us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:41.375179 (+464045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5758848}
I20260709 13:16:41.490180 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.392144 11409 rpcz_store.cc:276] 0709 13:16:40.255329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.255491 (+   162us) service_pool.cc:224] Handling call
0709 13:16:41.370644 (+1115153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.879000 13884 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:16:41.507513 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.507936 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:40.558727 13949 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:40.534691 13786 consensus_meta.cc:287] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.012s	user 0.006s	sys 0.006s
I20260709 13:16:41.467986 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.468266 10743 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:40.375052 13828 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.443022 10663 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:41.418449 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.512180 10660 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:41.468820 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.015s
I20260709 13:16:41.467864 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.513314 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1927) took 1054 ms. Trace:
I20260709 13:16:41.409058 10589 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:41.460628 10662 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:41.469146 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1505) took 1219 ms. Trace:
I20260709 13:16:41.513945 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1525) took 1189 ms. Trace:
I20260709 13:16:41.410287 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 350) took 1148 ms. Trace:
I20260709 13:16:41.435122 10666 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:40.311560 13791 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.422112 13847 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:41.475368 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.476392 13572 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.477159 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.477361 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.476333 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1524) took 1151 ms. Trace:
I20260709 13:16:40.584371 13865 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:41.405118 13876 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:41.421936 10667 rpcz_store.cc:269] 0709 13:16:39.763140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.419928 (+1656788us) service_pool.cc:224] Handling call
0709 13:16:41.421044 (+  1116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.667941 13762 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:40.584263 13975 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.618290 13974 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.508s	user 0.007s	sys 0.000s
W20260709 13:16:41.219040 13742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.000s	sys 0.015s
I20260709 13:16:41.379817 10739 rpcz_store.cc:276] 0709 13:16:40.296050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.296204 (+   154us) service_pool.cc:224] Handling call
0709 13:16:40.311842 (+ 15638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.312032 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:40.312288 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.374021 (+1061733us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.374063 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.374108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.374161 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.374254 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":532,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":9931,"thread_start_us":1061437,"threads_started":1,"wal-append.queue_time_us":1043341}
I20260709 13:16:40.552155 13940 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:41.557569 13940 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.558945 10660 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:16:41.559677 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 331) took 1376 ms (client timeout 1634 ms). Trace:
W20260709 13:16:41.560318 10660 rpcz_store.cc:269] 0709 13:16:40.183016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.418214 (+1235198us) service_pool.cc:224] Handling call
0709 13:16:41.559603 (+141389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.484416 13874 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.485631 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:40.955040 13788 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.356734 11410 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:40.431650 13547 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.376439 13916 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:40.319437 13792 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.320066 13918 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:40.315121 13934 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:40.373945 13961 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.514456 13786 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.496035 10665 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:40.337265 13947 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.411595 10490 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 4, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.588533 10490 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 5, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.508097 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1920) took 1209 ms. Trace:
W20260709 13:16:41.357265 13648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.007s	sys 0.015s
I20260709 13:16:41.589365 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:40.584257 13968 consensus_queue.cc:1243] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:40.607151 13781 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:41.567600 13547 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.591701 13781 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:40.638264 13875 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.326504 13896 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.510040 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1514) took 1231 ms. Trace:
I20260709 13:16:41.486675 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:41.510468 10668 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.508282 10735 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:41.601280 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1921) took 1302 ms. Trace:
I20260709 13:16:41.601572 10735 rpcz_store.cc:276] 0709 13:16:40.298415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.507269 (+1208854us) service_pool.cc:224] Handling call
0709 13:16:41.601228 (+ 93959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.510562 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1924) took 1210 ms. Trace:
W20260709 13:16:41.512120 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1861) took 1997 ms (client timeout 2231 ms). Trace:
W20260709 13:16:41.512771 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.011s	sys 0.015s
W20260709 13:16:41.602172 10663 rpcz_store.cc:269] 0709 13:16:39.514949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.387044 (+1872095us) service_pool.cc:224] Handling call
0709 13:16:41.512065 (+125021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.602089 10743 rpcz_store.cc:276] 0709 13:16:40.299837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.300876 (+  1039us) service_pool.cc:224] Handling call
0709 13:16:41.510517 (+1209641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.603071 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:41.514043 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1872) took 1968 ms (client timeout 2200 ms). Trace:
I20260709 13:16:41.603770 10663 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:41.603588 10662 rpcz_store.cc:269] 0709 13:16:39.555984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.876949 (+1320965us) service_pool.cc:224] Handling call
0709 13:16:41.513971 (+637022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.584633 13945 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.394824 11411 rpcz_store.cc:276] 0709 13:16:39.941332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.941468 (+   136us) service_pool.cc:224] Handling call
0709 13:16:40.667591 (+726123us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194e9c 00007f4254194a5b 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:41.379332 (+711741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70533248}
I20260709 13:16:41.514317 10589 rpcz_store.cc:276] 0709 13:16:40.324925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.397710 (+1072785us) service_pool.cc:224] Handling call
0709 13:16:41.513893 (+116183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.604821 10587 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.514091 10592 rpcz_store.cc:276] 0709 13:16:40.250139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.381903 (+1131764us) service_pool.cc:224] Handling call
0709 13:16:41.469088 (+ 87185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.514693 10666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1858) took 2000 ms (client timeout 2060 ms). Trace:
W20260709 13:16:41.605394 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 330) took 1422 ms (client timeout 1885 ms). Trace:
I20260709 13:16:41.513675 10734 rpcz_store.cc:276] 0709 13:16:40.458489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.395592 (+937103us) service_pool.cc:224] Handling call
0709 13:16:41.513262 (+117670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.605742 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.514480 11413 rpcz_store.cc:276] 0709 13:16:40.262055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.262572 (+   517us) service_pool.cc:224] Handling call
0709 13:16:41.410227 (+1147655us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.605845 10663 rpcz_store.cc:269] 0709 13:16:40.182767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.602855 (+1420088us) service_pool.cc:224] Handling call
0709 13:16:41.605307 (+  2452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.383822 13959 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.520320 10585 rpcz_store.cc:276] 0709 13:16:40.324661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.468832 (+1144171us) service_pool.cc:224] Handling call
0709 13:16:41.476278 (+  7446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.609201 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.482409 13823 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.542761 13847 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.512308 13766 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.544780 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.612250 10667 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:41.612728 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2134) took 1849 ms (client timeout 2155 ms). Trace:
W20260709 13:16:41.613080 10667 rpcz_store.cc:269] 0709 13:16:39.762863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.539673 (+1776810us) service_pool.cc:224] Handling call
0709 13:16:41.612672 (+ 72999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.514171 13816 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.547155 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1926) took 1089 ms. Trace:
I20260709 13:16:41.547858 13975 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.613772 10742 rpcz_store.cc:276] 0709 13:16:40.458202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.422421 (+964219us) service_pool.cc:224] Handling call
0709 13:16:41.547076 (+124655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.492319 13774 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.575645 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1923) took 1276 ms. Trace:
I20260709 13:16:41.537428 13656 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.562544 13742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.003s	sys 0.019s
I20260709 13:16:41.567895 13788 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.493707 10664 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:41.587136 10665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1888) took 1481 ms (client timeout 1700 ms). Trace:
I20260709 13:16:41.508888 10594 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:41.589643 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.589651 10740 rpcz_store.cc:276] 0709 13:16:40.298198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.507352 (+1209154us) service_pool.cc:224] Handling call
0709 13:16:41.507636 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.507800 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.507824 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.507860 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:41.507890 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.507940 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.508050 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.581668 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 347) took 1329 ms. Trace:
I20260709 13:16:41.600311 10490 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.600863 10593 rpcz_store.cc:276] 0709 13:16:40.279149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.489983 (+1210834us) service_pool.cc:224] Handling call
0709 13:16:41.509981 (+ 19998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.409839 13985 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.518646 10590 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:41.605468 10666 rpcz_store.cc:269] 0709 13:16:39.514270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.212703 (+698433us) service_pool.cc:224] Handling call
0709 13:16:41.514643 (+1301940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.673597 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.674602 10666 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:41.675050 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1895) took 1271 ms. Trace:
I20260709 13:16:41.675418 10666 rpcz_store.cc:276] 0709 13:16:40.403194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.673273 (+1270079us) service_pool.cc:224] Handling call
0709 13:16:41.674987 (+  1714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.676330 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.676469 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 398) took 1648 ms. Trace:
I20260709 13:16:41.507177 13738 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:41.676959 10666 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:41.604821 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 118210us
I20260709 13:16:41.677713 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1513) took 1406 ms. Trace:
I20260709 13:16:41.678701 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1517) took 1371 ms. Trace:
I20260709 13:16:41.678702 10590 rpcz_store.cc:276] 0709 13:16:40.271670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.475144 (+1203474us) service_pool.cc:224] Handling call
0709 13:16:41.677658 (+202514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.607969 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.680231 10662 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:41.608443 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 405) took 1166 ms. Trace:
W20260709 13:16:41.680740 10662 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1886) took 1636 ms (client timeout 2080 ms). Trace:
I20260709 13:16:41.611241 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.680812 10743 rpcz_store.cc:276] 0709 13:16:40.441879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.607696 (+1165817us) service_pool.cc:224] Handling call
0709 13:16:41.607972 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.608142 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.608168 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.608208 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:41.608244 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.608297 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.608389 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.681679 10589 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:41.561865 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.682895 10660 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
W20260709 13:16:41.683444 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1890) took 1541 ms (client timeout 1776 ms). Trace:
W20260709 13:16:41.683851 10660 rpcz_store.cc:269] 0709 13:16:40.165651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.561157 (+1395506us) service_pool.cc:224] Handling call
0709 13:16:41.683383 (+122226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.612105 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1519) took 1304 ms. Trace:
I20260709 13:16:41.684748 10585 rpcz_store.cc:276] 0709 13:16:40.307837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.608991 (+1301154us) service_pool.cc:224] Handling call
0709 13:16:41.612051 (+  3060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.686224 10585 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:41.687021 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 344) took 1501 ms. Trace:
I20260709 13:16:41.686297 10490 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 8, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:41.687403 10585 rpcz_store.cc:276] 0709 13:16:40.185507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.685716 (+1500209us) service_pool.cc:224] Handling call
0709 13:16:41.686021 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.686760 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.686964 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.688354 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.37618e+06us
I20260709 13:16:41.600503 13792 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.623207 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.622308 10739 rpcz_store.cc:276] 0709 13:16:40.299342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.556810 (+1257468us) service_pool.cc:224] Handling call
0709 13:16:41.575186 (+ 18376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.575356 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.575378 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.575423 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.575458 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.575509 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.575597 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.650173 13656 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.652390 13788 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.621698 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1929) took 1003 ms. Trace:
I20260709 13:16:41.653553 10669 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.654660 10734 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:41.648854 10586 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:16:41.611811 13992 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:16:41.654433 10665 rpcz_store.cc:269] 0709 13:16:40.106062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.397526 (+1291464us) service_pool.cc:224] Handling call
0709 13:16:41.587079 (+189553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.699625 10742 rpcz_store.cc:276] 0709 13:16:40.618457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.614496 (+996039us) service_pool.cc:224] Handling call
0709 13:16:41.621187 (+  6691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.621381 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.621426 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.621465 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.621502 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.621553 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.621653 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.702648 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.599992 13961 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:16:41.679203 10594 rpcz_store.cc:276] 0709 13:16:40.307310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.473675 (+1166365us) service_pool.cc:224] Handling call
0709 13:16:41.678643 (+204968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.677453 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2137) took 1913 ms. Trace:
W20260709 13:16:41.681124 10662 rpcz_store.cc:269] 0709 13:16:40.074839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.607758 (+1532919us) service_pool.cc:224] Handling call
0709 13:16:41.680691 (+ 72933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.706079 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 343) took 1597 ms. Trace:
I20260709 13:16:41.611951 13947 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.708772 10737 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:41.676807 10736 rpcz_store.cc:276] 0709 13:16:40.027841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.027997 (+   156us) service_pool.cc:224] Handling call
0709 13:16:40.028434 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.028741 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:40.131188 (+102447us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.676165 (+1544977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.676214 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.676263 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.676324 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.676422 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20200,"prepare.queue_time_us":152928,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":22525,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":58331,"thread_start_us":1634678,"threads_started":3,"wal-append.queue_time_us":1377841}
I20260709 13:16:41.690090 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:41.606899 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.710618  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:41.693396 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.695987 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1986) took 1591 ms. Trace:
I20260709 13:16:41.711424 10590 rpcz_store.cc:276] 0709 13:16:40.104984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.695072 (+1590088us) service_pool.cc:224] Handling call
0709 13:16:41.695390 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.695605 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.695640 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.695694 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:41.695746 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.695812 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.695924 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.712224 13959 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.712769 10590 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.712941 13774 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.713783 13985 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.714018 13874 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:41.690678 13648 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:41.700618 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1928) took 1083 ms. Trace:
I20260709 13:16:41.700544 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1516) took 1393 ms. Trace:
I20260709 13:16:41.722810 10734 rpcz_store.cc:276] 0709 13:16:40.617634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.611933 (+994299us) service_pool.cc:224] Handling call
0709 13:16:41.654366 (+ 42433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.700394 (+ 46028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.700573 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.722879 10586 rpcz_store.cc:276] 0709 13:16:40.306967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.397702 (+1090735us) service_pool.cc:224] Handling call
0709 13:16:41.589496 (+191794us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800000098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:41.700493 (+110997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788736}
I20260709 13:16:41.605116 13875 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.606546 10592 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:41.726994 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 6, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 6 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:41.728091 10669 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:41.711067 10663 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:41.703292 10665 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
W20260709 13:16:41.728870 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1897) took 1325 ms (client timeout 1747 ms). Trace:
I20260709 13:16:41.729048 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1894) took 1326 ms. Trace:
W20260709 13:16:41.729233 10663 rpcz_store.cc:269] 0709 13:16:40.403664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.606690 (+1203026us) service_pool.cc:224] Handling call
0709 13:16:41.728815 (+122125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.729391 10665 rpcz_store.cc:276] 0709 13:16:40.402970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.702429 (+1299459us) service_pool.cc:224] Handling call
0709 13:16:41.728999 (+ 26570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.730290 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.731040 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1867) took 2187 ms. Trace:
I20260709 13:16:41.731334 10665 rpcz_store.cc:276] 0709 13:16:39.544301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.730091 (+2185790us) service_pool.cc:224] Handling call
0709 13:16:41.730992 (+   901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.732106 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.678180 11414 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:41.703934 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.733446 10660 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:41.733965 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1896) took 1330 ms. Trace:
I20260709 13:16:41.734236 10660 rpcz_store.cc:276] 0709 13:16:40.403413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.684577 (+1281164us) service_pool.cc:224] Handling call
0709 13:16:41.733919 (+ 49342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.677255 13738 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.706420 10589 rpcz_store.cc:276] 0709 13:16:40.108329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.692978 (+1584649us) service_pool.cc:224] Handling call
0709 13:16:41.705655 (+ 12677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.705811 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.705833 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.705868 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.705903 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.705949 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.706031 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.738258 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.738945 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1893) took 1336 ms. Trace:
I20260709 13:16:41.739223 10660 rpcz_store.cc:276] 0709 13:16:40.402758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.734791 (+1332033us) service_pool.cc:224] Handling call
0709 13:16:41.738895 (+  4104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.707167 10666 rpcz_store.cc:276] 0709 13:16:39.763670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.676138 (+1912468us) service_pool.cc:224] Handling call
0709 13:16:41.677398 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.707296 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:41.740799 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1862) took 2225 ms. Trace:
I20260709 13:16:41.706103 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.741123 10666 rpcz_store.cc:276] 0709 13:16:39.515170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.740131 (+2224961us) service_pool.cc:224] Handling call
0709 13:16:41.740367 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.740536 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.740561 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.740596 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:41.740625 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.740673 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.740753 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.699369 13792 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.748279 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.749457 10660 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:41.750272 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1891) took 1575 ms. Trace:
I20260709 13:16:41.613375 10632 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:41.713361 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1515) took 1420 ms. Trace:
W20260709 13:16:41.751806 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 356739us
I20260709 13:16:41.751680 10590 rpcz_store.cc:276] 0709 13:16:40.293081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.712363 (+1419282us) service_pool.cc:224] Handling call
0709 13:16:41.712610 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.713132 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.713294 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.697989 10667 raft_consensus.cc:2410] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:41.621258 13816 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.652947 11410 rpcz_store.cc:276] 0709 13:16:40.247011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.250740 (+  3729us) service_pool.cc:224] Handling call
0709 13:16:41.568067 (+1317327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.621354 13766 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.732601 10665 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:41.728579 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 347) took 1194 ms. Trace:
I20260709 13:16:41.767031 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1868) took 2222 ms. Trace:
W20260709 13:16:41.767454 10667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1854) took 2254 ms (client timeout 2675 ms). Trace:
I20260709 13:16:41.767658 10591 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:41.767992 10667 rpcz_store.cc:269] 0709 13:16:39.513297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.621447 (+2108150us) service_pool.cc:224] Handling call
0709 13:16:41.767383 (+145936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.766934 10592 rpcz_store.cc:276] 0709 13:16:40.533960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.727908 (+1193948us) service_pool.cc:224] Handling call
0709 13:16:41.728160 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.728304 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.728327 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.728363 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:41.728391 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.728437 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.728533 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.741642 10662 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:41.689287 13847 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.708230 13947 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.750922 10660 rpcz_store.cc:276] 0709 13:16:40.175161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.739769 (+1564608us) service_pool.cc:224] Handling call
0709 13:16:41.750171 (+ 10402us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:41.754209 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 140901us
I20260709 13:16:41.751283 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:41.746122 13738 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.746971 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1526) took 1421 ms. Trace:
I20260709 13:16:41.792210 10594 rpcz_store.cc:276] 0709 13:16:40.325184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.725641 (+1400457us) service_pool.cc:224] Handling call
0709 13:16:41.746382 (+ 20741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.746579 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.746615 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.746668 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.746720 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.746786 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.746897 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.762681 10490 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:41.793886 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.794353 10490 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 8, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.710716 13998 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.803248 13998 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.722177 13961 consensus_queue.cc:1243] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:41.769433 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2132) took 2007 ms. Trace:
I20260709 13:16:41.805806 10662 rpcz_store.cc:276] 0709 13:16:39.762283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.705895 (+1943612us) service_pool.cc:224] Handling call
0709 13:16:41.769349 (+ 63454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.806886 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.807554 10662 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:41.808622 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.745879 13788 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.769290 10635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1876) took 2170 ms. Trace:
I20260709 13:16:41.809513 13788 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.809551 10635 rpcz_store.cc:276] 0709 13:16:39.599231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.769239 (+2170008us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:41.810072 13788 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:41.810309 10635 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35982 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:41.767479 10665 rpcz_store.cc:276] 0709 13:16:39.544582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.731909 (+2187327us) service_pool.cc:224] Handling call
0709 13:16:41.766977 (+ 35068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.810506 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1507) took 1559 ms. Trace:
I20260709 13:16:41.811007 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:41.765952 13989 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:16:41.775102 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.754843 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.812275 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2138) took 2048 ms. Trace:
I20260709 13:16:41.812609 10663 rpcz_store.cc:276] 0709 13:16:39.763943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.754630 (+1990687us) service_pool.cc:224] Handling call
0709 13:16:41.812225 (+ 57595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.811019 10587 rpcz_store.cc:276] 0709 13:16:40.251133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.403582 (+1152449us) service_pool.cc:224] Handling call
0709 13:16:41.810261 (+406679us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001abdd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:41.810437 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460786560}
I20260709 13:16:41.817963 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.819157 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.779067 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.781162 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:41.782650 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 413690us
I20260709 13:16:41.782760 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.762168 13999 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.764966 14004 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.783375 13786 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.770674 13782 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:16:41.784783 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:41.833359 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.728575 13648 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:41.790712 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.839226 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.763679 13792 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.774506 13947 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.798722 13419 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:41.798789 10668 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:41.794577 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:41.851615 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2128) took 2191 ms (client timeout 2143 ms). Trace:
I20260709 13:16:41.802595 13656 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:41.851600 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1873) took 2295 ms (client timeout 1852 ms). Trace:
I20260709 13:16:41.814831 10589 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.815378 10736 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:16:41.852735 10669 rpcz_store.cc:269] 0709 13:16:39.556311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.419649 (+863338us) service_pool.cc:224] Handling call
0709 13:16:41.851411 (+1431762us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000c2954. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:41.851523 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529742208}
I20260709 13:16:41.808938 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 404) took 1367 ms. Trace:
I20260709 13:16:41.853708 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.853591 10735 rpcz_store.cc:276] 0709 13:16:40.441524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.608919 (+1167395us) service_pool.cc:224] Handling call
0709 13:16:41.609140 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.805958 (+196818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.806004 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.806059 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:41.806105 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.808672 (+  2567us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540009f454. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:41.808727 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.808872 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452110720}
I20260709 13:16:41.775292 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.854930 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.826221 13874 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.826648 10490 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 5, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.810544 10635 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35982 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2170)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2159)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2161)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1866)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1869)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1874)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1875)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1881)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2129)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1885)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1889)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2169)
I20260709 13:16:41.831382 10739 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:16:41.832191 13997 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:16:41.833878 13999 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:41.833916 10663 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:41.880179 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.880872 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:41.881695 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.882423 10663 raft_consensus.cc:2410] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:41.837440 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:41.837872 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.844941 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1518) took 1537 ms. Trace:
I20260709 13:16:41.884415 10591 rpcz_store.cc:276] 0709 13:16:40.307600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.385091 (+1077491us) service_pool.cc:224] Handling call
0709 13:16:41.844745 (+459654us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001e55d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:41.844867 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877864704}
I20260709 13:16:41.846740 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.849130 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.849921 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:41.852159 10668 rpcz_store.cc:269] 0709 13:16:39.660458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.426879 (+1766421us) service_pool.cc:224] Handling call
0709 13:16:41.851533 (+424654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.887481 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.887562 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.771289 13985 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:16:41.893294 10634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.016s
I20260709 13:16:41.856662 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:41.895263 10741 raft_consensus.cc:2410] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:41.856048 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.774084 13945 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:41.876998 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.830613 10742 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:41.813277 13823 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.889904 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.897065 10735 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.897995 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.899250 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.889154 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.900517 10668 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:41.891826 10660 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.900748 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.891381 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:41.901616 10669 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:41.894459 10490 catalog_manager.cc:5697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 4, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.832603 13994 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:16:41.875957 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 81475.9us
I20260709 13:16:41.834033 14004 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:41.894336 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.906409 10663 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:41.907449 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.908105 10663 raft_consensus.cc:2376] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9. Re-sending same reply.
I20260709 13:16:41.909842 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.774878 13940 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:41.911497 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.851460 13888 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.918294 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 427116us
I20260709 13:16:41.918864 10490 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.912616 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:41.913012 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.920236 10660 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:41.921061 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:41.913581 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.913947 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.922955 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:41.875665 13419 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:41.889592 13999 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.909065 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:41.916639 10735 raft_consensus.cc:2393] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.893263 13778 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.917002 10586 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:41.890196 13961 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:41.889801 13874 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:41.917440 10634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.005s	sys 0.017s
I20260709 13:16:41.971084 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:42.184058 13927 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.001s
I20260709 13:16:42.193627 10588 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:41.945542 13888 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.184732 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.941839 13847 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.194479 10660 raft_consensus.cc:2393] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 5: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.195511 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.195691 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.196448 10660 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.196593 10735 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:42.197513 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.197659 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.198139 10660 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:42.199007 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:42.199070 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.199882 10660 raft_consensus.cc:2410] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:42.194469 13847 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.211724 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:41.912058 14004 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.064363 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.212481 10660 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:42.213388 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.213899 10660 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:42.214578 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:42.215166 10660 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.215806 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.094543 13419 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.193755 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:41.943549 13975 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:42.217061 13419 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.217458 13888 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:42.217767 10587 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:41.993321 13884 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.217s
I20260709 13:16:41.985181 13762 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.221s
I20260709 13:16:41.943336 10668 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:42.220850 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:42.221791 10668 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.206364 10663 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:42.050765 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 344313us
I20260709 13:16:41.944376 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.189239 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:42.223538 10669 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:42.224397 11414 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:42.224507 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.225098 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:42.225859 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.227087 10735 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:42.003750 13917 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.207s
I20260709 13:16:42.184818 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.222836 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.232133 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.232273 10668 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:42.185156 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.238107 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.238863 10741 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:42.239845 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.241154 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.242391 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.245638 10741 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:42.233369 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.248699 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.249964 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.250174 13945 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:42.004472 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:42.250751 13945 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:42.251371 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:42.251513 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 329528us
I20260709 13:16:41.974532 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.235361 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.211774 13847 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.236598 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.256009 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.211846 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.256644 10660 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:42.256783 10662 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:41.972434 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:42.259327 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 254948us
I20260709 13:16:42.248708 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.262010 10741 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:42.262835 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:42.227270 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:42.265883 10669 raft_consensus.cc:2376] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6. Re-sending same reply.
I20260709 13:16:42.267879 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1866) took 2751 ms. Trace:
I20260709 13:16:42.268368 10662 rpcz_store.cc:276] 0709 13:16:39.516126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.267105 (+2750979us) service_pool.cc:224] Handling call
0709 13:16:42.267364 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.267537 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.267560 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.267598 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.267633 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.267697 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.267820 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.270061 13648 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.270468 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1874) took 2677 ms. Trace:
I20260709 13:16:42.271337 14000 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.271960 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.272717 10735 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:42.273700 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.274484 10735 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:42.275863 10735 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:42.200151 13792 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.251169 13945 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:42.253271 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 64115us
I20260709 13:16:42.284337 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1863) took 2768 ms. Trace:
I20260709 13:16:42.243501 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.286033 10668 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:42.287240 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:42.252395 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.270918 10662 rpcz_store.cc:276] 0709 13:16:39.598318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.269574 (+2671256us) service_pool.cc:224] Handling call
0709 13:16:42.269875 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.270068 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.270102 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.270153 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.270225 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.270289 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.270400 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.290897 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1875) took 2692 ms. Trace:
I20260709 13:16:42.291460 10662 rpcz_store.cc:276] 0709 13:16:39.598815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.289691 (+2690876us) service_pool.cc:224] Handling call
0709 13:16:42.289981 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.290152 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.290187 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.290401 (+   214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.290469 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.290572 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.290833 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.293582 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1877) took 2666 ms. Trace:
W20260709 13:16:42.217094 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.297936 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:42.302337 10738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.005s	sys 0.008s
I20260709 13:16:42.284796 10666 rpcz_store.cc:276] 0709 13:16:39.515431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.742360 (+2226929us) service_pool.cc:224] Handling call
0709 13:16:41.742649 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.743047 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.743072 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.743577 (+   505us) log.cc:844] Serialized 52 byte log entry
0709 13:16:42.144467 (+400890us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.231048 (+ 86581us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.265297 (+ 34249us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.283938 (+ 18641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.284033 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.284088 (+    55us) raft_consensus.cc:1685] finished
0709 13:16:42.284106 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.284274 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41438,"prepare.queue_time_us":86213,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":41658,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":18419,"spinlock_wait_cycles":1440000,"thread_start_us":299714,"threads_started":2,"wal-append.queue_time_us":341795}
W20260709 13:16:42.302747 10738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.008s
I20260709 13:16:42.302243 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1879) took 2631 ms. Trace:
I20260709 13:16:42.305140 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.306036 10739 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:42.306303 10669 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:42.307075 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1869) took 2762 ms. Trace:
I20260709 13:16:42.304620 10668 rpcz_store.cc:276] 0709 13:16:39.671172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.301389 (+2630217us) service_pool.cc:224] Handling call
0709 13:16:42.301692 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.301873 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.301908 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.301958 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.302005 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.302070 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.302185 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.205045 13874 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.299690 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:42.300360 10742 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:42.300777 10735 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:42.287209 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.021063 13916 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.283s
I20260709 13:16:42.272257 13875 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.272219 13884 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:42.316143 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 482936us
I20260709 13:16:42.332861 10739 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:16:42.334129 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.301362 13918 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:42.337405 13918 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:42.337901 13918 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:42.338214 13788 consensus_meta.cc:287] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.004s
I20260709 13:16:42.338598 13788 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:42.323807 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.013s
I20260709 13:16:42.336921 13874 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.301581 14000 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:42.340097 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.000s	sys 0.013s
W20260709 13:16:42.361462 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 669699us
I20260709 13:16:42.360853 13874 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:42.327003 13881 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.368912 13918 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.377025 13874 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:42.392895 13949 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.876s	user 0.005s	sys 0.001s
I20260709 13:16:42.393759 13874 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.378182 13940 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.329123 13738 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.398288 13792 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:42.391448 13947 consensus_meta.cc:287] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.002s
I20260709 13:16:42.399844 13738 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.400096 13947 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.400761 11412 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:16:42.392927 13547 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.802s	user 0.006s	sys 0.002s
I20260709 13:16:42.402642 13947 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.402758 13547 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.405975 13949 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.419397 13949 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.412266 13945 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.428680 13945 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.416253 13918 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:42.410771 13547 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.409206 14000 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.434319 13999 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.436913 13999 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.420158 14004 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.445482 14004 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.414301 13788 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.423942 13847 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.448194 13847 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:41.982636 10490 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.497295 10490 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 9. New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.503177 10490 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 4, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.508006 10490 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:42.513450 10490 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 8, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), now has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:42.520298 10490 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:42.526796 10490 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 9, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:42.528672 10585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.015s	sys 0.024s
W20260709 13:16:42.529167 10585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.016s	sys 0.024s
I20260709 13:16:42.206287 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.530529 10594 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:42.531796 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.532581 10592 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:42.533336 10586 raft_consensus.cc:2410] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:42.533618 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:42.534391 10594 raft_consensus.cc:2376] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12. Re-sending same reply.
I20260709 13:16:42.536958 10594 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:42.537770 10591 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:42.538240 10588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1520) took 2230 ms (client timeout 1628 ms). Trace:
W20260709 13:16:42.538763 10588 rpcz_store.cc:269] 0709 13:16:40.308072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.406620 (+ 98548us) service_pool.cc:224] Handling call
0709 13:16:42.537730 (+2131110us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:42.537987 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902890368}
I20260709 13:16:42.539362 10587 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.539403 10591 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.543547 10490 catalog_manager.cc:5697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 5, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 5 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.276703 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:42.563184 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2130) took 2801 ms. Trace:
I20260709 13:16:42.563774 10660 rpcz_store.cc:276] 0709 13:16:39.761634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.561168 (+2799534us) service_pool.cc:224] Handling call
0709 13:16:42.562016 (+   848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.562544 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.562596 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.562673 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.562713 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.562798 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.562928 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.565907 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.567133 10660 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:42.568380 10661 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.570801 10665 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:42.571336 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1883) took 2715 ms (client timeout 1845 ms). Trace:
W20260709 13:16:42.571750 10661 rpcz_store.cc:269] 0709 13:16:39.856059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.309864 (+453805us) service_pool.cc:224] Handling call
0709 13:16:42.571013 (+2261149us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b540026a7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:42.571217 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5190731648}
I20260709 13:16:42.572790 10667 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.301196 10662 rpcz_store.cc:276] 0709 13:16:39.626992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.292701 (+2665709us) service_pool.cc:224] Handling call
0709 13:16:42.293009 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.293195 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.293230 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.293281 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:42.293346 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.293408 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.293528 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.569697 10663 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:42.307716 10669 rpcz_store.cc:276] 0709 13:16:39.544805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.272679 (+2727874us) service_pool.cc:224] Handling call
0709 13:16:42.306031 (+ 33352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.306812 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.307015 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.572633 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:42.569561 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1871) took 3024 ms (client timeout 1928 ms). Trace:
I20260709 13:16:42.576627 10669 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:42.577342 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1884) took 2558 ms. Trace:
W20260709 13:16:42.578267 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.000s
W20260709 13:16:42.578724 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.012s	sys 0.000s
I20260709 13:16:42.577694 10669 rpcz_store.cc:276] 0709 13:16:40.018885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.575422 (+2556537us) service_pool.cc:224] Handling call
0709 13:16:42.575948 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.577061 (+  1113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.577273 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.577922 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:42.582253 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1885) took 2557 ms. Trace:
W20260709 13:16:42.583186 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 285203us
I20260709 13:16:42.585727 10662 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.586457 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1882) took 2797 ms. Trace:
I20260709 13:16:42.586735 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:42.586793 10662 rpcz_store.cc:276] 0709 13:16:39.788794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.573904 (+2785110us) service_pool.cc:224] Handling call
0709 13:16:42.574379 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.586201 (+ 11822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.586383 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:42.574751 10664 rpcz_store.cc:269] 0709 13:16:39.545213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.724974 (+1179761us) service_pool.cc:224] Handling call
0709 13:16:42.569089 (+1844115us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b540041f854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:42.569352 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59071360}
I20260709 13:16:42.582803 10669 rpcz_store.cc:276] 0709 13:16:40.031642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.581104 (+2549462us) service_pool.cc:224] Handling call
0709 13:16:42.581511 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.581831 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.581867 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.581964 (+    97us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:42.582010 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.582067 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.582190 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.591218 10664 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:42.618479 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 333) took 2432 ms. Trace:
I20260709 13:16:42.618862 10664 rpcz_store.cc:276] 0709 13:16:40.183493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.590239 (+2406746us) service_pool.cc:224] Handling call
0709 13:16:42.590722 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.614765 (+ 24043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.615684 (+   919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.640184 10665 raft_consensus.cc:2410] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:42.648604 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.654979 10661 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:42.659986 10587 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:42.661376 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.662966 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.663707 10742 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.667163 13648 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.668099 13648 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.669481 13918 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.669816 14019 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.673010 13648 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.674981 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2136) took 2895 ms. Trace:
I20260709 13:16:42.675401 10661 rpcz_store.cc:276] 0709 13:16:39.763405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.572965 (+2809560us) service_pool.cc:224] Handling call
0709 13:16:42.614958 (+ 41993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.657984 (+ 43026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.658979 (+   995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.674243 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.679793 10665 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:42.680706 10740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.015s	sys 0.000s
W20260709 13:16:42.681084 10740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.016s	sys 0.000s
I20260709 13:16:42.682154 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1932) took 2028 ms. Trace:
I20260709 13:16:42.683583 10594 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:42.694613 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:42.695014 13983 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:42.695358 10661 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 6.
I20260709 13:16:42.696074 13788 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.700539 10661 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.701678 13792 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:42.702342 13792 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.704962 13792 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:42.708824 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:42.709466 10591 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.712687 13648 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:42.713606 13947 consensus_queue.cc:1059] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:42.713943 13648 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.714385 13648 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:42.713950 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 125104us
I20260709 13:16:42.717159 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:42.715626 13648 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:42.718415 13993 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.144s	user 0.006s	sys 0.023s
I20260709 13:16:42.724301 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.725055 10736 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.734782 10663 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:42.736121 13738 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:42.741964 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:42.771286 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2169) took 1010 ms. Trace:
I20260709 13:16:42.771746 10667 rpcz_store.cc:276] 0709 13:16:41.760644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.642437 (+881793us) service_pool.cc:224] Handling call
0709 13:16:42.682991 (+ 40554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.770885 (+ 87894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.770913 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.770973 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.771015 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.771086 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.771215 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87372}
I20260709 13:16:42.772485 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 345) took 2578 ms. Trace:
I20260709 13:16:42.772863 10585 rpcz_store.cc:276] 0709 13:16:40.194600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.688227 (+1493627us) service_pool.cc:224] Handling call
0709 13:16:41.688473 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.688669 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:41.703827 (+ 15158us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.772012 (+1068185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.772100 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:42.772170 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.772268 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.772418 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212954,"prepare.queue_time_us":16524,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":825507,"threads_started":1,"wal-append.queue_time_us":485975}
I20260709 13:16:42.774510 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:42.775456 11409 raft_consensus.cc:2368] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:16:42.776679 13738 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:42.777098 13738 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:42.777590 13547 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.778263 13738 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:42.779919 13738 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:42.781884 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 121858us
I20260709 13:16:42.782063 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.782927 10734 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:42.783872 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:42.784423 13959 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.785116 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2141) took 1022 ms. Trace:
I20260709 13:16:42.786062 10663 rpcz_store.cc:276] 0709 13:16:41.754367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.635651 (+881284us) service_pool.cc:224] Handling call
0709 13:16:42.734382 (+ 98731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.745499 (+ 11117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.767850 (+ 22351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.786939 13956 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:42.788075 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:42.334879 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:42.784993 13959 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:42.682466 10740 rpcz_store.cc:276] 0709 13:16:40.653479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.649390 (+995911us) service_pool.cc:224] Handling call
0709 13:16:41.649649 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.649837 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:41.890605 (+240768us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.681587 (+790982us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.681682 (+    95us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.681791 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.681923 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.682082 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5852,"prepare.queue_time_us":124336,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":88649,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":39394,"thread_start_us":982253,"threads_started":3,"wal-append.queue_time_us":331852}
I20260709 13:16:42.832412 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.832556 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1892) took 2430 ms. Trace:
I20260709 13:16:42.833009 10669 rpcz_store.cc:276] 0709 13:16:40.402450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.619791 (+2217341us) service_pool.cc:224] Handling call
0709 13:16:42.689400 (+ 69609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.832154 (+142754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.832189 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.832257 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.832305 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.832388 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.832503 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101263,"raft.queue_time_us":136082}
I20260709 13:16:42.838485 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:42.838761 13884 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.838538 13999 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:42.839479 10663 raft_consensus.cc:2376] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13. Re-sending same reply.
I20260709 13:16:42.839735 13884 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:42.840782 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 564001us
I20260709 13:16:42.822046 13983 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:42.867056 13947 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:42.867265 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.07031e+06us
I20260709 13:16:42.867595 13947 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:42.868165 13947 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.870313 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:42.872474 13983 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:42.874212 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 157238us
I20260709 13:16:42.874413 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:42.875443 13959 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:42.876678 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:42.876925 13959 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.877511 13999 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:42.879720 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 544767us
I20260709 13:16:42.873044 13816 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:42.885921 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:42.887204 14026 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:42.887708 14026 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.888140 10557 leader_election.cc:400] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:16:42.888557 10557 leader_election.cc:403] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:16:42.888799 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:42.889716 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:42.890530 13792 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:42.885917 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.885910 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1889) took 2755 ms. Trace:
I20260709 13:16:42.916301 10591 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:42.892867 10660 rpcz_store.cc:276] 0709 13:16:40.110917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.589762 (+2478845us) service_pool.cc:224] Handling call
0709 13:16:42.590541 (+   779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.860426 (+269885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.860469 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.865803 (+  5334us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.865862 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.865933 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.866085 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115185,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":266251,"threads_started":1}
W20260709 13:16:42.931602 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 50920.3us
I20260709 13:16:42.888154 14026 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.924712 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2143) took 1169 ms. Trace:
I20260709 13:16:42.932955 10742 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:42.936848 10664 rpcz_store.cc:276] 0709 13:16:41.754870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.637904 (+883034us) service_pool.cc:224] Handling call
0709 13:16:42.789424 (+151520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.892064 (+102640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.892093 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.897234 (+  5141us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.924436 (+ 27202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.924525 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.924649 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807616}
I20260709 13:16:42.911376 14019 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.948616 10740 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:42.949838 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.951063 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:42.952667 10740 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:42.929843 13816 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:16:42.947242 14019 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:42.987025 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 98367us
I20260709 13:16:42.984740 14019 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:43.004078 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.005203 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.000795 13762 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:43.016920 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.018298 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:43.019091 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58189us
I20260709 13:16:43.019479 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1881) took 3279 ms. Trace:
I20260709 13:16:43.019826 10666 rpcz_store.cc:276] 0709 13:16:39.740187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.570258 (+2830071us) service_pool.cc:224] Handling call
0709 13:16:42.570890 (+   632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.651161 (+ 80271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.651204 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.841268 (+190064us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.931827 (+ 90559us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.932049 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.932253 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.019183 (+ 86930us) raft_consensus.cc:1685] finished
0709 13:16:43.019202 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.019311 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134129,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":152,"thread_start_us":131964,"threads_started":2,"wal-append.queue_time_us":161727}
I20260709 13:16:43.022270 13973 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:43.022774 13973 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.023783 13973 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.024197 13947 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:43.026154 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 149647us
I20260709 13:16:43.027379 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:43.031404 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57318us
W20260709 13:16:43.033658 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 109715us
I20260709 13:16:43.034607 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:43.035702 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.036613 13875 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.037024 13875 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:43.037459 13875 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.037174 10559 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.049566 13884 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.050491 13956 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.052520 13999 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.053066 13999 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.056574 13999 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.058192 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.059942 13888 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.060452 13888 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:43.062711 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 1925) took 2762 ms (client timeout 1590 ms). Trace:
W20260709 13:16:43.063127 10737 rpcz_store.cc:269] 0709 13:16:40.457844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.556602 (+ 98758us) service_pool.cc:224] Handling call
0709 13:16:43.062302 (+2505700us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540036ddd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:43.062503 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788253056}
I20260709 13:16:43.064664 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 407) took 1579 ms. Trace:
I20260709 13:16:43.064582 13888 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.066098 13888 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.070650 13947 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.071749 13648 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.073019 13788 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:43.075112 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 113772us
I20260709 13:16:43.079466 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.080144 10585 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.080403 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 1985) took 2979 ms. Trace:
I20260709 13:16:43.075928 10591 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:43.076521 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.076717 13766 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.065137 10743 rpcz_store.cc:276] 0709 13:16:41.485355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.684409 (+199054us) service_pool.cc:224] Handling call
0709 13:16:43.062546 (+1378137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.062801 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.062850 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.062919 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.062961 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.063035 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.064369 (+  1334us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540036ddd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:43.064488 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168455552}
I20260709 13:16:43.077108 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.077783 14033 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:43.063328 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.083580 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.083027 10736 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:43.085860 11418 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.085984 10594 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.085047 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.065421 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:43.099320 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 66790.6us
I20260709 13:16:43.100301 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.100626 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.100360 14033 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.100941 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.101904 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.102375 14018 raft_consensus.cc:2764] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:43.102627 13927 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.103194 13927 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:43.103272 13884 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:43.104130 13742 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.104704 13742 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.104492 13927 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.106856 13781 raft_consensus.cc:3055] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.105075 13742 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.107239 13781 raft_consensus.cc:740] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.108286 13781 consensus_queue.cc:260] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.087312 13762 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.110877 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:43.111550 10587 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:43.105465 10586 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.105621 14018 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.113891 13875 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.114547 14018 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:43.105844 13934 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:43.116092 13875 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:43.116209 13934 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.116720 13934 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:43.117704 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 112666us
I20260709 13:16:43.117766 13934 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.119407 13934 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.090709 13956 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.126982 13865 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:43.103505 14033 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.104061 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.080770 10593 rpcz_store.cc:276] 0709 13:16:40.100649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.680544 (+1579895us) service_pool.cc:224] Handling call
0709 13:16:41.680811 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.714220 (+ 33409us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:41.714506 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.738856 (+1024350us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b180008e540. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f425b18d58f 00007f42541cc571 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd
0709 13:16:42.776648 (+ 37792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.776723 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.776829 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.080076 (+303247us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5400299854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:43.080126 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.080243 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728360,"prepare.queue_time_us":486,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":728978,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":22047,"spinlock_wait_cycles":72464256,"thread_start_us":335388,"threads_started":1,"wal-append.queue_time_us":476681}
I20260709 13:16:43.116725 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 402) took 2785 ms. Trace:
I20260709 13:16:43.135149 10594 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:43.136046 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.134223 10586 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
W20260709 13:16:43.137873 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 108854us
I20260709 13:16:43.153487 13856 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.153736 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.154004 13856 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.154479 13856 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.155388 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.160709 13547 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:43.144125 13788 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.144268 13947 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.162155 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:43.164395 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 127316us
W20260709 13:16:43.166854 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65088.5us
I20260709 13:16:43.168565 13865 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:43.170011 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.165511 13788 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.170567 13788 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.170652 10736 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.170950 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.181128 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:43.185932 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 108936us
I20260709 13:16:43.189386 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.146497 13875 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:43.193280 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.134393 10738 rpcz_store.cc:276] 0709 13:16:40.331473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.562150 (+1230677us) service_pool.cc:224] Handling call
0709 13:16:41.602408 (+ 40258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.602607 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:41.709697 (+107090us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.304197 (+594500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.304259 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:42.304351 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.304440 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.115740 (+811300us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b1800370d20. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4
0709 13:16:43.116433 (+   693us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54001cc350. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:43.116557 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4692,"prepare.queue_time_us":112446,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":16166,"raft.queue_time_us":84,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":19361,"spinlock_wait_cycles":795564544,"thread_start_us":689394,"threads_started":2,"wal-append.queue_time_us":653607}
I20260709 13:16:43.198526 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:43.201498 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:43.205397 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.205238 10592 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:43.205911 13781 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.206981 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.167562 13956 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.207602 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.208585 13648 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:43.168305 14033 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.212222 14003 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:16:43.236677 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.215226 11415 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:43.215566 13742 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:43.216583 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.220216 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:43.214083 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.238099 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.247771 10736 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:16:43.252653 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 187486us
I20260709 13:16:43.238693 13766 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.232220 13648 consensus_queue.cc:1243] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:16:43.265605 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 67895.9us
W20260709 13:16:43.273502 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.273900 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:43.284437 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 119633us
I20260709 13:16:43.252700 13959 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.286046 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:43.286669 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 95354.1us
I20260709 13:16:43.256983 13738 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:43.290874 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70761.4us
I20260709 13:16:43.277419 13766 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.298669 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.300925 14033 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:43.303705 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.311450 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:43.312170 10736 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:43.288684 13956 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.314780 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:43.315203 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.321511 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:43.303081 13766 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:43.327486 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 164103us
I20260709 13:16:43.284909 14026 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.335819 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.290800 14003 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:16:43.341550 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 149578us
I20260709 13:16:43.339519 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.317976 13956 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:43.328383 13959 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.349936 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 69882.3us
I20260709 13:16:43.340042 13888 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:43.348822 10743 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:43.345309 13956 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:43.356019 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70913.5us
I20260709 13:16:43.352634 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.358649 13866 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.359145 13866 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.359536 13866 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.359709 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.360736 14047 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.348444 13999 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.363457 13774 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.340327 14019 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.371816 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.376127 13823 raft_consensus.cc:2764] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:16:43.376281 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:43.377444 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1887) took 3297 ms. Trace:
I20260709 13:16:43.379482 10588 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:43.354499 13973 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.381560 13738 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:43.382833 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 68885.2us
I20260709 13:16:43.365406 14047 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.386677 13975 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:43.364640 13999 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.423344 13999 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.424386 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.426411 13547 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.426295 14047 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.348737 13959 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.431324 13959 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.434450 13998 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.435377 11412 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:43.377813 10662 rpcz_store.cc:276] 0709 13:16:40.080037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.587718 (+2507681us) service_pool.cc:224] Handling call
0709 13:16:42.588223 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.822003 (+233780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.822035 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.854053 (+ 32018us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.237547 (+383494us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:43.237605 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.237692 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.372729 (+135037us) raft_consensus.cc:1685] finished
0709 13:16:43.372747 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.377389 (+  4642us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117399,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"thread_start_us":500148,"threads_started":2,"wal-append.queue_time_us":373140}
W20260709 13:16:43.400525 14044 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:43.401679 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:43.402487 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:43.402707 13816 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.404251 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:43.451198 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47052.6us
W20260709 13:16:43.451346 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 162959us
I20260709 13:16:43.405299 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.452045 10586 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.409242 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.409220 14018 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.410573 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:43.411598 13774 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.412380 14042 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:16:43.413539 13742 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.414089 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:43.414912 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.422823 13947 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:43.447342 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62290.5us
W20260709 13:16:43.469583 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59187.3us
I20260709 13:16:43.389508 13738 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:43.477188 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:43.477156 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.478760 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.378885 13888 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.477051 13738 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.483115 13648 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.483291 14008 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:43.488461 13547 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.514151 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.514732 10594 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:43.517639 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 134919us
I20260709 13:16:43.517794 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.489435 13874 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.494030 10662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:43.518874 10662 raft_consensus.cc:606] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.519387 10662 raft_consensus.cc:614] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:43.494740 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.520031 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.518743 11418 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:43.496869 10738 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.521111 14000 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:43.521494 14000 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.521819 14000 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:43.453795 13816 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:43.505991 14029 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.525221 14018 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.525097 13816 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:43.506094 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 96950.2us
I20260709 13:16:43.506876 13648 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.512333 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:43.494671 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.518307 13844 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:43.524022 10594 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:43.396153 13973 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.518440 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.488687 14003 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.518823 13959 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:43.497844 10559 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.526324 10588 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:43.530275 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:43.533255 10738 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:43.518700 13874 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.474383 13774 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.526975 14026 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:43.528538 14008 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.547498 13998 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.547785 13786 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.547356 13648 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.548914 13648 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:43.549566 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51834.4us
I20260709 13:16:43.549623 14008 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.551251 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.548026 13998 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.537706 10585 raft_consensus.cc:2410] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:43.552227 13983 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.539458 13874 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.553217 10591 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:43.564651 10587 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:43.579067 13742 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:43.579607 13742 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.580040 13742 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.549111 13973 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:43.564318 13998 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.611760 10586 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:43.565079 13786 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:43.630254 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 79084.8us
I20260709 13:16:43.612300 13934 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.632696 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.634426 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:43.636446 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:43.636991 11413 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.618430 13816 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:43.639228 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 144709us
W20260709 13:16:43.641644 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 121715us
I20260709 13:16:43.645222 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:43.629666 14029 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:43.642771 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 124402us
I20260709 13:16:43.608758 13866 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.647503 10738 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:43.635962 13934 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:43.656629 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2129) took 3775 ms. Trace:
W20260709 13:16:43.657579 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.658715 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:43.674727 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.676697 10741 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.656988 10668 rpcz_store.cc:276] 0709 13:16:39.761261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.573166 (+2811905us) service_pool.cc:224] Handling call
0709 13:16:42.573730 (+   564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.654277 (+ 80547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.654312 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.119774 (+465462us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b2c0006e658. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:43.120269 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.217000 (+ 96731us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:43.343153 (+126153us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.343336 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.343402 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.528651 (+185249us) raft_consensus.cc:1685] finished
0709 13:16:43.534713 (+  6062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.536863 (+  2150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168380,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":131732,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":5551,"spinlock_wait_cycles":81582976,"thread_start_us":294829,"threads_started":3,"wal-append.queue_time_us":168430}
W20260709 13:16:43.681885 14053 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:16:43.683241 14058 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.686139 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.680239 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.658492 13934 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.678785 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:43.693531 13786 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.694802 14000 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:43.690689 13856 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:16:43.679134 14033 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.651333 13788 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.674283 14066 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.690284 14026 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.687145 13888 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.704411 14019 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.678498 13999 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.702572 13956 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:43.775930 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 102243us
I20260709 13:16:43.802538 10591 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:43.786360 10586 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:43.802791 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:43.815474 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.736732 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78023.2us
I20260709 13:16:43.711404 14067 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:43.835289 14067 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.835641 14067 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.837981 10738 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:16:43.839308 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.842521 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:43.843557 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54052.9us
I20260709 13:16:43.845778 13959 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:43.711484 13884 raft_consensus.cc:2764] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:43.849886 10590 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.851089 10668 raft_consensus.cc:2368] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8.
I20260709 13:16:43.772554 14058 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.860596 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.721870 14000 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.864048 10662 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:43.861756 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.860634 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.762271 14061 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.774279 13866 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.777168 14033 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.708691 13844 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:43.864302 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:43.735703 14066 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:43.774950 13874 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.866539 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:43.868813 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:43.730890 13738 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.727941 13774 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:43.869625 10665 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.710832 13856 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.878152 10663 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.759385 14064 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:43.866818 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:43.870515 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:43.870982 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 66252.1us
W20260709 13:16:43.872146 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.868319 10735 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.868930 10660 raft_consensus.cc:1240] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:43.876729 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 226986us
I20260709 13:16:43.878329 10666 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.730342 13766 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.842553 13888 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:16:43.873296 13875 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:43.837184 13998 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.880756 10664 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:43.893168 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:43.882869 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.876083 14069 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.883862 14061 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.884689 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:43.885419 14058 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.879680 10669 pending_rounds.cc:85] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 7
W20260709 13:16:43.888523 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.879580 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:43.898105 10669 pending_rounds.cc:107] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:43.898523 10669 raft_consensus.cc:2889] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.898770 11418 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.873346 13947 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:16:43.899587 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:43.899531 14064 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.900820 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.901799 14023 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.902168 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.902725 14023 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:43.904354 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:43.905835 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54144.9us
I20260709 13:16:43.896191 10738 raft_consensus.cc:606] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:43.890220 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.846706 13959 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.885462 13788 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.902007 14064 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:43.907546 10738 raft_consensus.cc:614] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:43.908154 10735 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:43.891177 10591 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.909732 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:43.954700 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48191.8us
W20260709 13:16:43.965047 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 55362.7us
I20260709 13:16:43.838431 13927 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:43.895141 13875 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:43.757354 14029 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:43.961731 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 57471.2us
I20260709 13:16:43.910375 10740 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.972407 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.898795 13888 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.985460 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:43.897745 14003 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:16:43.955391 14033 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.975121 13956 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:43.955945 13844 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.976539 13766 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:43.976764 14057 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:16:43.983274 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:44.039741 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.896152 13866 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.985301 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:43.990571 14000 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.961987 13774 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.964203 14018 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.954944 14074 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.963261 14026 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.956099 13547 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.957299 13856 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:44.044389 13788 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.957228 13874 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.014693 10742 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.905206 14023 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:43.977120 13875 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:44.015707 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:44.068059 10743 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.989907 11381 leader_election.cc:400] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8.
I20260709 13:16:43.961566 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.037123 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:43.911448 14008 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:16:43.986245 13823 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:16:43.955847 13742 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:43.986023 13888 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:44.043128 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 57922.8us
W20260709 13:16:44.072974 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 89370.3us
I20260709 13:16:44.044763 13931 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:44.077363 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 168603us
I20260709 13:16:44.077491 13931 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:44.077934 13931 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.078138 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.078603 14067 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.080195 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:44.046942 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 81612.3us
I20260709 13:16:44.054673 10663 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:44.054979 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:43.976372 13656 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:44.049925 14058 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.059363 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.060828 10660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55846c170448461696e53d2649ed09d8"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:16:44.053762 13934 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.050647 14000 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:44.135233 14000 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.135470 10734 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.135699 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.043555 14066 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.058311 13866 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:43.961635 14060 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:16:44.080680 14067 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.082285 13742 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:44.045878 14057 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:44.082865 13778 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.084460 10736 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.134178 10740 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:44.065727 13547 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.070137 13999 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.090265 14061 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.092778 13823 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:44.159116 10588 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.136408 13865 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.098598 11381 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:44.059774 10735 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:16:44.102586 14073 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:44.105651 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:44.161943 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 63415us
I20260709 13:16:44.069721 13788 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.106824 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.108457 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.109191 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.109716 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:44.109845 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:44.110069 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:44.110344 13956 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:44.112588 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:44.114307 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:44.115247 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:44.115783 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:44.171974 11418 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.118283 11412 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:44.119056 11409 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:44.120919 10666 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:44.154135 14058 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.125551 10586 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:44.129470 10743 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:44.131942 10660 raft_consensus.cc:606] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:43.901806 13998 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.128917 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:44.085593 14048 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.150661 10591 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:44.178625 10737 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:44.159467 13823 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.157923 14087 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:44.093493 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 104260us
W20260709 13:16:44.159993 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 79936.3us
I20260709 13:16:44.131455 13947 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:44.161012 13778 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:16:44.158906 13738 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.106128 13875 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:44.169898 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59933.3us
I20260709 13:16:44.151310 13884 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:44.145351 14057 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:44.174943 10660 raft_consensus.cc:614] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:44.176873 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:44.152683 14069 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:44.178194 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:44.184535 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:44.179733 10589 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:44.187515 10665 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:44.250316 10663 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:44.251163 10662 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:44.249874 10664 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.256240 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:44.176775 13742 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:44.260535 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 99179.3us
I20260709 13:16:44.178409 14048 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:44.263167 10594 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.259653 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:44.267093 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 91126.5us
I20260709 13:16:44.267239 10592 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:44.268817 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:44.271667 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:44.193676 13884 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:44.265928 13998 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.268270 10592 pending_rounds.cc:85] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 9
I20260709 13:16:44.276968 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:44.278211 10592 pending_rounds.cc:107] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:44.290118 10592 raft_consensus.cc:2889] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.178289 14058 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.291972 10594 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
W20260709 13:16:44.293851 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 136465us
I20260709 13:16:44.264544 14048 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.265558 13823 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.281016 13956 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:44.282933 13884 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.295992 14071 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:44.299531 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:44.280784 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.306499 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.275593 13742 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:44.263486 13874 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:16:44.297645 14077 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:16:44.304435 13975 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.278312 13766 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.280552 13875 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.298143 14060 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:44.328970 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 57411.6us
I20260709 13:16:44.277971 13998 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.340124 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.342507 13786 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.342996 13786 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.343950 13786 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.345731 13865 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:44.345938 14075 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:44.346396 14075 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.347152 14075 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.347782 11415 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:44.348168 14075 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.258061 13888 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.349815 13888 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.332748 14069 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.353983 10734 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.335871 13874 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:44.300431 14080 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.262156 13866 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.333014 13975 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:44.336177 13999 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.384222 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:44.307694 13956 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:44.336459 13766 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.315565 14029 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:44.357410 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:44.379642 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 102777us
I20260709 13:16:44.326910 14018 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:44.382414 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.306191 14088 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:16:44.388430 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.336233 13742 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:44.394956 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.392048 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 142371us
I20260709 13:16:44.396102 10734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:44.396777 10734 raft_consensus.cc:606] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:44.397169 10734 raft_consensus.cc:614] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:44.389925 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:44.371980 13786 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.398187 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:44.404712 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 141462us
W20260709 13:16:44.408303 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.371865 13874 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:44.384032 13884 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.386463 13956 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.383631 13999 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.428293 10741 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:44.431881 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.425979 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:44.426818 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:44.383406 14067 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:44.408551 14003 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:44.395107 14074 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:44.402253 14064 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:44.444715 10660 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:44.445824 14091 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.448325 13766 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.451143 14067 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.452363 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.454303 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:44.407707 13844 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:16:44.488535 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 98675.9us
I20260709 13:16:44.328162 14057 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.452797 14048 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.427894 13648 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:16:44.487080 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 90865.5us
I20260709 13:16:44.444068 13947 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.527141 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:44.527890 10585 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:44.433830 13865 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:16:44.529404 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:44.532437 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 134365us
W20260709 13:16:44.539521 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.486649 14003 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:44.540619 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:44.490783 14064 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:44.485492 14074 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.526306 13947 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.486526 13975 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.530395 13774 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:44.578536 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.579241 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 126962us
W20260709 13:16:44.622856 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.523263 13973 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:16:44.573784 13766 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.475090 13999 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.528469 14080 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.608719 13947 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.523674 13874 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.640616 14029 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.699610 10743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e922c08ea15b4851815093b0021df81c"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:16:44.716223 10743 raft_consensus.cc:606] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:44.581904 13547 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.703174 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.716590 10743 raft_consensus.cc:614] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:44.564430 14008 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:16:44.705454 13788 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:44.691216 13766 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:44.574833 14083 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:44.711563 11418 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260709 13:16:44.711519 10664 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:44.759833 11418 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
W20260709 13:16:44.704658 13931 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
W20260709 13:16:44.730600 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 294795us
W20260709 13:16:44.760855 10735 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.000s
I20260709 13:16:44.556340 14091 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.141s
I20260709 13:16:44.690760 14100 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.715885 13874 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:44.736146 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 281896us
I20260709 13:16:44.692157 14058 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.574206 13742 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.758057 13766 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.762163 13999 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.758644 14099 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.772420 14085 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:16:44.772612 13547 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.815033 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.822717 13844 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.870247 13844 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:44.870811 13547 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.871034 13844 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.872188 13844 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.823365 14074 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.823470 10708 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:44.873201 13547 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:44.874198 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 50810us
W20260709 13:16:44.874410 14098 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:44.874619 14106 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.874987 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:44.875416  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:44.874372 14018 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.876123 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:44.823912 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 120854us
I20260709 13:16:44.876086 14018 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:44.835811 14000 consensus_meta.cc:287] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.000s
I20260709 13:16:44.877381 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.877278 14000 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.878198 14074 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.878650 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.879354 14000 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:44.879455 14074 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.879930 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.880084 14000 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.821444 14099 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.882452 13844 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:44.882582 14099 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:44.882867 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:44.883011 13844 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:44.861811 14111 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:44.883553 14111 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.883908 14111 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:44.865676 13956 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:44.945405 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.036s
W20260709 13:16:44.945747 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.014s	sys 0.036s
W20260709 13:16:44.946058 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 525994us
W20260709 13:16:44.866479 14096 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:16:44.867782 14094 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:16:44.867239 13947 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:44.869648 13656 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.005s
I20260709 13:16:44.764259 13931 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:44.880702 14074 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.880501 14000 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:44.849920 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44994.9us
I20260709 13:16:44.755162 13959 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.884509 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:44.881774 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:44.898730 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.910327 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.747685 14029 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:44.947655 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.945253 13547 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.960876 14082 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.961220 13547 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.963241 13547 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:44.884723 14099 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.963016 13766 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.959041 14000 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.773414 14003 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.966250 13844 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:44.944876 14018 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.809355 14088 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 13:16:44.975447 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:44.989993 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 108288us
I20260709 13:16:44.999096 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:44.790720 14100 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:45.007251 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 122797us
I20260709 13:16:45.007725 13947 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:45.008301 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:45.009346 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.009893 10664 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.990406 14067 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:45.012753 13888 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.662s	user 0.002s	sys 0.011s
I20260709 13:16:45.000320 14101 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:45.014626 14100 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.014807 13956 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.001274 13766 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.016153 14112 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.016244 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.017110 10665 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:45.017493 14048 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.018435 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:44.814108 14064 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.016384 14102 raft_consensus.cc:2764] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:16:45.019737 14101 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:45.024902 10664 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:45.032909 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:45.025981 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.033851 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.034068 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:45.039112 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 429) took 1064 ms. Trace:
I20260709 13:16:45.039551 10738 rpcz_store.cc:276] 0709 13:16:43.975061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.985598 (+ 10537us) service_pool.cc:224] Handling call
0709 13:16:44.017778 (+ 32180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.036517 (+ 18739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.036547 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.283833 (+247286us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2c0006cc38. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:44.284309 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.402314 (+118005us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:44.402369 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.402467 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.024157 (+621690us) raft_consensus.cc:1685] finished
0709 13:16:45.024198 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.039052 (+ 14854us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6008,"raft.queue_time_us":124,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3801,"spinlock_wait_cycles":4219776,"thread_start_us":117566,"threads_started":1,"wal-append.queue_time_us":256676}
I20260709 13:16:45.038812 13947 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:45.041803 13888 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.042431 14008 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.051148 14099 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.069865 14106 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:45.111631 14106 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.076027 13888 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.079695 13931 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.079411 13998 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.073021 13947 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.081459 14108 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.081348 14000 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:45.093837 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 85707.3us
W20260709 13:16:45.094377 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 90776.6us
I20260709 13:16:45.095897 14008 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:45.066885 13959 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.105983 14074 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.107023 14029 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.108357  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:45.110348 14101 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:45.114670 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 43912.8us
I20260709 13:16:45.133170 10738 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:45.131903 14103 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.317s	user 0.002s	sys 0.002s
I20260709 13:16:45.133352 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 540) took 1015 ms. Trace:
I20260709 13:16:45.144456 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:45.124701 13947 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:45.131229 13884 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 13:16:45.147979 11409 rpcz_store.cc:276] 0709 13:16:44.117849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.118548 (+   699us) service_pool.cc:224] Handling call
0709 13:16:44.118790 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.118958 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:44.577277 (+458319us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.126301 (+549024us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.126574 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.129680 (+  3106us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.133030 (+  3350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.133077 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:45.133119 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.133183 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.133279 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3004,"raft.queue_time_us":2872,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5544,"spinlock_wait_cycles":7355648,"thread_start_us":545742,"threads_started":2,"wal-append.queue_time_us":471219}
I20260709 13:16:45.153697 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:45.159523 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.162961 14000 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.135624 13856 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.143121 13998 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:45.151669 14097 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:16:45.179183 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 1973) took 1128 ms. Trace:
I20260709 13:16:45.129341 14018 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.146889 13934 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.148511 14106 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.179876 10735 rpcz_store.cc:276] 0709 13:16:44.051068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.051181 (+   113us) service_pool.cc:224] Handling call
0709 13:16:44.059504 (+  8323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.059679 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:44.761463 (+701784us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.173496 (+412033us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.178215 (+  4719us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.178626 (+   411us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.178793 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.178842 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:45.178898 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.178979 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.179116 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38806,"raft.queue_time_us":26326,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":3967,"thread_start_us":332930,"threads_started":2,"wal-append.queue_time_us":377518}
I20260709 13:16:45.187314 14026 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.135977 14111 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.187628 14061 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.196256 13888 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.207168 13823 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.208631 13547 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:45.211376 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.219053 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 65434.6us
I20260709 13:16:45.131382 14108 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.214448 14008 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.230290 10734 raft_consensus.cc:2368] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11.
I20260709 13:16:45.157752 13866 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:16:45.232831 14061 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.236682 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.238503 10588 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:45.239745 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.243753 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.244521 10586 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:16:45.241048 14074 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:45.246343 14074 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.248795 14074 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.241928 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.250721 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:45.253984 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.254942 10592 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:45.223878 13547 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.260629 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.262342 10587 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:45.220335 14003 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:16:45.315052 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:45.316839 10741 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.317487 10743 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.323249 10737 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:45.325524 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.326745 10741 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.326900 10743 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:45.327127 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 44744.8us
I20260709 13:16:45.329738 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:45.330318 10737 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:45.334889 10735 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:45.321547 13786 consensus_meta.cc:287] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.003s
I20260709 13:16:45.258862 14074 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:16:45.352152 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 95784us
I20260709 13:16:45.321553 13888 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:45.319226 13781 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.361014 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:45.406795 10738 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:45.336668 14067 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.407508 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.334208 14018 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.363165 13547 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.408092 10589 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:45.408854 13547 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.409034 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.364795 14113 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:45.413440 13786 consensus_queue.cc:1175] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "18f1a9f5e66846dba474825fb5b2b784" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 6 index: 6 } }
I20260709 13:16:45.413691 14113 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.367098 14057 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.367573 14108 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.368579 14111 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.366489 13888 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:45.420269 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.371770 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:45.374311 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:45.376762 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:45.422447 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55046.4us
I20260709 13:16:45.329659 14064 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:16:45.387050 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.424808 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46042.9us
I20260709 13:16:45.390321 10559 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.391757 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:45.397871 14112 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.398993 13975 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.402124 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.403673 10587 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:45.436769 10588 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.436929 11382 leader_election.cc:400] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11.
I20260709 13:16:45.437503 11382 leader_election.cc:403] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.405915 10742 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:45.416029 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.417461 10590 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:45.418114 14113 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.388788 13947 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.420243 10586 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.369827 14061 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:45.422079 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.423933 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.389472 14003 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:45.427225 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.428051 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.461163 10585 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:16:45.432816 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.452145 10590 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:45.455528 10594 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:45.456106 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:45.463299 11415 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.465060 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:45.466763 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:45.469851 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:45.469641 13888 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.428676 13738 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.471817 13738 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.474047 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:45.474776 13738 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.475404 14003 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.475868 14003 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.468962 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:45.478140 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:45.479385 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:45.479916 13823 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:45.480015 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:45.480628 13823 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.480749 13956 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:45.481201 13999 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.481714 13956 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.482371 11413 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:45.482400 13956 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.476675 14003 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.484496 14003 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.487535 13823 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.451300 14029 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:45.489519 14102 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:45.490140 14102 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.492916 14102 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.481669 14048 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:16:45.493940 14048 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.494285 14048 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.495011 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.495167 14048 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.496155 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.496308 14048 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.496726 10587 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:45.451493 14067 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.497529 14067 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.497895 14067 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:45.499400 14095 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.092s	user 0.001s	sys 0.004s
I20260709 13:16:45.503202 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:45.514194 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:45.514833 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.515846 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:45.516582 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126365us
I20260709 13:16:45.419663 13781 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.481629 13999 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.455077 13934 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.519708 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.520100 10588 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:45.520280 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:45.520697 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 129097us
I20260709 13:16:45.429006 13998 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:16:45.524911 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:45.548125 13781 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.514547 14061 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.527128 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.528700 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:45.525396 14130 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:45.560477 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:45.572607 10590 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:45.575348 11412 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:45.514501 14114 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:16:45.589418 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:45.589982 10587 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.526788 13999 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.527338 14000 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:45.578027 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.517963 14111 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:45.550444 14071 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:45.614006 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.615832 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 55448.2us
I20260709 13:16:45.637511 14026 raft_consensus.cc:2764] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:45.638211 14071 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.641939 13738 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:45.593262 14000 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.643141 14000 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.644650 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.644565 13934 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:45.652539 10664 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:45.692744 10587 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
W20260709 13:16:45.694783 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 220803us
I20260709 13:16:45.592212 14074 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:45.702754 10742 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:45.702749 10587 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.704458 11415 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:45.709088 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.715266 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.716059 10664 raft_consensus.cc:2410] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:45.693732 13934 raft_consensus.cc:2764] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:16:45.721346 10669 raft_consensus.cc:2368] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9.
I20260709 13:16:45.702100 14100 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.728346 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 13:16:45.729049 10587 raft_consensus.cc:606] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:16:45.708837 14066 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11.
I20260709 13:16:45.733728 10588 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:45.734669 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.736693 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:45.738710 10664 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:45.642474 13738 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.735654 14019 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.742157 13956 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.726765 14023 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.748411 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.745714 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.762598 10663 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:45.765853 13956 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.771929 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.772698 10662 raft_consensus.cc:2410] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:45.753597 10669 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:45.711966 14074 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.780954 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.788628 10664 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.790179 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.790796 10667 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:45.792081 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.793004 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.737327 14100 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:45.798646 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.751556 14019 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.800031 10663 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:45.806282 14141 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:16:45.806612 14074 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:45.800768 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54124.6us
I20260709 13:16:45.798079 13947 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.765192 13999 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.812096 10664 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:45.814661 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.815399 10668 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.777117 14023 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.807539 13648 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.819585 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.822507 13648 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.826700 10666 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:45.829764 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.830900 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.831578 14061 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.832273 14061 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.832417 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.833191 14061 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:45.834862 13999 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.836741 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.813221 14019 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.838229 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.835153 14000 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.840183 10666 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.810256 14057 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:45.843878 14023 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.813887 14003 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:16:45.846125 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.847550 10668 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:45.849212 14061 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.850740 10667 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:45.851377 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.866099 10662 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.858161 10666 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:45.862635 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:45.863098 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.812724 14143 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:16:45.871889 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:45.876811 10593 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:45.877249 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.886615 14000 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.892210 14023 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.892581 14023 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.892886 14023 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:45.894732 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.897745 13738 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:45.900766 14135 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.480s	user 0.000s	sys 0.005s
I20260709 13:16:45.835841 14067 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.867532 14019 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.906224 10665 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:45.909061 10662 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:45.903493 14067 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:45.911893 10665 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:45.913760 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:45.904407 14019 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.916954 10662 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.923283 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.918001 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:45.925298 10666 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
W20260709 13:16:45.926165 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 98665us
W20260709 13:16:45.926734 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63742us
W20260709 13:16:45.926967 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.928194 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:45.929023 10737 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.936563 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.925505 14061 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.939378 10742 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:45.916127 14111 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:45.921916 14074 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:45.960054 14147 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:45.960712 13927 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:45.961550 13927 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.962520 13927 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:45.963416 14019 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:45.963965 13927 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.965099 14111 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:45.967777 14111 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:45.969838 10590 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:45.971071 14029 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:45.971606 14029 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.972852 10741 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:45.974416 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.974939 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.975284 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.980676 13998 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:45.982378 10594 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:45.984261 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.984905 10590 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:45.985654 10589 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:45.986778 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:45.987700 10592 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:45.992161 14067 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:45.993470 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56967.1us
I20260709 13:16:45.994307 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.995623 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:45.999394 13888 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.002526 13999 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:16:46.001286 14067 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.007388 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:46.008253 14067 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.009440 14113 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.009967 14113 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:46.010367 14113 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.985615 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:46.009085 14067 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:16:46.024219 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:46.024927 10594 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.037215 14088 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:46.044615 14088 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:45.960677 14074 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.040601 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.042562 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:46.054777 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:46.055437 13959 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:46.056267 13959 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:46.057139 14140 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
I20260709 13:16:46.057556 14061 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:46.057994 14061 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:46.058768 14061 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.059868 14061 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.060002 13738 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:46.061240 11379 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.061828 14143 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:46.062201 14143 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:46.063040 14143 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.064143 14143 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.066752 10588 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.067035 13648 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.068862 14100 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.070219 10662 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:46.078346 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.080029 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:46.082649 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 106578us
I20260709 13:16:46.083346 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:45.964941 14023 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.091692 10737 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:46.092013 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.093345 10592 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:46.086936 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.095069 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:46.106676 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.106496 10557 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:46.107098 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.108125 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69692.1us
I20260709 13:16:46.115091 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:46.115839 10590 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.119536 10588 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:46.122064 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.122824 10585 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:16:46.123939 11379 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.125464 10591 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:46.126767 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.134128 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 50851.8us
I20260709 13:16:46.135879 10594 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:46.136698 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.137495 10592 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:46.137610 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.139909 10557 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.140668 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.143833 10662 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:46.144371 10662 pending_rounds.cc:85] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 4
I20260709 13:16:46.144691 10662 pending_rounds.cc:107] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:46.145020 10662 raft_consensus.cc:2889] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.063063 13973 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.148864 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.151039 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.153600 10560 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.159451 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.160259 10739 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:46.161106 13781 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.161648 13781 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.162068 13781 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.145807 14003 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:46.165668 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.166254 13998 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.166465 10736 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:46.167601 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.168210 10741 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:46.146432 14066 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:46.169600 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:46.170660 10734 raft_consensus.cc:2410] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:46.171521 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.171725 14102 raft_consensus.cc:993] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:16:46.165861 14051 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:46.174563 14051 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:46.175699 14051 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.110176 13648 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:16:46.183240 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.183820 10665 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:46.183823 10660 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:46.185222 10665 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:46.185928 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.186137 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.186489 10664 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:46.186600 10665 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.187484 10664 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:46.187644 10743 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:46.187989 10743 pending_rounds.cc:85] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:46.188190 10743 pending_rounds.cc:107] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:46.188414 10743 raft_consensus.cc:2889] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.189554 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.185158 10660 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:46.188351 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 13:16:46.191043 10587 raft_consensus.cc:606] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:16:46.191337 10669 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:46.192734 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.101895 13959 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.103164 14149 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:46.166674 13998 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.157696 10592 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:46.199651 10743 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:46.197921 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.105854 14064 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:46.202368 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 381322us
I20260709 13:16:46.204504 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.212917 10559 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.213290 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.205615 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.133736 14048 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:46.169138 14066 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.217437 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.219393 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.220319 10740 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:46.221151 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.221877 10662 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.146791 14019 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:46.153543 14108 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.214605 14066 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:46.259306 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46460.6us
I20260709 13:16:46.133869 14018 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:16:46.233016 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.231448 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.154700 13973 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.236374 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.274997 10666 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:46.237176 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.195937 14071 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:46.238854 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:46.283444 10743 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:46.231685 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.252116 10590 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:46.258711 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.232372 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.286933 10738 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:46.287334 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.288082 10660 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.288466 10743 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:46.266628 10665 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:46.198367 13959 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:46.270741 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.272059 10559 leader_election.cc:400] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9.
I20260709 13:16:46.293622 10559 leader_election.cc:403] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.293551 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.218995 13998 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.273371 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.209561 13742 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:16:46.278973 10662 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:46.231398 14112 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.294530 10739 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:16:46.295934 10665 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:46.273648 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:46.290153 14142 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:16:46.244405 14067 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.301714  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.317616 10741 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:46.282840 13973 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.283352 14074 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.292953 13934 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:46.292834 14048 raft_consensus.cc:1081] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Signalling peer fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:16:46.225379 14064 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.302237 13959 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.307191 13956 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.303361 14100 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.318228 13742 consensus_queue.cc:1243] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:46.268503 14108 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.368469 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.316025 14112 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.330739 14113 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.342970 14026 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.398756 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 245204us
I20260709 13:16:46.402274 10666 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.409257 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.409865 10665 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.411569 10661 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:46.332329 14067 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.434553 10740 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:46.443761 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:46.444608 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 296921us
I20260709 13:16:46.374430 14159 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9.
I20260709 13:16:46.392261 14112 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.372442 14071 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:46.391429 13934 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:46.480131 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.443593 14048 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.412559 14026 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.443904 14029 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.071206 14088 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:46.651434 14144 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.890s	user 0.003s	sys 0.001s
I20260709 13:16:46.659929 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.660537 10662 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:46.575208 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.661924 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.533010 13823 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.662622 10734 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:46.664325 14048 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.664644 13823 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.597520 14074 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.666172 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.561255 14147 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:46.665745 14074 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:16:46.664942 14113 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:46.538762 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 297833us
W20260709 13:16:46.586453 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.663304 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 403069us
I20260709 13:16:46.662871 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:46.661682 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.560137 10665 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:46.673465 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.674305 10665 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.675158 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.661775 10666 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:46.674361 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.652258 10664 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:46.661279 10667 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.672397 10736 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.684463 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.536545 14018 consensus_queue.cc:1243] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer e71e2e44af1e46d8a8423ae08646bc22 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:46.683331 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:46.666890 10734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:16:46.661240 14029 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:46.687299 10734 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.692241 10734 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.501708 14023 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.687275 10559 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.687775 10664 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:46.697230 10665 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:46.697737 10736 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:46.698829 10665 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:46.707082 14061 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.002s
I20260709 13:16:46.707638 14061 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:46.708115 14061 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.711134 10660 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:46.636809 13934 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.712255 10667 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:46.667054 14147 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.691386 13956 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:46.718500 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.720746 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:46.725425 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:46.712898 14029 raft_consensus.cc:2764] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:16:46.732126 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.715268 14150 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.715476 14064 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:46.723214 14153 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:16:46.724463 14108 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:46.744416 13956 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:46.741484 14067 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.721558 14102 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:16:46.776083 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 100962us
W20260709 13:16:46.761981 14154 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:16:46.781584 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:46.782369 13781 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:16:46.782779 13781 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.782802 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:46.759728 14164 raft_consensus.cc:2764] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:16:46.792820 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65579.2us
W20260709 13:16:46.813705 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 126267us
I20260709 13:16:46.802274 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:46.816438 10591 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.792639 11382 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.803392 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.811084 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.820663 10736 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:16:46.791675 13888 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.002s
W20260709 13:16:46.823630 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 342121us
I20260709 13:16:46.828189 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:46.845420 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.846060 10587 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:46.847296 10585 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:46.791478 14172 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.853585 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:46.851215 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:46.849301 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:46.855477 10736 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:46.854903 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.865448 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:46.868394 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 65763.1us
I20260709 13:16:46.846817 14100 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:46.874228 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:46.872406 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53377.6us
I20260709 13:16:46.873700 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:46.875108 10663 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:46.875288 11415 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:46.877281 10736 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:46.884312 10591 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
W20260709 13:16:46.865387 14140 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:46.849251 14170 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:46.890046 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.890252 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:46.886289 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.886848 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.891654 10592 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:46.887715 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.893229 14100 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:46.896807 14176 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:46.897406 14176 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.897492 14100 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.899626 14176 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:46.900352 14176 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:46.900782 14176 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:46.901579 14008 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:46.902084 13973 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.546s	user 0.002s	sys 0.007s
I20260709 13:16:46.902232 14167 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.865813 14172 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.903366 14167 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.904856 14172 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:46.905462 13927 consensus_meta.cc:287] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.941s	user 0.013s	sys 0.005s
I20260709 13:16:46.902510 13973 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.906031 14162 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.865545 13781 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.906553 14162 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:46.907613 10587 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:46.905375 14167 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:46.907840 10632 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:46.865947 14026 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:46.909299 10665 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:46.914343 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:46.914433 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.918313 10591 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:46.918944 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:46.886943 13888 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.925114 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.925839 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.913636 14066 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:16:46.927757 10560 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:46.929504 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.908442 14074 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:46.902102 14008 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:46.931268 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:47.043437 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 385) took 1058 ms. Trace:
I20260709 13:16:46.930655 13888 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.074355 10586 rpcz_store.cc:276] 0709 13:16:46.019485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.019659 (+   174us) service_pool.cc:224] Handling call
0709 13:16:46.020031 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.020232 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.020257 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.020713 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.663068 (+642355us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:46.663116 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.663208 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.043243 (+380035us) raft_consensus.cc:1685] finished
0709 13:16:47.043263 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.043384 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":435238,"threads_started":1,"wal-append.queue_time_us":1020675}
I20260709 13:16:47.076242 13888 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:47.011842 13999 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:47.077175 13999 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.003140 14150 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:47.077941 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.998991 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:47.078825 10663 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.032272 14169 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.079134 14008 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:46.997411 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 386) took 1084 ms. Trace:
I20260709 13:16:47.080274 10668 rpcz_store.cc:276] 0709 13:16:45.913299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.921815 (+  8516us) service_pool.cc:224] Handling call
0709 13:16:45.922118 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:45.926248 (+  4130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.926278 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:45.939011 (+ 12733us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.210353 (+271342us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b1800312dc0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:46.673779 (+463426us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.673807 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.673851 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.997106 (+323255us) raft_consensus.cc:1685] finished
0709 13:16:46.997126 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.997355 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":368,"raft.queue_time_us":502,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":8430,"spinlock_wait_cycles":7597440,"thread_start_us":443256,"threads_started":1,"wal-append.queue_time_us":1045908}
I20260709 13:16:47.077939 14150 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:46.987879 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 66866.6us
I20260709 13:16:46.922768 13956 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:47.001816 14166 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:16:46.993413 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:47.083542 14163 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:47.083925 11412 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:47.083971 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2046) took 1008 ms. Trace:
I20260709 13:16:46.997202 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.085637 10589 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:46.995394 11409 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:46.969841 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 44277.9us
W20260709 13:16:46.976995 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.088860 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.042917 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:47.089712 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46880.8us
I20260709 13:16:47.085119 10593 rpcz_store.cc:276] 0709 13:16:46.075063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.075165 (+   102us) service_pool.cc:224] Handling call
0709 13:16:46.075452 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.101050 (+ 25598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.101092 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.125306 (+ 24214us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.539058 (+413752us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:46.539110 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.539201 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.083795 (+544594us) raft_consensus.cc:1685] finished
0709 13:16:47.083814 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.083922 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8617,"raft.queue_time_us":17516,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13655,"thread_start_us":348778,"threads_started":1,"wal-append.queue_time_us":539756}
I20260709 13:16:47.082188 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.038582 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.091729 10660 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:47.091606 10668 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
W20260709 13:16:47.005132 13959 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.001s
I20260709 13:16:46.985598 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:47.001245 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.077673 10586 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:46.985018 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:46.998661 14162 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:46.933508 10734 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.103623 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:47.142284 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 44316.9us
I20260709 13:16:47.154716 10739 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:47.148379 10663 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:46.914623 14170 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.077679 13999 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.082613 13742 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:47.185362 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.198406 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 94855.2us
I20260709 13:16:46.924711 14026 raft_consensus.cc:2764] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:47.004139 13973 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:47.161908 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.996214 14158 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:16:47.229532 10734 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:47.162091 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 49272.2us
W20260709 13:16:47.006067 13998 consensus_meta.cc:287] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.000s
I20260709 13:16:47.211077 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.236883 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:46.923269 14187 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:47.248535 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:47.248843 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:47.222848 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 453) took 1006 ms. Trace:
I20260709 13:16:47.237368 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:47.216965 14071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.018s
W20260709 13:16:47.243956 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 86680.3us
I20260709 13:16:47.244153 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:47.112787 14057 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.201146 14029 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.083469 13956 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.206161 14161 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.248164 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:47.112895 14112 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.005s
I20260709 13:16:47.155915 13959 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.112210 13656 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.251318 10738 rpcz_store.cc:276] 0709 13:16:46.216664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.298214 (+ 81550us) service_pool.cc:224] Handling call
0709 13:16:46.298550 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.300944 (+  2394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.301010 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.301996 (+   986us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.728749 (+426753us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:46.850573 (+121824us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.857427 (+  6854us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.222524 (+365097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.222605 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.222655 (+    50us) raft_consensus.cc:1685] finished
0709 13:16:47.222670 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.222795 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5747,"prepare.queue_time_us":489721,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":533398,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":45801,"thread_start_us":856579,"threads_started":3,"wal-append.queue_time_us":733252}
I20260709 13:16:47.112386 13927 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.945885 14066 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.262696 10591 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:47.263221 10742 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:46.932828 14164 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:47.263837 11409 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.245110 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:46.970520 14177 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:47.156577 14169 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.266047 14198 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.161624 14064 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.034394 14192 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.228s
I20260709 13:16:46.946183 14102 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.266073 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.033893 14093 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.229s
I20260709 13:16:47.290122 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2006) took 1182 ms. Trace:
I20260709 13:16:47.290483 10737 rpcz_store.cc:276] 0709 13:16:46.107787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.107937 (+   150us) service_pool.cc:224] Handling call
0709 13:16:46.108335 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.146451 (+ 38116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.146488 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.147070 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.312142 (+165072us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:46.312180 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.312263 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.289949 (+977686us) raft_consensus.cc:1685] finished
0709 13:16:47.289966 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.290069 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59468,"raft.queue_time_us":38549,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":27986,"thread_start_us":144796,"threads_started":1,"wal-append.queue_time_us":617904}
I20260709 13:16:47.270895 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:47.043772 13781 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
I20260709 13:16:47.271775 10585 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:47.241716 13742 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.112071 14023 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.153s
I20260709 13:16:46.992978 14172 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.112501 14160 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 13:16:47.203189 14074 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:16:47.266073 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:47.275588 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.267273 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.266598 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:47.266202 14174 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:47.003125 14176 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.276902 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:47.318080 10663 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.266675 14057 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.277997 10591 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:47.278549 10660 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.279649 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:47.265309 14071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.020s
I20260709 13:16:47.280742 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:47.332836 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:47.333214 10742 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:47.284583 10669 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:47.272524 14026 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.274430 14048 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.272315 14196 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:47.285799 10593 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:47.277156 13656 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.294210 10734 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:47.268249 14067 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:47.292255 11409 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:47.291826 14102 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.300427 14023 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:47.280371 13927 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.264430 13998 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.301484 14066 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.284503 14169 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.275974 14112 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.301630 13742 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.302172 14193 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:47.303426 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:47.380782 10737 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:47.302700 14172 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.308033 14192 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:47.308068 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:47.319751 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 53215.6us
I20260709 13:16:47.391572 10585 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:47.391906 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:47.326040 10591 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.327360 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2179) took 1143 ms. Trace:
I20260709 13:16:47.394866 10591 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.394681 10661 rpcz_store.cc:276] 0709 13:16:46.183756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.201301 (+ 17545us) service_pool.cc:224] Handling call
0709 13:16:47.327171 (+1125870us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:47.327308 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288980864}
I20260709 13:16:47.329638 14057 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.329905 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:47.335425 10663 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:47.398313 10738 raft_consensus.cc:3060] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.398825 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:47.399991 10663 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:47.336195 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:47.400671 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 64576.5us
I20260709 13:16:47.294189 14164 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:47.337514 10660 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:47.349401 13973 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:16:47.407318 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 75026.4us
I20260709 13:16:47.347113 10587 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:47.343322 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:47.349691 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:47.338343 14197 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.353169 14074 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:47.285756 14198 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.357081 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:47.359624 13959 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.355373 14102 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.391172 14150 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:47.361768 10476 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 8e245cc261b6415fac3d372489a49ceb already in progress [suppressed 28 similar messages]
W20260709 13:16:47.369468 14199 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:47.371464 13927 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.390592 10592 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:47.437897 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1570) took 1341 ms. Trace:
I20260709 13:16:47.438342 10594 rpcz_store.cc:276] 0709 13:16:46.096290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.138249 (+ 41959us) service_pool.cc:224] Handling call
0709 13:16:46.154785 (+ 16536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.431858 (+277073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.432046 (+   188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.075452 (+643406us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c00000f48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:16:47.075851 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.205674 (+129823us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:47.205723 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.205795 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.437573 (+231778us) raft_consensus.cc:1685] finished
0709 13:16:47.437601 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.437831 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93836,"raft.queue_time_us":129403,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":14604,"spinlock_wait_cycles":3590528,"thread_start_us":333214,"threads_started":2,"wal-append.queue_time_us":85306}
I20260709 13:16:47.443590 14164 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.444350 13823 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.448451 10667 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:47.449043 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2008) took 1039 ms. Trace:
I20260709 13:16:47.449445 10738 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:47.449795 10667 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:47.450753 10662 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:47.451022 10667 pending_rounds.cc:85] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 4
I20260709 13:16:47.451349 10667 pending_rounds.cc:107] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:16:47.451579 10667 raft_consensus.cc:2889] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.451913 10662 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:47.452117 14201 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.452643 14201 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.453035 10587 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:47.355865 14023 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:47.454622 14201 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.454344 14023 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.455602 14023 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:47.356297 14196 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.397013 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.339066 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:47.457901 11413 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:47.458220 14196 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.409725 10742 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:47.405076 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:47.411181 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76038.9us
I20260709 13:16:47.463550 10660 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:47.377535 13888 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:47.419057 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 450) took 1209 ms. Trace:
I20260709 13:16:47.412178 14197 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.410053 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:47.397691 14172 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:47.396245 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 159430us
I20260709 13:16:47.468072 14112 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:47.468585 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.397950 14192 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.465924 10742 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:16:47.469730 14192 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.417861 14074 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.429019 13656 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.429292 14169 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:47.429575 13999 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:47.420463 14019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.014s	sys 0.009s
I20260709 13:16:47.432060 13998 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.320358 14170 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.356660 14067 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.412150 14064 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:47.434614 10663 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:47.452301 10662 pending_rounds.cc:85] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 4
I20260709 13:16:47.457927 10741 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:47.422168 10591 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:47.418087 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.464879 10740 rpcz_store.cc:276] 0709 13:16:46.202917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.232119 (+ 29202us) service_pool.cc:224] Handling call
0709 13:16:47.411871 (+1179752us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003507d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:47.411979 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298405248}
I20260709 13:16:47.398141 14111 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.473151 11382 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.449440 10739 rpcz_store.cc:276] 0709 13:16:46.409274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.409437 (+   163us) service_pool.cc:224] Handling call
0709 13:16:47.080758 (+671321us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:47.080940 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.156149 (+ 75209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.448828 (+292679us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b54001ce8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:47.448986 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197129984}
I20260709 13:16:47.410307 14026 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.473943 10742 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:16:47.478269 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 63411us
W20260709 13:16:47.480095 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 83189.4us
I20260709 13:16:47.390331 14071 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:47.483008 10585 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:16:47.492691 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:47.502110 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 145118us
W20260709 13:16:47.520982 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47906.4us
I20260709 13:16:47.521881 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:47.502944 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 92924.7us
I20260709 13:16:47.465860 14197 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.515844 10661 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:47.515928 10662 pending_rounds.cc:107] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:47.518502 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:47.481254 14193 raft_consensus.cc:2764] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:47.481670 13959 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:47.505757 14019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.014s	sys 0.009s
I20260709 13:16:47.523345 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.492458 14061 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.524890 10662 raft_consensus.cc:2889] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.533246 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.533893 10663 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:47.505311 14029 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.503602 13656 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.537868 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:47.519878 14196 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:47.529770 11415 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:47.527980 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:47.526463 10476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 187018us
I20260709 13:16:47.535133 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:47.536931 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.540723 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.525458 14211 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.541425 10663 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:47.544024 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:47.544669 10662 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:47.526418 10660 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:47.546514 10662 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:47.528419 14074 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.519448 14187 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:47.550148 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.551622 14198 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:47.549752 10706 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.554334 14102 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.555886 14057 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.541541 14112 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.557683 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:47.519577 14064 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.530638 14019 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.562772 10663 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:47.567438 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.557135 14197 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.564075 14061 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.570000 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.559473 14211 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:47.577719 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:47.536240 13959 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.543776 13781 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:47.615540 10661 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:47.570595 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:47.616272 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46363.8us
I20260709 13:16:47.619705 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.619908 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.543604 13656 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.574838 14093 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:47.573632 14162 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.620290 10587 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
W20260709 13:16:47.626212 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55717.8us
I20260709 13:16:47.617730 14204 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:47.628911 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 135932us
I20260709 13:16:47.572140 14196 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.629601 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.630602 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.631106 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.627413 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:47.633147 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:47.627847 10632 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:47.633711 10589 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:47.635254 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.636425 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.611351 14066 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.647174 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:47.649513 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56154
I20260709 13:16:47.650038 10589 raft_consensus.cc:606] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:16:47.650416 10589 raft_consensus.cc:614] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.661194 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 394) took 1269 ms. Trace:
W20260709 13:16:47.662735 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2185) took 1477 ms (client timeout 1503 ms). Trace:
I20260709 13:16:47.661739 10590 rpcz_store.cc:276] 0709 13:16:46.392279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.392511 (+   232us) service_pool.cc:224] Handling call
0709 13:16:46.392910 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.498265 (+105355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.498307 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.498958 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.917903 (+418945us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.918286 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.660764 (+742478us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001abdd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:47.660808 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.660853 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:47.660866 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.661118 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1667,"raft.queue_time_us":1777,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":31647,"spinlock_wait_cycles":237203712,"thread_start_us":300283,"threads_started":1,"wal-append.queue_time_us":472095}
I20260709 13:16:47.575510 14164 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:16:47.664837 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:47.615963 14026 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:47.625509 14112 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.667766 10593 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
W20260709 13:16:47.663260 10669 rpcz_store.cc:269] 0709 13:16:46.194996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.205363 (+ 10367us) service_pool.cc:224] Handling call
0709 13:16:47.662487 (+1457124us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002da354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:47.662666 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461242240}
I20260709 13:16:47.629771 14162 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.626643 14149 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:47.672981 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:47.642264 14160 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.677590 10669 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.635639 14193 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.642968 14122 raft_consensus.cc:2804] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:47.646073 14169 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.645743 14061 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.642832 13781 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:47.706650 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.635980 14176 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:47.675046 14112 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.668219 13999 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:47.724452 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 97068.1us
I20260709 13:16:47.739343 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:47.677845 14198 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.679114 14162 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.748623 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:47.679977 14064 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.751541 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:47.742839 14177 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.667974 14066 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.769922 14122 raft_consensus.cc:697] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:47.777402 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 108336us
I20260709 13:16:47.753229 14088 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.749468 14112 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.744400 14169 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.794121 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.757716 14160 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.800019 13781 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.775660 14193 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.818287 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:47.664186 14204 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.800758 14203 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.826201 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 141277us
I20260709 13:16:47.722640 14149 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.788271 14074 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:47.776103 14198 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.817291 14160 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:47.822570 14093 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:47.842458 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 91021us
I20260709 13:16:47.720609 14019 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.793721 14061 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:47.741175 14187 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.836066 14205 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.836431 14057 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.761035 14196 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.834154 14193 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.838263 14212 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.853608 14176 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.836367 14188 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.848224 14160 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.835981 14182 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.322s
I20260709 13:16:47.878815 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:47.879612 11415 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:47.847209 14102 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:47.848536 14093 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.870954 14205 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.844748 14074 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.862929 14197 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.836254 14215 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.305s
I20260709 13:16:47.875794 14186 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.874625 14212 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:47.774554 14211 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.837487 14203 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.879577 13656 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.827219 14026 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.899513 10669 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:47.882462 14093 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:47.894466 14228 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:47.884680 14205 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.923753 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:47.874087 14198 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.928215 10669 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:47.882768 14188 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:47.900632 14215 consensus_queue.cc:1243] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:47.929162 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:47.902599 14212 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.949378 10593 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:47.916702 14226 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:47.886081 14233 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.200s
I20260709 13:16:47.937812 14217 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.871526 14122 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:47.882261 14169 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:47.974346 14221 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:16:47.956705 14066 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:48.001840 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 117650us
I20260709 13:16:47.971885 13959 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:47.974570 14176 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:47.993449 14217 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:48.010869 14172 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.002s
I20260709 13:16:48.001536 14233 consensus_queue.cc:1243] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:16:48.020541 14023 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.002s
I20260709 13:16:48.021731 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 388) took 1364 ms. Trace:
I20260709 13:16:48.041985 10664 rpcz_store.cc:276] 0709 13:16:46.657268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.684165 (+ 26897us) service_pool.cc:224] Handling call
0709 13:16:48.021549 (+1337384us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b54000c5154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.021674 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5965696}
I20260709 13:16:48.021931 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 398) took 1114 ms. Trace:
W20260709 13:16:48.022583 14224 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:16:48.022852 14223 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:16:48.010497 14182 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.013850 14149 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:48.032948 14216 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.485s	user 0.004s	sys 0.000s
I20260709 13:16:48.037858 14217 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.040679 14160 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.044243 10592 rpcz_store.cc:276] 0709 13:16:46.907968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.915340 (+  7372us) service_pool.cc:224] Handling call
0709 13:16:48.021726 (+1106386us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540020ec54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.021856 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684245888}
W20260709 13:16:48.099591 10666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2189) took 1764 ms (client timeout 1996 ms). Trace:
W20260709 13:16:48.099974 10666 rpcz_store.cc:269] 0709 13:16:46.334975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.335136 (+   161us) service_pool.cc:224] Handling call
0709 13:16:48.099448 (+1764312us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54002d9e54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.099544 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37675392}
W20260709 13:16:48.103206 10665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2205) took 1323 ms (client timeout 1503 ms). Trace:
W20260709 13:16:48.103693 10665 rpcz_store.cc:269] 0709 13:16:46.780243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.782573 (+  2330us) service_pool.cc:224] Handling call
0709 13:16:48.103000 (+1320427us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000b3bd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.103142 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278972672}
I20260709 13:16:47.953500 14193 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.122304 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.121413 10665 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:48.052419 14233 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.122934 11415 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:48.124441 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.124962 11415 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:16:48.059123 14188 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.126217 14203 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.129197 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:48.061250 14204 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.033623 14172 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.137476 10665 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:48.136749 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:48.109170 14074 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.064896 14182 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.142661 14194 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:48.147231 14203 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:48.162720 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 390) took 2067 ms. Trace:
I20260709 13:16:48.163115 10588 rpcz_store.cc:276] 0709 13:16:46.095137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.120460 (+ 25323us) service_pool.cc:224] Handling call
0709 13:16:46.120773 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.234162 (+113389us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:46.663440 (+429278us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.663651 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.663708 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:46.663761 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.162489 (+1498728us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002c97d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:48.162538 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.162657 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":827203,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":6522,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9653,"spinlock_wait_cycles":260166400,"thread_start_us":386758,"threads_started":1}
I20260709 13:16:48.174315 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1923) took 1252 ms. Trace:
I20260709 13:16:48.174544 14160 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.158109 14194 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.177641 14194 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.176554 10668 rpcz_store.cc:276] 0709 13:16:46.921639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.470531 (+548892us) service_pool.cc:224] Handling call
0709 13:16:47.470787 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.470972 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.470994 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.471428 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.579636 (+108208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:47.641963 (+ 62327us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.686062 (+ 44099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.686157 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.174138 (+487981us) raft_consensus.cc:1685] finished
0709 13:16:48.174156 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.174266 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106738,"prepare.queue_time_us":65303,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":140559,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6128,"spinlock_wait_cycles":10227584,"thread_start_us":151587,"threads_started":2,"wal-append.queue_time_us":329926}
I20260709 13:16:48.178416 14172 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.163229 14203 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:48.177466 14222 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:16:48.135180 14233 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.192351 14162 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.186303 14203 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:48.170176 14112 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:48.202996 14051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.017s	sys 0.018s
W20260709 13:16:48.208655 14051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.017s	sys 0.019s
I20260709 13:16:48.185438 14205 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.222257 10590 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:48.226208 14176 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:48.227053 14176 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.229005 14176 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:48.231500 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.241295 14212 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.241926 14205 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.239926 14018 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:48.244629 14018 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:48.249583 14018 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:48.244853 14111 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.000s
I20260709 13:16:48.255105 14111 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:48.255849 14093 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.256330 10734 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:48.260529 14259 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:48.262157 14182 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:48.265746 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 196575us
W20260709 13:16:48.267267 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.268501 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.272895 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 447) took 2073 ms. Trace:
I20260709 13:16:48.273392 10735 rpcz_store.cc:276] 0709 13:16:46.199247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.307751 (+108504us) service_pool.cc:224] Handling call
0709 13:16:48.263894 (+1956143us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:48.264082 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.264269 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.264293 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.272586 (+  8293us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:48.272639 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.272700 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.272839 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27436800}
I20260709 13:16:48.274009 10734 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:48.283969 14194 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.284868 14093 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:48.297153 14161 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.298303 14185 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.298163 14161 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.298947 14185 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.300014 13786 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.300613 13786 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.301242 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:48.303092 13786 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.304491 14194 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.304446 13742 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.305466 13998 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:48.305997 13998 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:48.306876 13998 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.308905 14161 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.304841 14185 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.309811 14203 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.313429 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.314853 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.315397 14112 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:48.330456 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:48.331135 11415 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.316869 14147 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.340219 14064 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:48.341441 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 519315us
I20260709 13:16:48.345450 11415 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:48.346704 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:48.350953 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.351595 11415 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:48.352968 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.346208 14227 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.354084 14051 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.354612 14247 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.349815 14235 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.355284 14247 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.355517 14235 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:48.356628 14236 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.476s	user 0.000s	sys 0.003s
I20260709 13:16:48.357743 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:48.357815 14235 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.358395 11418 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:48.358558 14260 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:16:48.351469 14147 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:48.354707 14051 consensus_queue.cc:1243] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:48.370731 11418 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:48.362589 14147 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:48.371631 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:48.375334 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.376883 10736 raft_consensus.cc:2368] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
W20260709 13:16:48.379352 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.386065 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:48.386811 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.388200 10743 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:48.388375 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.388980 10739 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
W20260709 13:16:48.389411 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.385010 13786 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.390880 13786 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.391697 10735 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:48.392798 13786 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.393448 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.379153 13934 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.394304 13934 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.397964 10736 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:48.365624 14247 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.363829 14227 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:47.745673  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:48.410840 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:48.515216 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 397) took 1211 ms. Trace:
W20260709 13:16:48.501303 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 683046us
I20260709 13:16:48.485035 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:48.519052 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:48.520152 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.520789 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1933) took 1004 ms. Trace:
I20260709 13:16:48.502472 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:48.521152 10665 rpcz_store.cc:276] 0709 13:16:47.516803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.140894 (+624091us) service_pool.cc:224] Handling call
0709 13:16:48.143334 (+  2440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.520471 (+377137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.520502 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.520551 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:48.520584 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.520640 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.520745 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376797}
I20260709 13:16:48.421509 10735 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:48.483009 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 460) took 1163 ms. Trace:
I20260709 13:16:48.517562 10669 rpcz_store.cc:276] 0709 13:16:47.303756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.939850 (+636094us) service_pool.cc:224] Handling call
0709 13:16:47.940181 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.351099 (+410918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.351128 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.361288 (+ 10160us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.470278 (+108990us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:48.470334 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.470425 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.515022 (+ 44597us) raft_consensus.cc:1685] finished
0709 13:16:48.515039 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.515164 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410531,"raft.queue_time_us":418040,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"thread_start_us":101121,"threads_started":1,"wal-append.queue_time_us":147897}
I20260709 13:16:48.530257 10734 rpcz_store.cc:276] 0709 13:16:47.319714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.349466 (+ 29752us) service_pool.cc:224] Handling call
0709 13:16:48.482811 (+1133345us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540032fd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.482939 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946514816}
I20260709 13:16:48.406663 14203 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.545148 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.511158 13547 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.499945 14186 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:48.550582 10669 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:16:48.551386 10669 pending_rounds.cc:85] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 7
I20260709 13:16:48.551628 10669 pending_rounds.cc:107] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:16:48.551846 10669 raft_consensus.cc:2889] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.539649 14003 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.552541 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.555449 10665 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:48.556674 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 399) took 1200 ms. Trace:
I20260709 13:16:48.559439 10666 rpcz_store.cc:276] 0709 13:16:47.355894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.100591 (+744697us) service_pool.cc:224] Handling call
0709 13:16:48.100828 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.100967 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:48.123626 (+ 22659us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.426606 (+302980us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b18003bd400. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:48.556375 (+129769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:48.556420 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:48.556461 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.556521 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.556624 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65323,"prepare.queue_time_us":22556,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5400,"raft.queue_time_us":66336,"spinlock_wait_cycles":10628992,"thread_start_us":64199,"threads_started":1,"wal-append.queue_time_us":418869}
I20260709 13:16:48.557541 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.558859 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:48.555222 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 183666us
I20260709 13:16:48.561913 10669 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:48.562013 10737 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.557225 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:48.562863 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:48.466667 14147 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.563862 11418 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:16:48.563361 10669 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.568701 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:48.554067 14186 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.553160 14203 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.564951 10662 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:48.543650 14151 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:48.553442 14204 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.579365 14204 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.581293 14204 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.581789 14204 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:48.582988 13742 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:48.583352 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.584374 13742 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.584686 13888 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:48.587430 14018 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.572060 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:48.590114 10665 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:48.590191 13934 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.591322 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.555065 14232 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.591934 14232 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.560062 14235 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:48.555773 13547 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.593699 14235 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:48.594681 14235 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.595948 13547 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.574442 10737 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:48.558301 14247 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.557029 14003 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:48.572892 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.603099 10666 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:48.604111 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.617420 10669 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:48.617674 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:48.571061 14233 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.605824 14003 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.603261 14160 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.631130 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:48.632215 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:48.606470 14231 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.635459 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:48.636497 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.625838 14211 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.637410 10559 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:48.638273 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.639209 11415 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:48.603912 14203 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.614393 14194 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:16:48.640376 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:48.634820 14113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.007s	sys 0.011s
I20260709 13:16:48.633471 13786 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:48.633994 13547 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.613704 14247 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.633833 13934 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:48.649464 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.636365 14201 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.633674 13998 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:48.640283 14151 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.654016 14151 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.654402 14151 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.656533 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 371) took 1314 ms. Trace:
I20260709 13:16:48.651190 14071 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.657349 13934 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.659584 13934 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.636543 14160 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.659878 13998 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.643080 14088 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:48.648108 14113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.008s	sys 0.011s
I20260709 13:16:48.661875 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.656879 11412 rpcz_store.cc:276] 0709 13:16:47.342279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.342424 (+   145us) service_pool.cc:224] Handling call
0709 13:16:47.354211 (+ 11787us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:47.372144 (+ 17933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.372182 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:47.378695 (+  6513us) log.cc:844] Serialized 52 byte log entry
0709 13:16:48.427060 (+1048365us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b1800346000. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:48.558591 (+131531us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:48.619635 (+ 61044us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.619863 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.619952 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.656246 (+ 36294us) raft_consensus.cc:1685] finished
0709 13:16:48.656321 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.656462 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59796,"raft.queue_time_us":48946,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":12208,"spinlock_wait_cycles":18899456,"thread_start_us":180883,"threads_started":2,"wal-append.queue_time_us":1227687}
I20260709 13:16:48.663439 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.664876 10736 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:48.652370 14201 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.639155 14231 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.676388 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.651443 13786 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:48.652060 13547 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:48.674193 14201 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.684891 14227 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.696138 13547 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.707546 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.708247 10735 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:48.710806 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 448) took 2508 ms. Trace:
I20260709 13:16:48.711227 10743 rpcz_store.cc:276] 0709 13:16:46.202443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.303993 (+101550us) service_pool.cc:224] Handling call
0709 13:16:47.085690 (+781697us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:16:47.085865 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.388730 (+1302865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.710540 (+321810us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001cd254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:48.710715 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014824064}
W20260709 13:16:48.696313 14229 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.896s	user 0.007s	sys 0.000s
I20260709 13:16:48.717048 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.717729 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.718438 14212 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.719326 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2207) took 1872 ms. Trace:
I20260709 13:16:48.701802 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.720356 11415 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:48.718430 11409 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:48.721834 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.722204 10707 connection.cc:256] RPC call timeout handler was delayed by -1.1034653240001262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:16:48.723078 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.702158 14203 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:48.702943 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.703856 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:48.690086 13998 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.714938 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.714906 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.715489 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.744971 10589 raft_consensus.cc:2410] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:48.715812 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:48.716326 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.745573 10587 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:48.716292 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.716742 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.716985 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.746357 10586 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.717705 10593 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.719689 10667 rpcz_store.cc:276] 0709 13:16:46.846524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.450532 (+604008us) service_pool.cc:224] Handling call
0709 13:16:47.450844 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:47.483313 (+ 32469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.483345 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:47.483883 (+   538us) log.cc:844] Serialized 52 byte log entry
0709 13:16:47.668781 (+184898us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:47.740259 (+ 71478us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.940686 (+200427us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.351495 (+410809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.351577 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.695684 (+344107us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:48.719130 (+ 23446us) raft_consensus.cc:1685] finished
0709 13:16:48.719154 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.719273 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":946941,"prepare.queue_time_us":78768,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":522893,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":25119,"spinlock_wait_cycles":2807168,"thread_start_us":318048,"threads_started":2,"wal-append.queue_time_us":283379}
I20260709 13:16:48.714119 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.724315 10739 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:48.702600 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1934) took 1182 ms. Trace:
I20260709 13:16:48.748483 10661 rpcz_store.cc:276] 0709 13:16:47.519737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.528643 (+  8906us) service_pool.cc:224] Handling call
0709 13:16:48.702420 (+1173777us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54003aacd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:48.702538 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173156224}
I20260709 13:16:48.726375 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:48.749852 10738 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:48.726830 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:48.734659 14169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.010s
I20260709 13:16:48.738111 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.812165 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.812970 10590 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.814704 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.815266 10739 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:48.815973 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.817193 10594 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:48.829782 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.830336 10588 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.830850 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:48.831513 10594 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.837533 10739 raft_consensus.cc:2393] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:48.838471 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.853442 10585 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:48.720516 13786 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:48.876650 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:48.861035 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:48.868502 10586 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:48.723615 13973 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:16:48.871112 10594 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:49.154862 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:49.109807 10588 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:49.081128 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.154834 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:49.107925 10593 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:16:49.171972 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 449499us
W20260709 13:16:48.986743 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.172806 10585 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:48.877234 10667 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:49.154036 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:48.810603 14169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.011s
I20260709 13:16:49.177073 10735 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:49.178885 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.174546 10585 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:49.178141 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:48.983875 10590 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:49.180383 10585 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:48.971992 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 161634us
I20260709 13:16:49.122274 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.175583 10743 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:48.877790 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:49.181838 10591 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:48.877914 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.182366 10661 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.177219 13547 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.178069 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:49.074697 14284 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:16:48.743109 14212 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.198817 10590 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:49.162427 14231 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.067528 14067 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.113559 13934 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:49.114491 11413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 549) took 1560 ms. Trace:
I20260709 13:16:49.174957 10742 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 5.
I20260709 13:16:49.186036 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:49.180011 10588 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:49.205622 10739 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:49.204401 11413 rpcz_store.cc:276] 0709 13:16:47.537104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.537344 (+   240us) service_pool.cc:224] Handling call
0709 13:16:49.096884 (+1559540us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54005820d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:49.097053 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796089216}
W20260709 13:16:49.164000 14151 consensus_meta.cc:287] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.002s
I20260709 13:16:49.192178 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:49.196099 13547 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.078039 14203 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.200032 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:49.185068 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:49.218004 10743 raft_consensus.cc:2393] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:49.147418 14176 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.049362 13786 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:48.860884 14260 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:16:49.242313 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1927) took 2315 ms. Trace:
I20260709 13:16:48.971431 14003 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.164324 14201 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.213267 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.194798 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.262221 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.263319 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.264235 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.264708 10669 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:49.265982 14026 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.266460 14026 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.268250 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1928) took 2341 ms. Trace:
I20260709 13:16:49.066816 14186 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.228293 10489 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 7 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.269201 14231 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:49.269984 14067 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.269692 14231 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.270721 14186 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.270525 14067 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.271946 14061 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.272143 14231 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.272621 14067 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.273217 14234 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.273772 14234 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.274624 14201 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:49.266016 14262 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.038s	user 0.001s	sys 0.015s
I20260709 13:16:49.275949 14234 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.214355 10735 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:49.252005 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:49.211848 14247 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.277295 10667 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:49.277655 10587 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:49.249992 14211 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:49.243481 14177 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.243111 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 398) took 1929 ms. Trace:
W20260709 13:16:49.244292 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 578525us
I20260709 13:16:49.235185 14192 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.248708 14057 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:49.272572 10663 rpcz_store.cc:276] 0709 13:16:46.927076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.576691 (+649615us) service_pool.cc:224] Handling call
0709 13:16:48.103205 (+526514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.516845 (+413640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.516872 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.535067 (+ 18195us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.614379 (+ 79312us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.614420 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.614488 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.644905 (+ 30417us) raft_consensus.cc:1685] finished
0709 13:16:48.644924 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.267886 (+622962us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54000b3bd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:49.268167 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413236,"raft.queue_time_us":416832,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11736,"spinlock_wait_cycles":1210016512,"thread_start_us":55836,"threads_started":1,"wal-append.queue_time_us":89271}
I20260709 13:16:49.286592 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.287204 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:49.287999 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.288554 10663 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.251091 13547 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.257591 10737 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:49.206899 14162 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:49.268347 14026 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.278584 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.288980 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:49.238257 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.307646 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.308019 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.203130 14212 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.210523 13934 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.282871 10664 rpcz_store.cc:276] 0709 13:16:47.314207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.042804 (+728597us) service_pool.cc:224] Handling call
0709 13:16:48.043099 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.043303 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:48.043580 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.625771 (+582191us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.242806 (+617035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.242856 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:49.242895 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.242958 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.243064 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":918096,"prepare.queue_time_us":112355,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":909102,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":5278,"thread_start_us":292037,"threads_started":2,"wal-append.queue_time_us":237960}
I20260709 13:16:49.258845 10662 rpcz_store.cc:276] 0709 13:16:46.926711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.547083 (+620372us) service_pool.cc:224] Handling call
0709 13:16:48.026907 (+479824us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.364893 (+337986us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:48.386529 (+ 21636us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.557711 (+171182us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.564792 (+  7081us) log.cc:844] Serialized 574 byte log entry
0709 13:16:48.564886 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:48.605982 (+ 41096us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.613864 (+  7882us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.240902 (+627038us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b1800392740. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287 00007f42572d4208
0709 13:16:49.241062 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.241202 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.241259 (+    57us) raft_consensus.cc:1685] finished
0709 13:16:49.241279 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.242170 (+   891us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54000c5150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:49.242263 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":985731,"prepare.queue_time_us":329346,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":1145502,"raft.run_cpu_time_us":35145,"raft.run_wall_time_us":742269,"spinlock_wait_cycles":1120544384,"thread_start_us":149478,"threads_started":1,"wal-append.queue_time_us":228470}
I20260709 13:16:49.312129 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.312758 10662 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:49.261044 14064 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.213465 14151 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.308228 10667 raft_consensus.cc:2376] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9. Re-sending same reply.
I20260709 13:16:49.319813 10662 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
W20260709 13:16:49.289930 14185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.006s	sys 0.023s
I20260709 13:16:49.283921 14061 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.323335 14003 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:49.325716 14185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.006s	sys 0.024s
I20260709 13:16:49.329291 10666 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:49.330602 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.331383 10662 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:49.332808 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:49.337744 10540 auto_rebalancer.cc:893] Removing replace marker failed: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:16:49.338173 10540 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:16:49.338423 10540 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:49.261691 14051 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:16:49.339458 13781 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:49.340586 13648 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.340938 13648 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:49.341797 13648 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.281117 13888 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.343674 13888 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.252321 14176 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.346879 14176 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.347505 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1922) took 2429 ms. Trace:
I20260709 13:16:49.349692 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.350268 10665 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:49.351037 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.317490 14288 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:49.351987 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.352252 14288 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:49.353112 14288 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.221678 14203 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.285859 14018 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.357129 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.357640 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.361867 10669 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:49.320897 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:49.347852 10660 rpcz_store.cc:276] 0709 13:16:46.917936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.464144 (+546208us) service_pool.cc:224] Handling call
0709 13:16:47.464418 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.526316 (+ 61898us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:47.644408 (+118092us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.366207 (+721799us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.553598 (+187391us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.565941 (+ 12343us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.566337 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.566475 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:48.566639 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.571426 (+  4787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.233668 (+662242us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4800160158. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:16:49.347227 (+113559us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b5400320d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:49.347276 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.347318 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:49.347330 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.347456 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":833507,"prepare.queue_time_us":4387,"prepare.run_wall_time_us":36,"raft.queue_time_us":622056,"raft.run_cpu_time_us":9807,"raft.run_wall_time_us":683180,"spinlock_wait_cycles":274491904,"thread_start_us":184865,"threads_started":1,"wal-append.queue_time_us":330476}
I20260709 13:16:49.364127 10632 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:49.359462 10663 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:49.283705 14211 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.367219 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:49.369666 14232 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.371742 13934 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.259727 13786 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.355875 14203 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.373225 10661 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:49.373267 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.312610 13973 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:49.320073 14204 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.375864 10741 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:49.381393 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.385196 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.385651 10593 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:49.385602 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.372808 14029 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:49.382352 10667 raft_consensus.cc:2376] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10. Re-sending same reply.
I20260709 13:16:49.374276 14177 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:49.382792 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.383641 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.383481 13973 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.384447 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.386296 10590 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:16:49.386432 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.378113 14172 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.405619 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.426227 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.414975 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.415380 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.423588 10590 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:49.360193 14064 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.427277 10586 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:49.428400 10663 pending_rounds.cc:85] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 3
I20260709 13:16:49.428745 10663 pending_rounds.cc:107] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:49.429056 10663 raft_consensus.cc:2889] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.429080 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.435304 10667 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:49.436803 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.437391 10669 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:16:49.440054 10669 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:49.441424 10669 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:49.444324 10669 pending_rounds.cc:85] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 6
I20260709 13:16:49.444567 10669 pending_rounds.cc:107] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:16:49.444796 10669 raft_consensus.cc:2889] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.444993 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.447117 13786 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.393632 14029 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.449625 14029 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.450196 14061 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.449095 13973 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:49.458057 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 276577us
W20260709 13:16:49.459203 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 262131us
I20260709 13:16:49.431944 10586 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.432587 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.464941 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.459421 10662 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:16:49.426254 14172 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.462033 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.465487 10666 raft_consensus.cc:2376] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12. Re-sending same reply.
I20260709 13:16:49.465946 10590 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:49.435557 13888 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.428185 14177 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:49.431417 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:49.393816 14204 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:49.507076 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47226.3us
W20260709 13:16:49.566839 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 135495us
I20260709 13:16:49.498279 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.577112 11412 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
W20260709 13:16:49.573764 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43948.4us
I20260709 13:16:49.577778 11413 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:49.585237 11382 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:49.530387 14172 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.590044 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.595398 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:49.593201 10664 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:49.583527 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:49.578792 14232 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:49.598533 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.463445 14162 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:16:49.597492 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:49.588371 14113 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.626564 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:49.600116 14147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.022s	sys 0.023s
W20260709 13:16:49.600258 14255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.016s	sys 0.007s
I20260709 13:16:49.636549 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.604053 14192 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:49.603617 14232 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.638854 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:49.630563 14147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.022s	sys 0.023s
I20260709 13:16:49.605980 13973 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:49.588198 14061 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:49.603780 14074 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:49.629736 14255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.017s	sys 0.007s
I20260709 13:16:49.646063 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.646862 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:49.639739 10489 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 4 to 8, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.592185 14289 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:49.628239 14234 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:49.695715 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 226137us
I20260709 13:16:49.631803 14212 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:49.648355 14108 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:49.693977 10592 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:49.625452 14247 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:16:49.636848 14151 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.647795 14232 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:49.692041 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 508028us
I20260709 13:16:49.700978 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2034) took 1147 ms. Trace:
W20260709 13:16:49.702719 14279 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:16:49.691793 14167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.006s
I20260709 13:16:49.689801 13973 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.627784 14113 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.690623 14192 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:49.782605 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.694975 14231 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.783851 14231 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.785928 14231 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.783458 14192 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.638935 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1940) took 1820 ms. Trace:
I20260709 13:16:49.789808 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.734280 10736 rpcz_store.cc:276] 0709 13:16:48.553618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.554356 (+   738us) service_pool.cc:224] Handling call
0709 13:16:48.554938 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.665241 (+110303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.700766 (+1035525us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003309d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:49.700924 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251966208}
I20260709 13:16:49.724342 14071 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.648106 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 474502us
I20260709 13:16:49.770780 10587 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:49.771571 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.771775 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:49.712918 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:49.773639 10589 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:49.778396 10590 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:49.724709 14212 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:49.782684 14064 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:49.762076 14167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.006s	sys 0.007s
I20260709 13:16:49.789875 10668 rpcz_store.cc:276] 0709 13:16:47.818610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.178756 (+360146us) service_pool.cc:224] Handling call
0709 13:16:48.179062 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.539649 (+360587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.539679 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.544120 (+  4441us) log.cc:844] Serialized 52 byte log entry
0709 13:16:48.638153 (+ 94033us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.682873 (+ 44720us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.638383 (+955510us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.638662 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.638728 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.638764 (+    36us) raft_consensus.cc:1685] finished
0709 13:16:49.638774 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.638888 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969137,"prepare.queue_time_us":108325,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":962696,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":18092,"thread_start_us":455854,"threads_started":3,"wal-append.queue_time_us":121974}
I20260709 13:16:49.812724 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.813443 10668 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.808754 10560 leader_election.cc:400] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
I20260709 13:16:49.815598 10560 leader_election.cc:403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.812760 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2210) took 1205 ms. Trace:
I20260709 13:16:49.816586 10662 rpcz_store.cc:276] 0709 13:16:48.607456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.332549 (+725093us) service_pool.cc:224] Handling call
0709 13:16:49.812566 (+480017us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540026a7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:49.812692 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289493248}
I20260709 13:16:49.818030 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.773147 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:49.775949 14088 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:49.820202 14088 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.822540 14088 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:49.822700 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.823216 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2223) took 1212 ms. Trace:
I20260709 13:16:49.823577 10664 rpcz_store.cc:276] 0709 13:16:48.611147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.311859 (+700712us) service_pool.cc:224] Handling call
0709 13:16:49.444855 (+132996us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:49.823058 (+378203us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000c1f54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:49.823165 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351021696}
I20260709 13:16:49.775032 13973 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.824606 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:49.825145 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 112325us
I20260709 13:16:49.826032 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2043) took 1144 ms. Trace:
I20260709 13:16:49.826515 10589 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:49.828152 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:49.829041 10590 raft_consensus.cc:2393] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:49.826381 10741 rpcz_store.cc:276] 0709 13:16:48.682023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.682432 (+   409us) service_pool.cc:224] Handling call
0709 13:16:48.683577 (+  1145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.385020 (+701443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.825831 (+440811us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540036bfd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:49.825979 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590764928}
W20260709 13:16:49.836504 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 63428us
I20260709 13:16:49.840214 10593 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:49.645152 14177 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.762912 14162 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.700594 14234 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.842700 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:49.849731 10662 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:49.851905 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54137.9us
I20260709 13:16:49.853098 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:49.854312 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.862421 10668 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:49.843197 14230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.018s
I20260709 13:16:49.868914 10560 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:49.869900 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:49.870560 10668 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.866771 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:49.834300 13547 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.871966 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:49.845695 14066 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:49.859526 13786 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12.
I20260709 13:16:49.880481 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:49.880604 10664 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:49.834883 14071 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.844602 14289 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:49.873427 14230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.019s
I20260709 13:16:49.854163 14293 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:49.875705 14088 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.889426 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 409) took 1310 ms. Trace:
I20260709 13:16:49.882129 14064 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:49.884819 14305 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:49.873212 14203 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:49.861920 14162 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:49.888037 14147 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:49.888949 14160 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:49.900271 14088 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.891853 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.897773 14227 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:49.879580 13547 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:49.895856 14293 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.967941 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 392377us
I20260709 13:16:49.959894 14067 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.889974 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:49.974993 10668 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:50.011288 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:50.012079 10668 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.998392 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.014010 10587 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:49.999565 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.015218 10590 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:50.001530 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:49.915388 14212 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:49.899201 10665 rpcz_store.cc:276] 0709 13:16:48.578815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.463005 (+884190us) service_pool.cc:224] Handling call
0709 13:16:49.576502 (+113497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.576696 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:49.588137 (+ 11441us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.888944 (+300807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.889030 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:49.889103 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.889201 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.889357 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8353,"prepare.queue_time_us":11678,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":1669,"raft.queue_time_us":10484,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5908,"thread_start_us":291845,"threads_started":1}
I20260709 13:16:49.893652 14151 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:16:49.886868 14288 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:16:50.007185 10588 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:49.891969 14029 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.009040 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:49.992152 14088 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.041831 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:49.992489 14227 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.994856 14203 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:50.067762 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58831.7us
I20260709 13:16:49.959542 14294 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.141s
I20260709 13:16:50.082765 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:50.007807 14293 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.010659 13738 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:16:50.109072 14029 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.109726 14029 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:50.110977 14203 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.111753 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:50.112313 10665 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.007232 14160 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:16:49.968112 14064 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:50.142215 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 252352us
I20260709 13:16:49.968544 14305 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.069084 14235 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.045823 10668 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:50.083192 14147 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:50.136471 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.136803 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.156013 10741 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:50.156334 10736 raft_consensus.cc:2393] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:50.147807 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.157137 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.157581 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:50.158035 10741 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:50.154594 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.154840 10737 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:50.158820 10743 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:50.159559 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.155208 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.159937 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.042330 14067 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.103711 14227 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.202137 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2083) took 1231 ms. Trace:
I20260709 13:16:50.202509 10592 rpcz_store.cc:276] 0709 13:16:48.971094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.971297 (+   203us) service_pool.cc:224] Handling call
0709 13:16:49.000786 (+ 29489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.723238 (+722452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.201928 (+478690us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540016ab54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:50.202082 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593777536}
I20260709 13:16:50.160573 10735 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:50.164878 10736 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:50.165170 14299 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:50.165473 14304 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:16:50.166142 14113 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.166888 14204 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.162429 14147 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.168169 14325 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:50.169458 14162 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.169574 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.170879 13547 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.171118 13959 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.171450 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.230829 10738 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:50.171842 14064 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:50.172384 14292 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:16:50.172833 14234 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:50.173652 14313 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:50.176090 14026 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:50.176826 14169 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:50.180183 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.221719 14176 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.259992 14176 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.262156 14176 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.262838 14169 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.183084 14071 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:50.189082 13973 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.265808 10734 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:16:50.189903 14306 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:16:50.192309 14232 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.195959 14293 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.198716 10664 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:50.251992 14026 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:50.267464 14026 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.267637 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2219) took 1657 ms. Trace:
I20260709 13:16:50.268033 10664 rpcz_store.cc:276] 0709 13:16:48.610046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.198224 (+1588178us) service_pool.cc:224] Handling call
0709 13:16:50.198516 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.267386 (+ 68870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.267584 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.268563 14232 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.268692 14293 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.199918 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 408) took 1633 ms. Trace:
W20260709 13:16:50.200469 14309 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:16:50.102021 14212 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.164122 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:50.210175 14211 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.001s
I20260709 13:16:50.272207 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1496) took 1524 ms. Trace:
I20260709 13:16:50.224092 10665 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
W20260709 13:16:50.224645 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 348088us
I20260709 13:16:50.240195 10662 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.276466 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2221) took 1665 ms. Trace:
I20260709 13:16:50.276782 10662 rpcz_store.cc:276] 0709 13:16:48.610593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.239716 (+1629123us) service_pool.cc:224] Handling call
0709 13:16:50.240021 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.276236 (+ 36215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.276417 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.241861 14018 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.250626 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2026) took 1853 ms. Trace:
W20260709 13:16:50.251360 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 380739us
I20260709 13:16:50.222541 14147 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.287315 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:50.255540 10706 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:50.287933 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:50.182104 14305 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.230396 14325 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.223661 14295 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.259541 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1491) took 1513 ms. Trace:
I20260709 13:16:50.269203 10664 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.272998 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2211) took 1665 ms. Trace:
I20260709 13:16:50.295543 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 410) took 1228 ms. Trace:
I20260709 13:16:50.279210 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.280566 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:50.278096 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.296753 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:50.289072 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.289016 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.295665 10736 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:50.294817 10666 rpcz_store.cc:276] 0709 13:16:48.607754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.566930 (+959176us) service_pool.cc:224] Handling call
0709 13:16:49.587219 (+ 20289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.587480 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.587516 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.596851 (+  9335us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.052718 (+455867us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:50.146303 (+ 93585us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.146757 (+   454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.146893 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.272775 (+125882us) raft_consensus.cc:1685] finished
0709 13:16:50.272794 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.272932 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34570,"prepare.queue_time_us":100405,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":123,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":50867,"thread_start_us":414620,"threads_started":1,"wal-append.queue_time_us":634466}
W20260709 13:16:50.283182 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 119057us
I20260709 13:16:50.299860 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:50.269488 10669 rpcz_store.cc:276] 0709 13:16:48.566710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.443801 (+877091us) service_pool.cc:224] Handling call
0709 13:16:49.444094 (+   293us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:49.462390 (+ 18296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.462433 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:49.463141 (+   708us) log.cc:844] Serialized 78 byte log entry
0709 13:16:49.973520 (+510379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:50.006594 (+ 33074us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.006780 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.006845 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.199693 (+192848us) raft_consensus.cc:1685] finished
0709 13:16:50.199715 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.199856 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16911,"prepare.queue_time_us":33271,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1926,"raft.queue_time_us":18443,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":84161,"thread_start_us":384972,"threads_started":1,"wal-append.queue_time_us":623795}
I20260709 13:16:50.300608 11412 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:50.292930 10742 rpcz_store.cc:276] 0709 13:16:48.746030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.210899 (+464869us) service_pool.cc:224] Handling call
0709 13:16:49.212419 (+  1520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.215941 (+  3522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.215988 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.216521 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.598077 (+381556us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:49.603359 (+  5282us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.626142 (+ 22783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.626213 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.259362 (+633149us) raft_consensus.cc:1685] finished
0709 13:16:50.259381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.259490 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50374,"prepare.queue_time_us":4843,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":36998,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":8805,"thread_start_us":381200,"threads_started":1,"wal-append.queue_time_us":795233}
I20260709 13:16:50.300643 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2233) took 1675 ms. Trace:
I20260709 13:16:50.303421 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.303489 10664 rpcz_store.cc:276] 0709 13:16:48.625713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.268743 (+1643030us) service_pool.cc:224] Handling call
0709 13:16:50.269025 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.300428 (+ 31403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.300598 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.300858 10666 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:50.305204 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2234) took 1599 ms. Trace:
I20260709 13:16:50.305282 10664 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:50.305784 10666 rpcz_store.cc:276] 0709 13:16:48.705386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.300360 (+1594974us) service_pool.cc:224] Handling call
0709 13:16:50.300606 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.304942 (+  4336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.305145 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.306339 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2236) took 1600 ms. Trace:
I20260709 13:16:50.306862 10664 rpcz_store.cc:276] 0709 13:16:48.706217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.304693 (+1598476us) service_pool.cc:224] Handling call
0709 13:16:50.305013 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.306043 (+  1030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.306278 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.307906 10666 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:50.308941 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2237) took 1602 ms. Trace:
I20260709 13:16:50.309384 10666 rpcz_store.cc:276] 0709 13:16:48.706560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.307225 (+1600665us) service_pool.cc:224] Handling call
0709 13:16:50.307646 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.308411 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.308881 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.310889 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 410) took 1604 ms. Trace:
I20260709 13:16:50.311252 10666 rpcz_store.cc:276] 0709 13:16:48.706830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.310221 (+1603391us) service_pool.cc:224] Handling call
0709 13:16:50.310461 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.310617 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.310641 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.310678 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:50.310716 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.310762 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.310846 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.298305 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.284045 10740 rpcz_store.cc:276] 0709 13:16:48.397696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.397930 (+   234us) service_pool.cc:224] Handling call
0709 13:16:48.403645 (+  5715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.403833 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:48.404127 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.783330 (+1379203us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800458440. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a 00007f42572c3a2a
0709 13:16:50.250182 (+466852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.250323 (+   141us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:50.250397 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.250460 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.250566 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24133,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":12998,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":10341248,"thread_start_us":458295,"threads_started":1}
I20260709 13:16:50.273825 10739 rpcz_store.cc:276] 0709 13:16:48.747366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.211102 (+463736us) service_pool.cc:224] Handling call
0709 13:16:49.213580 (+  2478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.258947 (+ 45367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.258991 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.321804 (+ 62813us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.732366 (+410562us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:49.766553 (+ 34187us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.766756 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.766830 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.272020 (+505190us) raft_consensus.cc:1685] finished
0709 13:16:50.272041 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.272151 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19526,"prepare.queue_time_us":42401,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":328586,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14590,"thread_start_us":408343,"threads_started":1,"wal-append.queue_time_us":571850}
I20260709 13:16:50.299600 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.318948 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.319850 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.289779 14160 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.322677 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:50.325042 10742 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:50.334549 10742 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:50.336712 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 449284us
I20260709 13:16:50.337044 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.282061 14018 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.342057 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:50.296066 10591 rpcz_store.cc:276] 0709 13:16:49.067472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.192484 (+125012us) service_pool.cc:224] Handling call
0709 13:16:49.192894 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.193406 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:49.597998 (+404592us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.294506 (+696508us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.295159 (+   653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.295216 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:50.295274 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.295343 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.295470 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":666321,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":274422,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":16284,"thread_start_us":1085697,"threads_started":3,"wal-append.queue_time_us":631843}
I20260709 13:16:50.338734 10669 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:50.292850 14291 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.316679 14295 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.337615 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.346374 14291 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.347949 14295 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:50.334234 14113 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:50.339855 14122 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:50.352007 14169 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.299070 14162 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:50.345700 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2239) took 1410 ms. Trace:
I20260709 13:16:50.357525 10669 rpcz_store.cc:276] 0709 13:16:48.935669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.332676 (+1397007us) service_pool.cc:224] Handling call
0709 13:16:50.334456 (+  1780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.345419 (+ 10963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.345641 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.317849 14302 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.291347 14319 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:16:50.380832 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:50.382601 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45044.3us
I20260709 13:16:50.386382 10559 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.383769 10669 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:50.334100 14204 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.290235 14211 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.388459 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1961) took 1137 ms. Trace:
I20260709 13:16:50.402158 10669 rpcz_store.cc:276] 0709 13:16:49.250819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.382682 (+1131863us) service_pool.cc:224] Handling call
0709 13:16:50.383405 (+   723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.387928 (+  4523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.388371 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.393417 11412 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:16:50.298944 14064 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:16:50.396225 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.397677 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.398226 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.415256 10737 raft_consensus.cc:2410] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:50.316622 14071 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:16:50.399794 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.400851 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:50.399160 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.354614 14232 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.418390 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:50.383131 14295 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:50.420475 14325 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:50.399271 14162 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.422457 14162 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.425439 14018 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.426769 14018 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.373345 14176 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:16:50.429903 14172 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.002s
I20260709 13:16:50.430608 14211 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.430931 14296 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:50.431891 14066 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:50.433928 13973 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.434690 14333 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:50.381260 14192 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:16:50.435642 14333 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:50.436128 14333 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:50.437402 14305 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.437804 14305 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:50.438153 14305 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.438966 14071 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:50.439203 14295 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:50.439363 14071 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.439608 14295 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.440187 14071 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.440366 14295 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:50.434811 14301 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:16:50.437078 13959 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:50.441301 14071 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.398481 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:50.441447 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46643.2us
I20260709 13:16:50.339690 13888 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:16:50.419554 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.456815 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.387511 14291 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.430296 14172 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.442607 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:50.450023 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.050s
W20260709 13:16:50.493502 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.008s	sys 0.051s
I20260709 13:16:50.444933 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.458282 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.447757 10591 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:50.458343 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:50.460539 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1943) took 1913 ms. Trace:
W20260709 13:16:50.475863 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 431362us
I20260709 13:16:50.399930 13547 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:50.466065 14167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.030s
W20260709 13:16:50.499473 14167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.030s
W20260709 13:16:50.502004 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.496884 10663 rpcz_store.cc:276] 0709 13:16:48.547279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.427943 (+880664us) service_pool.cc:224] Handling call
0709 13:16:49.428223 (+   280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:49.461376 (+ 33153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.461423 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.462099 (+   676us) log.cc:844] Serialized 52 byte log entry
0709 13:16:50.036474 (+574375us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.083835 (+ 47361us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.175800 (+ 91965us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4800160158. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:16:50.459773 (+283973us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.460195 (+   422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.460267 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.460358 (+    91us) raft_consensus.cc:1685] finished
0709 13:16:50.460371 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.460482 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8111,"prepare.queue_time_us":48358,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":48178,"raft.run_cpu_time_us":7855,"raft.run_wall_time_us":712651,"spinlock_wait_cycles":42315008,"thread_start_us":827282,"threads_started":2,"wal-append.queue_time_us":691561}
I20260709 13:16:50.507754 10591 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:16:50.508486 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50268.6us
I20260709 13:16:50.510955 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.512252 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.514659 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:50.463858 14108 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.010s	sys 0.021s
I20260709 13:16:50.454769 14295 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.441576 14234 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.389394 14122 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:16:50.441601 14151 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.521080 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1962) took 1270 ms. Trace:
I20260709 13:16:50.387418 14088 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:50.519560 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 74716.2us
I20260709 13:16:50.442704 13934 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:16:50.459309 14232 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:50.564026 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45055.1us
I20260709 13:16:50.566077 10663 rpcz_store.cc:276] 0709 13:16:49.251082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.520156 (+1269074us) service_pool.cc:224] Handling call
0709 13:16:50.520493 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.520710 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.520745 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.520797 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:50.520841 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.520904 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.521016 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.583041 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 411) took 1289 ms. Trace:
I20260709 13:16:50.583424 10663 rpcz_store.cc:276] 0709 13:16:49.293620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.582272 (+1288652us) service_pool.cc:224] Handling call
0709 13:16:50.582528 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.582687 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.582717 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.582761 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:50.582795 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.582857 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.582981 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.584923 10663 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:50.586319 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.587452 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.519904 14337 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:50.588267 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.011s
I20260709 13:16:50.530675 14234 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:50.489593 14067 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:50.584149 14315 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:50.601677 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.028s
W20260709 13:16:50.602278 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.004s	sys 0.028s
W20260709 13:16:50.523960 14108 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.010s	sys 0.021s
I20260709 13:16:50.574259 10669 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:50.603725 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1963) took 1352 ms. Trace:
I20260709 13:16:50.604059 10669 rpcz_store.cc:276] 0709 13:16:49.251331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.519068 (+1267737us) service_pool.cc:224] Handling call
0709 13:16:50.573859 (+ 54791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.603492 (+ 29633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.603675 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.517350 14204 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.519604 14113 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.436955 14333 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.532465 10661 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:50.567941 14177 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.588646 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 412) took 1294 ms. Trace:
I20260709 13:16:50.531035 14327 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:50.591646 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 288300us
I20260709 13:16:50.532025 13547 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:50.568917 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.566325 14151 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:50.593962 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.457952 14064 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:50.718748 10669 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:50.522210 14291 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:16:50.603325 14108 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.585341 13888 consensus_queue.cc:1243] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:16:50.588625 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.003s	sys 0.011s
I20260709 13:16:50.531061 14211 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:50.607738 10666 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.736253 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1964) took 1174 ms. Trace:
I20260709 13:16:50.736755 10666 rpcz_store.cc:276] 0709 13:16:49.562200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.607257 (+1045057us) service_pool.cc:224] Handling call
0709 13:16:50.607544 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.735953 (+128409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.736188 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.614145 10663 rpcz_store.cc:276] 0709 13:16:49.293942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.584394 (+1290452us) service_pool.cc:224] Handling call
0709 13:16:50.584636 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.585279 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.587932 (+  2653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.590444 14337 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.594599 14234 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:50.619664 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 50821.7us
I20260709 13:16:50.601573 13959 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:50.719563 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 96140.3us
I20260709 13:16:50.793303 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.722342 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 414) took 1076 ms. Trace:
I20260709 13:16:50.794391 10669 rpcz_store.cc:276] 0709 13:16:49.646090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.604841 (+958751us) service_pool.cc:224] Handling call
0709 13:16:50.620487 (+ 15646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.722099 (+101612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.722290 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.613600 14177 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:50.731807 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.718305 14151 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.754094 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.754030 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.743785 14337 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:50.747753 14323 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:16:50.769447 14334 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:50.758772 14172 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.759262 13547 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.814800 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:50.815636 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:50.602689 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 730765us
I20260709 13:16:50.817855 10741 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:50.817838 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:50.819890 10557 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:50.768991 14026 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.000s
I20260709 13:16:50.722312 14332 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.798297 10666 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:50.834096 10736 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.834261 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2240) took 1095 ms. Trace:
I20260709 13:16:50.834622 10666 rpcz_store.cc:276] 0709 13:16:49.739310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.737789 (+998479us) service_pool.cc:224] Handling call
0709 13:16:50.791316 (+ 53527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.834027 (+ 42711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.834207 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:50.835035 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:50.729600 14338 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:50.768831 14305 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.804440 10663 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:50.805430 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51408.9us
I20260709 13:16:50.848942 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:50.850028 14336 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:50.850378 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.850410 14336 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:50.851788 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:50.807235 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53275.1us
I20260709 13:16:50.853013 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.808899 14212 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.809302 14329 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:50.834411 14227 consensus_meta.cc:287] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:16:50.812315 14293 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.812748 14343 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.813462 14297 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.813865 14192 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:50.814018 13934 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.876151 14192 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.814597 10740 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:50.876960 10740 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.821584 10669 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:50.877921 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2244) took 1047 ms. Trace:
I20260709 13:16:50.878367 14192 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:50.878917 10740 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.879416 14151 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.879918 10740 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.816764 14108 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.818256 10741 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:50.881829 10741 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.791447 14326 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:50.882876 10741 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.856338 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:50.857101 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.854027 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.883936 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:50.884123 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.884918 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.816612 14337 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:50.834574 14147 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.001s
I20260709 13:16:50.885475 10737 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:50.885833 10666 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:50.885671 14147 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.886811 14337 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.803160 14177 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.888351 14147 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.829986 13648 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.813479 14018 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:50.893631 14297 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:50.894173 14297 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.897945 14345 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:16:50.899003 14345 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:50.899326 14345 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:50.900174 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2242) took 1134 ms. Trace:
I20260709 13:16:50.900142 14345 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.900637 10663 rpcz_store.cc:276] 0709 13:16:49.765965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.738097 (+972132us) service_pool.cc:224] Handling call
0709 13:16:50.738505 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.848157 (+109652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.899962 (+ 51805us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b540012fa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:50.900124 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150742912}
I20260709 13:16:50.904732 10743 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:50.886924 10588 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:50.868386 14227 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.861123 14162 raft_consensus.cc:2764] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:16:50.851806 14336 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.878234 10669 rpcz_store.cc:276] 0709 13:16:49.830312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.795307 (+964995us) service_pool.cc:224] Handling call
0709 13:16:50.821215 (+ 25908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.877687 (+ 56472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.877870 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:50.905014 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48001.2us
W20260709 13:16:50.920423 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 100621us
I20260709 13:16:50.922098 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:50.875622 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:50.905668 10663 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:50.882704 14326 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.861709 14332 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:50.863304 14341 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.902545 14305 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:50.846971 14026 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.861546 14203 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:50.929580 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.859273 14289 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:16:50.929055 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:50.935406 10662 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:16:50.940598 10735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.038s	sys 0.043s
W20260709 13:16:50.960445 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.039s	sys 0.044s
I20260709 13:16:50.959362 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:50.963362 11412 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:50.919937 14295 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.925518 14345 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.970892 11409 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:50.971099 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118187us
I20260709 13:16:50.925221 14147 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.973383 10559 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:50.975857 11415 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:50.928610 14350 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.930192 14192 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.893647 14018 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.925770 14151 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:50.998282 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69329.4us
I20260709 13:16:50.999001 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:50.990235 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.000488 11414 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:50.934826 13973 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.001600 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:50.868789 14329 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.927891 14327 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:50.858551 14338 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:50.926954 14339 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.995282 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:50.932233 14088 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:50.970435 14295 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:50.970506 14366 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.992388 10741 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:16:50.966252 14203 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:50.972294 14177 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.042173 10592 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:51.014882 14344 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.261s	user 0.006s	sys 0.004s
I20260709 13:16:51.043232 10587 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:51.055138 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.003572 14341 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:51.045573 10741 pending_rounds.cc:85] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 6
I20260709 13:16:51.009971 14321 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:51.053048 14351 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:16:51.014086 14329 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.014987 14018 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:51.012125 14293 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:51.058066 10741 pending_rounds.cc:107] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:51.080425 10741 raft_consensus.cc:2889] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.081676 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.082697 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.058698 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.059614 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.045068 14295 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.045383 14366 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:51.048230 14368 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:51.087581 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.078262 14204 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.090222 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.096195 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:51.096750 10587 raft_consensus.cc:606] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:51.097080 10587 raft_consensus.cc:614] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:51.010264 13973 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.057683 14341 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.046931 14212 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:51.057422 14234 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.015823 14327 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.100193 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.045823 14192 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:16:51.015959 14332 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.086581 14371 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.034904 14339 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.092057 14366 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.113049 11409 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:51.091856 14368 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:51.144340 14368 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.150758 14339 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:51.152743 14029 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:51.153463 14360 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:51.118319 14371 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.104712 14227 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.154636 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2238) took 2447 ms. Trace:
I20260709 13:16:51.155344 14371 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:51.157387 14352 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:16:51.159381 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1955) took 2513 ms. Trace:
I20260709 13:16:51.159806 10665 rpcz_store.cc:276] 0709 13:16:48.645783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.274225 (+1628442us) service_pool.cc:224] Handling call
0709 13:16:50.274521 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.274722 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.274745 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.275148 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.521930 (+246782us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.586891 (+ 64961us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.592374 (+  5483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.592466 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.159152 (+566686us) raft_consensus.cc:1685] finished
0709 13:16:51.159177 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.159318 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46529,"prepare.queue_time_us":64802,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7333,"raft.run_wall_time_us":5196,"spinlock_wait_cycles":17355648,"thread_start_us":172346,"threads_started":1,"wal-append.queue_time_us":578390}
I20260709 13:16:51.161517 13738 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.161966 13738 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.089123 14088 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:16:51.107101 14341 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.169663 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.170348 10737 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.133028 14297 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.175251 14297 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.178649 14368 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.133430 14177 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.134395 14338 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:51.135097 14370 log.cc:927] Time spent T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:16:51.136425 14071 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.693s	user 0.003s	sys 0.005s
I20260709 13:16:51.136806 14293 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.138701 14234 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.140893 14326 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:51.141553 14113 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:16:51.182129 10734 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:51.131337 13973 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.187732 11413 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:51.216845 10742 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:51.155001 10664 rpcz_store.cc:276] 0709 13:16:48.706830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.307749 (+1600919us) service_pool.cc:224] Handling call
0709 13:16:50.308118 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:50.308607 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.308646 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:50.335515 (+ 26869us) log.cc:844] Serialized 52 byte log entry
0709 13:16:50.721829 (+386314us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:50.721882 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.721965 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.154423 (+432458us) raft_consensus.cc:1685] finished
0709 13:16:51.154442 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.154580 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2675,"raft.queue_time_us":7992,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":7820,"thread_start_us":234844,"threads_started":1,"wal-append.queue_time_us":531167}
I20260709 13:16:51.207556 14295 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.226730 14203 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.227406 13738 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.227632 14088 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:51.228026 14088 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:51.228292 14026 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.228745 14088 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.229974 14088 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:51.229980 14369 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.236979 14369 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.238942 14369 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.228292 14295 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.243254 14368 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.191016 14211 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.334304 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 361049us
W20260709 13:16:51.336004 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.336163 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 742192us
W20260709 13:16:51.336539 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.337096 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:51.207010 14339 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.206804 13959 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:51.208633 14172 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.218559 14113 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.360888 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.338557 14064 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.363751 10737 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:51.365828 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.366403 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.366957 10663 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.367123 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.367718 10665 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.348193 14295 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.215011 14336 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.373545 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.335441 14340 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.377408 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.389686 10667 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:51.390204 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 475) took 1098 ms. Trace:
I20260709 13:16:51.338828 14363 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:51.367960 14305 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.353585 14339 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:51.389575 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1960) took 2139 ms (client timeout 1939 ms). Trace:
I20260709 13:16:51.390595 10738 rpcz_store.cc:276] 0709 13:16:50.291370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.293866 (+  2496us) service_pool.cc:224] Handling call
0709 13:16:50.330744 (+ 36878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.380788 (+1050044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.380818 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.380855 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:51.380883 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.389993 (+  9110us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540036ddd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:51.390031 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.390151 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414455168}
I20260709 13:16:51.389376 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.341019 14211 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.361933 14177 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.385962 10669 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:51.375470 10665 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
W20260709 13:16:51.395556 10661 rpcz_store.cc:269] 0709 13:16:49.250592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.382591 (+131999us) service_pool.cc:224] Handling call
0709 13:16:51.389391 (+2006800us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002da854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:51.389513 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615720320}
I20260709 13:16:51.378509 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:16:51.355422 14332 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:51.373481 14071 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:16:51.422086 10489 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 8, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:16:51.422969 10490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 204) took 28878 ms (client timeout 15000 ms). Trace:
I20260709 13:16:51.423789 10489 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 6, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.425298 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 420) took 1083 ms. Trace:
I20260709 13:16:51.396535 14305 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.425709 10588 rpcz_store.cc:276] 0709 13:16:50.341614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.341774 (+   160us) service_pool.cc:224] Handling call
0709 13:16:51.425129 (+1083355us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54003ffcd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:51.425249 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251138816}
I20260709 13:16:51.425138 10489 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 3 to 6, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:51.426802 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:51.426936 10489 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 4 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.427814 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:51.428829 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:51.436162 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:51.437412 10739 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.438426 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2216) took 2829 ms. Trace:
I20260709 13:16:51.438796 10668 rpcz_store.cc:276] 0709 13:16:48.609189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.162147 (+1552958us) service_pool.cc:224] Handling call
0709 13:16:50.239538 (+ 77391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.250273 (+ 10735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.250316 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.250831 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.584414 (+333583us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.926327 (+341913us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.332433 (+406106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.332512 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.332552 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:51.332563 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.438280 (+105717us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54002300d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:51.438376 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432364,"prepare.queue_time_us":19628,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":416510,"raft.run_cpu_time_us":637,"raft.run_wall_time_us":25883,"spinlock_wait_cycles":177092480,"thread_start_us":652739,"threads_started":2,"wal-append.queue_time_us":533515}
I20260709 13:16:51.353485 13959 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.440456 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.441368 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1956) took 2779 ms. Trace:
I20260709 13:16:51.441721 10662 rpcz_store.cc:276] 0709 13:16:48.662415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.277605 (+1615190us) service_pool.cc:224] Handling call
0709 13:16:50.277875 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.960242 (+682367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.441140 (+480898us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400322b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:51.441301 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511549696}
I20260709 13:16:51.442239 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.442831 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.429065 10489 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.443351 10662 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:51.444422 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.355612 14203 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:51.379976 14074 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.354233 14172 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.401021 10741 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.446007 10664 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:51.445185 14074 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.447474 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.448170 10664 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:51.365388 14113 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.450014 14113 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.385701 14061 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.386855 14295 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.469657 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.471251 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.471786 10661 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.411577 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.414490 14247 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.415091 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.473433 11415 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
W20260709 13:16:51.415426 11413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 436) took 1783 ms (client timeout 1503 ms). Trace:
W20260709 13:16:51.474050 11413 rpcz_store.cc:269] 0709 13:16:49.632382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.632489 (+   107us) service_pool.cc:224] Handling call
0709 13:16:51.415258 (+1782769us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540059f454. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:51.415357 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3417769856}
I20260709 13:16:51.474543 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2086) took 1707 ms. Trace:
W20260709 13:16:51.415933 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.478108 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 415) took 1652 ms. Trace:
I20260709 13:16:51.386547 14212 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:16:51.419667 11381 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:51.421048 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.396262 14340 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.494508 14340 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.506496 14340 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.507145 14340 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.509856 14340 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.386620 14366 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.368091 14162 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.380477 14018 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:51.455353 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.520174 10662 raft_consensus.cc:2376] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11. Re-sending same reply.
I20260709 13:16:51.520294 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.459007 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:51.521032 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 120500us
I20260709 13:16:51.521328 10665 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:51.522083 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.522204 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:51.522634 10665 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:51.461585 10588 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:16:51.523387 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.524317 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.465126 10741 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:16:51.468653 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.411567 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:51.417733 10632 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:51.526253 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:51.526794 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 109139us
I20260709 13:16:51.527005 10665 raft_consensus.cc:2376] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9. Re-sending same reply.
I20260709 13:16:51.527670 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:51.475035 10585 rpcz_store.cc:276] 0709 13:16:49.767099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.767230 (+   131us) service_pool.cc:224] Handling call
0709 13:16:49.767553 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.767765 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:50.223066 (+455301us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.429642 (+1206576us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b180019be20. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf 00007f42572d3038
0709 13:16:51.429819 (+   177us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.474197 (+ 44378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.474257 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:51.474308 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.474385 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.474490 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60844,"prepare.queue_time_us":958141,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2499,"raft.queue_time_us":13832,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":111694,"spinlock_wait_cycles":6994304,"thread_start_us":798237,"threads_started":2,"wal-append.queue_time_us":581946}
I20260709 13:16:51.528076 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.473774 14061 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.478526 13786 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.486330 14295 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.487008 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.491695 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.492796 10661 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:51.423368 10490 rpcz_store.cc:269] 0709 13:16:22.544966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.545131 (+   165us) service_pool.cc:224] Handling call
0709 13:16:22.695734 (+150603us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:16:51.422889 (+28727155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:43.048704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:43.049369 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:43.049415 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:16:43.049447 (+    32us) tablet.cc:662] Decoding operations
0709 13:16:43.295511 (+246064us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:43.305942 (+ 10431us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:43.310595 (+  4653us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:16:43.414487 (+103892us) tablet.cc:701] Row locks acquired
0709 13:16:43.414531 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:16:43.414712 (+   181us) write_op.cc:270] Start()
0709 13:16:43.414855 (+   143us) write_op.cc:276] Timestamp: P: 1783603003414634 usec, L: 0
0709 13:16:43.414877 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:43.415893 (+  1016us) log.cc:844] Serialized 12616 byte log entry
0709 13:16:43.885812 (+469919us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.072521 (+186709us) write_op.cc:301] APPLY: starting
0709 13:16:44.072627 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.073236 (+   609us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.073377 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:44.098304 (+ 24927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:44.098747 (+   443us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=31
0709 13:16:44.098793 (+    46us) write_op.cc:312] APPLY: finished
0709 13:16:44.099301 (+   508us) log.cc:844] Serialized 206 byte log entry
0709 13:16:44.099482 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.099729 (+   247us) write_op.cc:454] Released schema lock
0709 13:16:44.099807 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:44.100235 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.100265 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3473332,"reported_tablets":49,"spinlock_wait_cycles":11045760,"child_traces":[["op",{"apply.queue_time_us":173977,"apply.run_cpu_time_us":6388,"apply.run_wall_time_us":30877,"num_ops":31,"prepare.queue_time_us":93602,"prepare.run_cpu_time_us":49696,"prepare.run_wall_time_us":567392,"raft.queue_time_us":177547,"raft.run_cpu_time_us":45042,"raft.run_wall_time_us":119313,"replication_time_us":461505,"thread_start_us":331684,"threads_started":4,"wal-append.queue_time_us":165546,"wal-append.run_cpu_time_us":32876,"wal-append.run_wall_time_us":1518602}]]}
W20260709 13:16:51.516655 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 97057.5us
I20260709 13:16:51.536727 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:51.443958 10489 catalog_manager.cc:5697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.516753 13648 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.537745 13648 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.538116 13648 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.402968 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.405746 14369 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.541898 10663 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:51.542829 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.545243 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.546221 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:51.543390 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51818.3us
I20260709 13:16:51.480571 14151 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.533752 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.534384 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.544359 10632 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:16:51.530107 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:51.548498 13648 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.479434 14247 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:51.601913 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78341.3us
W20260709 13:16:51.602130 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 181134us
I20260709 13:16:51.602962 10559 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:51.583704 10489 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 6, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 6 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.587553 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.604460 10585 raft_consensus.cc:2393] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 6: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:51.587944 10632 leader_election.cc:403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.587733 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.605047 10663 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.584219 10669 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:51.534931 14026 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.600754 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.600868 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.609299 10662 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:51.497135 14341 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.610323 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.620288 13648 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.616931 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.617525 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.618914 10585 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.621419 10662 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:51.555600 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:51.582739 14358 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:51.549762 14371 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:51.622566 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 78346.8us
I20260709 13:16:51.542912 14177 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:51.619819 10663 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:51.625834 10590 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:51.583863 14295 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.648890 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.636246 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:51.624697 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 69191.2us
I20260709 13:16:51.618036 14365 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.637251 10665 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:51.648499 10590 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:51.539454 14376 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:16:51.642547 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.645651 10743 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.549939 14338 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:51.613938 14337 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.583006 13781 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:16:51.652843 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.634047 14029 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:16:51.653539 10590 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:51.633916 14192 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:51.651021 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:51.543135 14369 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:51.682092 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:51.653707 10489 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 10 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:51.683362 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.686429 10590 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:51.692646 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 82980us
I20260709 13:16:51.694792 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:51.695055 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 92213.3us
I20260709 13:16:51.696377 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:51.654485 14018 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.699473 10590 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:51.704857 10590 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:51.644797 14212 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:16:51.685977 14162 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.680653 14177 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:51.685700 14369 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.722008 10489 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 8, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 8 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.717527 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.698989 14295 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:51.694613 13547 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:51.702580 13888 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.704573 14332 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:51.726866 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.728313 13648 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:51.703953 14339 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:51.729003 10489 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 1 to 4, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.702889 14371 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:51.688712 14337 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.721683 14297 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.738121 13648 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.742523 13648 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:51.743294 13648 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.697726 14071 consensus_queue.cc:1059] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:51.727980 14061 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.715689 14113 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.741528 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.685492 14321 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:51.751740 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.758379 10489 catalog_manager.cc:5697] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.708549 13998 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:51.733832 14018 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.730182 14295 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:51.778488 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:51.758594 14384 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:16:51.787901 13648 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:51.789158 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 94433.9us
I20260709 13:16:51.792461 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:51.786939 14327 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:51.726843 14162 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.743204 14332 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:51.745371 14192 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:51.798851 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.805373 10661 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:51.794577 10489 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:51.806470 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 102620us
I20260709 13:16:51.775768 14339 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.735136 13547 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.783536 14295 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.810495 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:51.742456 14297 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.809254 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 83949.2us
I20260709 13:16:51.782279 14366 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.809902 10489 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 6, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:51.822207 10489 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 4 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:51.794236 14336 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:51.759480 14396 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.816972 10737 raft_consensus.cc:2410] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:51.809983 13998 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:51.833911 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.834749 10489 catalog_manager.cc:5697] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 7 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.839908 14403 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:51.840425 14403 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.842449 14403 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:51.848237 14390 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:16:51.848464 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.849499 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.849828 14399 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.850461 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.850507 14399 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.851581 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.851696 14399 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:51.852115 10740 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:51.852289 14399 consensus_queue.cc:1243] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:51.852738 14341 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:51.852898 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.853298 14341 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.853631 14341 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:51.853878 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:51.854457 14341 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.854867 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.854988 14337 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.855556 14341 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.855914 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.880992 10740 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:51.881809 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.882290 10740 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:51.882979 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.884629 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.887409 14373 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.887892 14373 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:51.856990 14162 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:51.818341 14371 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.857590 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.892089 10661 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:51.858566 14088 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:16:51.861446 14332 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:51.862607 14388 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:51.862646 13547 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.863065 14336 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.863409 13998 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.805627 14327 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.808765 14177 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.870484 14319 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.871387 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:51.873507 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:51.952713 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.953092 13998 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:51.953903 10669 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.878661 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.878782 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:51.879374 14396 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:51.956704 10662 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:51.888808 14373 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.824074 14297 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:51.905360 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.907099 14365 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.910125 14067 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:51.910883 14369 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:51.918983 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:51.923887 10489 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 8 to 9, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:51.933938 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.072796 10663 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:52.392349 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:52.074091 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 377744us
I20260709 13:16:52.394138 10662 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.394191 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:52.394981 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1973) took 1030 ms. Trace:
I20260709 13:16:52.395478 10662 rpcz_store.cc:276] 0709 13:16:51.364327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.393739 (+1029412us) service_pool.cc:224] Handling call
0709 13:16:52.393976 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.394747 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.394920 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:52.186673 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 376215us
I20260709 13:16:52.396888 10662 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.399609 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2247) took 1020 ms. Trace:
W20260709 13:16:52.210963 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 382055us
W20260709 13:16:52.049222 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 219488us
I20260709 13:16:52.390699 10661 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:52.410871 10661 raft_consensus.cc:1240] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:52.411623 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1977) took 1031 ms. Trace:
I20260709 13:16:52.412021 10661 rpcz_store.cc:276] 0709 13:16:51.379765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.410364 (+1030599us) service_pool.cc:224] Handling call
0709 13:16:52.410667 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.411372 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.411564 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:52.413909 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2250) took 1033 ms. Trace:
I20260709 13:16:52.091797 10668 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:52.447921 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1985) took 1038 ms. Trace:
I20260709 13:16:52.448665 10668 rpcz_store.cc:276] 0709 13:16:51.409891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.918700 (+508809us) service_pool.cc:224] Handling call
0709 13:16:52.447803 (+529103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:52.424692 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:52.437006 10662 rpcz_store.cc:276] 0709 13:16:51.378872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.396446 (+1017574us) service_pool.cc:224] Handling call
0709 13:16:52.396688 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.399358 (+  2670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.399552 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:52.446929 10661 rpcz_store.cc:276] 0709 13:16:51.380388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.412976 (+1032588us) service_pool.cc:224] Handling call
0709 13:16:52.413275 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.413530 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.413566 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.413620 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.413668 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.413734 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.413852 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:52.477026 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 82897.5us
I20260709 13:16:52.478207 10559 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:52.089768 14067 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:52.092783 14373 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.963586 14319 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:51.964100 14327 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:52.510490 14336 consensus_meta.cc:287] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.003s
I20260709 13:16:52.520660 14336 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.510525 14088 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:52.521711 14088 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:52.522881 14088 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.506268 14067 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:52.511937 14295 consensus_meta.cc:287] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.001s
I20260709 13:16:52.526108 14295 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.397688 14337 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.527617 14337 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.515944 14369 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:52.529942 14337 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:52.530537 14337 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.517757 14391 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.554s	user 0.001s	sys 0.000s
I20260709 13:16:52.531000 14337 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:52.518528 14401 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.550s	user 0.000s	sys 0.001s
I20260709 13:16:52.505998 14365 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:52.519094 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1529) took 1018 ms. Trace:
I20260709 13:16:52.526261 14067 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.511684 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:52.545589 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2104) took 1491 ms. Trace:
I20260709 13:16:52.546195 10585 rpcz_store.cc:276] 0709 13:16:51.053925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.621836 (+567911us) service_pool.cc:224] Handling call
0709 13:16:51.622107 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.695904 (+ 73797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.695949 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.696506 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.779347 (+ 82841us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:51.780088 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.780176 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.545299 (+765123us) raft_consensus.cc:1685] finished
0709 13:16:52.545342 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.545520 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73418,"raft.queue_time_us":75223,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5596,"thread_start_us":47821,"threads_started":1,"wal-append.queue_time_us":98386}
I20260709 13:16:52.547531 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:52.535431 10668 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:52.542986 10737 rpcz_store.cc:276] 0709 13:16:51.500673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.494095 (+993422us) service_pool.cc:224] Handling call
0709 13:16:52.518454 (+ 24359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.518684 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.518721 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.518777 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:52.518824 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.518895 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.519027 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.967393 14396 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.071560 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2055) took 1256 ms. Trace:
I20260709 13:16:52.559291 10742 rpcz_store.cc:276] 0709 13:16:50.814961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.815429 (+   468us) service_pool.cc:224] Handling call
0709 13:16:52.071311 (+1255882us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540014c154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:52.071481 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907958144}
I20260709 13:16:52.092216 10489 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 7, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:52.562796 10489 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 8, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.595880 10735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.021s	sys 0.030s
W20260709 13:16:52.596365 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.021s	sys 0.030s
I20260709 13:16:52.598673 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.600311 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.601704 10585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:52.602823 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.564736 10489 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 4 to 5, term changed from 8 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to <none>, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:16:52.608006 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 183425us
I20260709 13:16:52.609836 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:52.367679 14363 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:52.613616 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 120935us
I20260709 13:16:52.615092 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.615864 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 491) took 1097 ms. Trace:
I20260709 13:16:52.616433 10737 rpcz_store.cc:276] 0709 13:16:51.518941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.556622 (+1037681us) service_pool.cc:224] Handling call
0709 13:16:52.615078 (+ 58456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.615270 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.615309 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.615365 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:52.615417 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.615558 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.615751 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:52.570888 14371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.003s	sys 0.023s
W20260709 13:16:52.561441 14226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.008s	sys 0.024s
I20260709 13:16:52.346266 14232 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:52.017194 14192 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.622769 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.633524 10587 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:52.599190 14369 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.556420 14327 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:52.533783 14300 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:16:52.629582 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 238024us
I20260709 13:16:52.633992 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:52.621631 14371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.003s	sys 0.024s
W20260709 13:16:52.627902 14226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.008s	sys 0.024s
I20260709 13:16:52.646214 10737 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.649052 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1535) took 1090 ms. Trace:
I20260709 13:16:52.613237 14363 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:52.650095 10737 rpcz_store.cc:276] 0709 13:16:51.559005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.627573 (+1068568us) service_pool.cc:224] Handling call
0709 13:16:52.646030 (+ 18457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.648553 (+  2523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.648943 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:52.628072 14067 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.653949 10594 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.629038 14397 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:52.644140 14029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.002s	sys 0.032s
W20260709 13:16:52.644659 14204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.007s	sys 0.016s
I20260709 13:16:52.638605 14369 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:52.637836 14321 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:16:52.670333 14369 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.636970 14336 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:16:52.665252 14029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.003s	sys 0.032s
W20260709 13:16:52.664794 14204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.008s	sys 0.016s
I20260709 13:16:52.662185 14371 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.636854 14232 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.665038 14295 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:52.634826 14319 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.674741 14337 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:52.724941 10559 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:52.700333 14353 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.940s	user 0.006s	sys 0.026s
I20260709 13:16:52.675168 14071 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:16:52.739940 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 116508us
I20260709 13:16:52.700742 14029 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.713927 14400 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:52.736516 14405 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:52.746786 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:52.715939 14336 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.715538 14408 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:52.805208 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.700254 14412 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 13:16:52.826227 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 216478us
W20260709 13:16:52.829195 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.833209 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 484) took 1493 ms. Trace:
I20260709 13:16:52.747208 14405 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:52.775902 14420 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:52.715001 14371 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.874015 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:52.875029 10590 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:16:52.861871 10736 rpcz_store.cc:276] 0709 13:16:51.339811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.425638 (+ 85827us) service_pool.cc:224] Handling call
0709 13:16:51.425925 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:51.473916 (+ 47991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.473942 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:51.482454 (+  8512us) log.cc:844] Serialized 52 byte log entry
0709 13:16:51.741777 (+259323us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:51.741814 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.777749 (+1035935us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b540028df54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:52.777824 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.777900 (+    76us) raft_consensus.cc:1685] finished
0709 13:16:52.777920 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.833130 (+ 55210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":583,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5892,"spinlock_wait_cycles":109529984,"thread_start_us":197504,"threads_started":1,"wal-append.queue_time_us":303304}
I20260709 13:16:52.747471 14029 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.883769 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:52.887398 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 419) took 2596 ms. Trace:
I20260709 13:16:52.855664 14235 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.776376 14400 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.868920 14420 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:52.899068 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:52.887811 10589 rpcz_store.cc:276] 0709 13:16:50.282284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.284971 (+  2687us) service_pool.cc:224] Handling call
0709 13:16:50.285296 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.287712 (+  2416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.287740 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.298256 (+ 10516us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.488633 (+190377us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:50.488676 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.488738 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.598280 (+2109542us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:52.870583 (+272303us) raft_consensus.cc:1685] finished
0709 13:16:52.870605 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.878556 (+  7951us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14821,"raft.queue_time_us":37971,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":5982,"spinlock_wait_cycles":34622208,"thread_start_us":136049,"threads_started":1,"wal-append.queue_time_us":387537}
I20260709 13:16:52.873068 14409 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:52.879544 14396 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:52.879861 14321 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.920616 14409 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:52.905795 14333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.912s	user 0.005s	sys 0.048s
W20260709 13:16:52.925007 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56730.2us
I20260709 13:16:52.852102 14408 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.895805 14088 consensus_queue.cc:1059] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:52.936836 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:52.927476 14333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.005s	sys 0.049s
W20260709 13:16:52.934576 14332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.000s	sys 0.008s
I20260709 13:16:52.869820 14422 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:52.945096 14332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.000s	sys 0.008s
I20260709 13:16:52.964941 14430 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:52.965386 14417 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:16:52.965492 14430 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:52.966020 14430 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.966305 14371 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:52.926162 14321 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.968400 14321 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:52.968621 14297 consensus_meta.cc:287] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.656s	user 0.006s	sys 0.002s
W20260709 13:16:52.969940 14406 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:16:52.970760 14408 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:52.953891 14232 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:52.954077 14436 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:52.972106 14400 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:52.972416 14436 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.947671 14420 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.973425 14409 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:52.973910 14420 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.948185 14372 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.190s
I20260709 13:16:52.975493 14332 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:52.948359 14422 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:52.947827 14088 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.966820 14371 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:52.974714 14436 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:52.948745 14333 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:52.975879 14332 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:52.976174 14341 consensus_meta.cc:287] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.080s	user 0.011s	sys 0.000s
I20260709 13:16:52.957502 14415 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:52.969010 14297 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:52.990231 14416 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:16:52.928932 14405 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:52.996212 14422 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:52.996829 14405 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.977834 14371 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:52.994058 14415 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.010365 14415 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:53.043556 10557 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.68:35619 timed out after 1.703s (SENT) [suppressed 14 similar messages]
W20260709 13:16:52.861234 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 114512us
I20260709 13:16:53.055106 14029 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.055343 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:53.056155 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 119339us
W20260709 13:16:52.869774 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 144886us
I20260709 13:16:53.057699 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 496) took 1363 ms. Trace:
I20260709 13:16:53.058204 10737 rpcz_store.cc:276] 0709 13:16:51.694596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.675586 (+980990us) service_pool.cc:224] Handling call
0709 13:16:52.718303 (+ 42717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.718536 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:52.916268 (+197732us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.056831 (+140563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.056961 (+   130us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:53.057094 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.057252 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.057473 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6195,"prepare.queue_time_us":254773,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":5503232,"thread_start_us":302454,"threads_started":2,"wal-append.queue_time_us":87807}
I20260709 13:16:53.045092 10592 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:53.060845 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.065670 10737 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:53.054816 14018 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.066939 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.069085 10737 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:53.070376 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 492) took 1529 ms. Trace:
I20260709 13:16:53.067077 14029 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.982712 14088 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.074721 14332 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.076107 14327 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:53.076411 14088 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.070951 10742 rpcz_store.cc:276] 0709 13:16:51.540426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.560345 (+1019919us) service_pool.cc:224] Handling call
0709 13:16:52.560728 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.804414 (+243686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.804459 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.826029 (+ 21570us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.938635 (+112606us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:52.938684 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.938749 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.069736 (+130987us) raft_consensus.cc:1685] finished
0709 13:16:53.069787 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.070165 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69438,"raft.queue_time_us":138922,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14283,"thread_start_us":209190,"threads_started":2,"wal-append.queue_time_us":107522}
I20260709 13:16:52.987923 14122 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.078595 14122 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.079643 14394 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.080127 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 489) took 1619 ms. Trace:
I20260709 13:16:53.080761 14394 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.070777 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:53.083082 10737 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.985662 14333 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.084591 14371 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:53.087896 10665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2262) took 1703 ms (client timeout 1998 ms). Trace:
I20260709 13:16:53.043556 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 423) took 1683 ms. Trace:
I20260709 13:16:53.078622 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:53.088616 10665 rpcz_store.cc:269] 0709 13:16:51.383860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.546017 (+162157us) service_pool.cc:224] Handling call
0709 13:16:53.087362 (+1541345us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b5400182254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.087629 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208031616}
I20260709 13:16:53.078446 14327 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.105098 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.106670 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:53.097952 10669 rpcz_store.cc:276] 0709 13:16:51.359917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.955439 (+595522us) service_pool.cc:224] Handling call
0709 13:16:51.968839 (+ 13400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.396399 (+427560us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:52.715050 (+318651us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.041548 (+326498us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.042263 (+   715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.042397 (+   134us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:53.042587 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.042754 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.043137 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8615,"prepare.queue_time_us":304130,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":110,"raft.queue_time_us":16612,"raft.run_cpu_time_us":498,"raft.run_wall_time_us":7164,"thread_start_us":539190,"threads_started":2,"wal-append.queue_time_us":257247}
I20260709 13:16:53.114728 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:53.115463 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.115844 10665 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.117434 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:53.122956 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2060) took 2306 ms (client timeout 1807 ms). Trace:
I20260709 13:16:53.123579 14333 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:53.128252 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.129729 14122 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:53.130874 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2066) took 2070 ms (client timeout 1624 ms). Trace:
W20260709 13:16:53.131356 10741 rpcz_store.cc:269] 0709 13:16:51.060182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.082481 (+ 22299us) service_pool.cc:224] Handling call
0709 13:16:53.130372 (+2047891us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54001cc354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.130608 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730531712}
I20260709 13:16:53.132272 14297 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.135597 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2072) took 1997 ms. Trace:
I20260709 13:16:53.136075 10743 rpcz_store.cc:276] 0709 13:16:51.137837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.419503 (+281666us) service_pool.cc:224] Handling call
0709 13:16:51.419792 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.678131 (+258339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.135039 (+1456908us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540036abd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.135380 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518888832}
I20260709 13:16:53.139475 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.140569 10589 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:53.141523 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.145005 13888 raft_consensus.cc:3055] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.145433 13888 raft_consensus.cc:740] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:16:53.123368 10734 rpcz_store.cc:269] 0709 13:16:50.816147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.873751 (+ 57604us) service_pool.cc:224] Handling call
0709 13:16:53.122596 (+2248845us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002bf054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.122776 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595440896}
W20260709 13:16:53.157780 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 102946us
I20260709 13:16:53.161168 13888 consensus_queue.cc:260] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.163141 13888 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.165743 14029 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.080672 10735 rpcz_store.cc:276] 0709 13:16:51.460363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.951411 (+491048us) service_pool.cc:224] Handling call
0709 13:16:51.951726 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.956136 (+  4410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.956163 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.968061 (+ 11898us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.596783 (+628722us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:52.596837 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.596926 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.051190 (+454264us) raft_consensus.cc:1685] finished
0709 13:16:53.079559 (+ 28369us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.079858 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4062,"raft.queue_time_us":4506,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":628326,"threads_started":1,"wal-append.queue_time_us":699115}
I20260709 13:16:53.166580 14029 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.167232 13786 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:53.167824 13786 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:53.174520 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 66311.3us
I20260709 13:16:53.133898 14336 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.182686 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.177656 10735 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:53.180938 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 137733us
I20260709 13:16:53.197922 10743 pending_rounds.cc:85] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 8
I20260709 13:16:53.198310 10743 pending_rounds.cc:107] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:53.198678 10743 raft_consensus.cc:2889] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.202533 10742 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:53.201107 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.193516 14029 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.214010 10585 raft_consensus.cc:606] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:53.203698 13934 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:53.214143 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 324451us
I20260709 13:16:53.215116 13934 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.216975 14057 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.217738 14057 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.219439 14247 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.222618 14029 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.223950 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:53.224853 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49480.3us
I20260709 13:16:53.227310 10734 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
W20260709 13:16:53.228497 14067 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.015s
W20260709 13:16:53.225874 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 99585.8us
I20260709 13:16:53.232034 14088 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.232371 14450 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.232954 14088 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.233309 14450 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.234761 14057 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:53.235178 14450 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.235311 14088 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.242290 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.246498 10665 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:53.247215 10735 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.243808 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.257195 11418 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:53.252441 13934 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.261658 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.272917 14172 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.273011 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:53.274192 11409 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13.
W20260709 13:16:53.276993 14404 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.576s	user 0.000s	sys 0.003s
I20260709 13:16:53.277606 14399 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.279024 14427 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.279249 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.280002 11418 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:53.280690 14399 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.281541 10632 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:16:53.279667 14427 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.283763 14399 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.284664 14427 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:53.284835 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.282135 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:53.290889 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.292517 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1635) took 1416 ms. Trace:
I20260709 13:16:53.295190 10738 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:53.295908 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1972) took 1931 ms (client timeout 2035 ms). Trace:
W20260709 13:16:53.296134 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 136356us
W20260709 13:16:53.296362 10663 rpcz_store.cc:269] 0709 13:16:51.364053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.648670 (+284617us) service_pool.cc:224] Handling call
0709 13:16:53.295530 (+1646860us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400182c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.295740 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973455232}
I20260709 13:16:53.297644 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.292871 10588 rpcz_store.cc:276] 0709 13:16:51.876251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.876390 (+   139us) service_pool.cc:224] Handling call
0709 13:16:51.876715 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.955813 (+ 79098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.955854 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.955906 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:51.955949 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.292131 (+1336182us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54001e37d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.292190 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.292354 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181433088}
I20260709 13:16:53.304656 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.305356 11413 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:16:53.305708 14230 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:16:53.306727 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 415) took 3475 ms. Trace:
I20260709 13:16:53.306298 13786 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.307179 10666 rpcz_store.cc:276] 0709 13:16:49.830846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.835354 (+1004508us) service_pool.cc:224] Handling call
0709 13:16:50.835627 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.886185 (+ 50558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.306203 (+2420018us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b540041f354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.306547 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115001088}
W20260709 13:16:53.307917 14410 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.633s	user 0.000s	sys 0.001s
I20260709 13:16:53.308504 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.309203 13786 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.310104 10665 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:53.310850 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.311033 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:53.311491 11409 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:53.311677 10665 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.309358 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 427) took 2504 ms. Trace:
I20260709 13:16:53.312366 10593 rpcz_store.cc:276] 0709 13:16:50.804771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.810337 (+  5566us) service_pool.cc:224] Handling call
0709 13:16:50.810617 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.050557 (+239940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.050587 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.050627 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:51.050665 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.308913 (+2258248us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54001abdd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.308982 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.309168 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551351552}
I20260709 13:16:53.313820 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:53.316056 13934 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.316872 13934 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.319079 13934 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:53.321173 14369 consensus_meta.cc:287] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.012s
I20260709 13:16:53.321704 14369 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:51.478588 10586 rpcz_store.cc:276] 0709 13:16:49.826165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.839500 (+ 13335us) service_pool.cc:224] Handling call
0709 13:16:49.860434 (+ 20934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.860678 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:50.223510 (+362832us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.432062 (+1208552us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.477718 (+ 45656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.477787 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:51.477853 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.477937 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.478043 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":672524,"prepare.queue_time_us":563852,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":174413,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":29469,"thread_start_us":930414,"threads_started":3,"wal-append.queue_time_us":562291}
I20260709 13:16:53.323726 10665 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:53.324821 10586 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:53.324879 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.326197 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.326318 10586 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:53.327762 10665 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:53.328202 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.330930 10736 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:53.332398 14430 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.334823 14430 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:53.335529 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.335762 14305 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:53.336326 11379 connection.cc:256] RPC call timeout handler was delayed by -1.1649879730000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 13:16:53.336404 14172 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:53.338532 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1978) took 1934 ms. Trace:
I20260709 13:16:53.339197 10593 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.339104 10665 rpcz_store.cc:276] 0709 13:16:51.393570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.327104 (+1933534us) service_pool.cc:224] Handling call
0709 13:16:53.327455 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.328151 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.328316 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.344899 14332 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.346969 14339 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:53.338531 10737 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 6.
I20260709 13:16:53.354653 14425 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.355209 14456 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.355682 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.356470 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.357972 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1982) took 1949 ms. Trace:
W20260709 13:16:53.358793 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56616.6us
I20260709 13:16:53.359442 14363 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.360397 14335 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.360783 14363 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.361035 14335 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:53.362838 14386 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.673s	user 0.015s	sys 0.014s
I20260709 13:16:53.364094 14335 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:53.364944 14204 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:53.355998 14456 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.366255 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:53.367487 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:53.351400 14339 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:53.368659 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1522) took 1917 ms. Trace:
I20260709 13:16:53.369401 14305 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.358389 10666 rpcz_store.cc:276] 0709 13:16:51.409039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.353089 (+1944050us) service_pool.cc:224] Handling call
0709 13:16:53.357227 (+  4138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.357652 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.357679 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.357721 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:53.357752 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.357808 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.357898 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.372584 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:53.375907 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 426) took 2584 ms. Trace:
I20260709 13:16:53.377229 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1628) took 1966 ms. Trace:
I20260709 13:16:53.376291 10591 rpcz_store.cc:276] 0709 13:16:50.791338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.791448 (+   110us) service_pool.cc:224] Handling call
0709 13:16:50.791727 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.805343 (+ 13616us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:51.430480 (+625137us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.622673 (+192193us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.623084 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.623215 (+   131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:51.623252 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.623313 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.361916 (+1738603us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:53.369907 (+  7991us) raft_consensus.cc:1685] finished
0709 13:16:53.374961 (+  5054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.375215 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":722595,"prepare.queue_time_us":626160,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":100464,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":8268160,"thread_start_us":107248,"threads_started":1,"wal-append.queue_time_us":213998}
I20260709 13:16:53.377583 10594 rpcz_store.cc:276] 0709 13:16:51.410649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.685067 (+274418us) service_pool.cc:224] Handling call
0709 13:16:51.685336 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.657798 (+972462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.376817 (+719019us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540008aa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.377072 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227076352}
I20260709 13:16:53.369135 10740 rpcz_store.cc:276] 0709 13:16:51.451289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.883702 (+432413us) service_pool.cc:224] Handling call
0709 13:16:53.127170 (+1243468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.143417 (+ 16247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.143447 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.144083 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.195443 (+ 51360us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:53.195484 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.199861 (+  4377us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.233943 (+ 34082us) raft_consensus.cc:1685] finished
0709 13:16:53.233962 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.368191 (+134229us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002bf050. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.368445 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15314,"raft.queue_time_us":17086,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":2856357632,"thread_start_us":50862,"threads_started":1,"wal-append.queue_time_us":87214}
I20260709 13:16:53.369227 14339 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.372255 14305 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.372182 14420 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:53.371757 14456 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:53.385064 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 87641.1us
I20260709 13:16:53.382308 14172 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.384169 14305 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.393997 14339 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.388759 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.395193 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:53.389540 14172 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.396919 14172 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.397086 14444 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.398228 14420 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.399549 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2096) took 2361 ms. Trace:
I20260709 13:16:53.400264 14420 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.401566 14369 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.402387 14074 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.399906 10592 rpcz_store.cc:276] 0709 13:16:51.037650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.110626 (+ 72976us) service_pool.cc:224] Handling call
0709 13:16:51.110911 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.063518 (+1952607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.399304 (+335786us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b540008b454. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.399498 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4445730048}
I20260709 13:16:53.416982 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.417688 11415 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
W20260709 13:16:53.418381 14331 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 2.664s	user 0.016s	sys 0.014s
I20260709 13:16:53.422652 14234 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.422616 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:53.423209 14234 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:53.423635 14234 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.429592 14074 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:53.430024 14074 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.430387 14074 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:53.430446 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1953) took 4825 ms. Trace:
W20260709 13:16:53.429095 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 110115us
I20260709 13:16:53.434685 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.438097 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2259) took 2055 ms. Trace:
I20260709 13:16:53.438645 10668 rpcz_store.cc:276] 0709 13:16:51.382900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.450225 (+1067325us) service_pool.cc:224] Handling call
0709 13:16:52.450782 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.548406 (+ 97624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.437445 (+889039us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b54000c3854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:53.437856 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193770368}
I20260709 13:16:53.439538 14074 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.441223 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.441684 14074 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.441977 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 403) took 4887 ms. Trace:
I20260709 13:16:53.442521 10667 rpcz_store.cc:276] 0709 13:16:48.555600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.438413 (+882813us) service_pool.cc:224] Handling call
0709 13:16:51.389514 (+1951101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.393478 (+  3964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.441494 (+2048016us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54002da850. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.441765 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4486452992}
I20260709 13:16:53.446261 14397 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:53.446817 14397 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.441116 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 426) took 1969 ms. Trace:
I20260709 13:16:53.452167 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.453603 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.454866 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:53.460455 14234 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:53.431150 10660 rpcz_store.cc:276] 0709 13:16:48.605347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.569225 (+963878us) service_pool.cc:224] Handling call
0709 13:16:49.823176 (+253951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.823506 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.823535 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.823960 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.493934 (+669974us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.563686 (+ 69752us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.580655 (+ 16969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.580737 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.152558 (+571821us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b180041c380. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f425b18d58f 00007f42541cc571 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd
0709 13:16:53.417302 (+2264744us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:53.428967 (+ 11665us) raft_consensus.cc:1685] finished
0709 13:16:53.428995 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.430055 (+  1060us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54000c1f50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:53.430246 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9528,"prepare.queue_time_us":74445,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":34,"raft.queue_time_us":22539,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":16402,"spinlock_wait_cycles":631212928,"thread_start_us":669587,"threads_started":1,"wal-append.queue_time_us":796060}
I20260709 13:16:53.465739 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:53.465993 10741 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:53.467808 14442 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.484s	user 0.000s	sys 0.001s
I20260709 13:16:53.468040 14300 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.468828 14300 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.469273 14300 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:53.465761 14447 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.459s	user 0.000s	sys 0.003s
W20260709 13:16:53.471216 14414 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.773s	user 0.001s	sys 0.008s
I20260709 13:16:53.472229 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.474149 10664 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:16:53.474352 10591 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.474810 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2268) took 1964 ms. Trace:
I20260709 13:16:53.474977 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.475173 10664 rpcz_store.cc:276] 0709 13:16:51.510959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.473344 (+1962385us) service_pool.cc:224] Handling call
0709 13:16:53.473725 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.474562 (+   837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.474766 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.475766 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.476697 10594 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:16:53.476931 10664 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.478251 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.474447 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:53.480737 10586 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.482179 10592 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.483314 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:53.483856 10592 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:53.476967 10741 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.487923 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.488459 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.489444 10743 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:16:53.475359 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.478376 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.451499 10668 rpcz_store.cc:276] 0709 13:16:51.471546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.439877 (+1968331us) service_pool.cc:224] Handling call
0709 13:16:53.440320 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.440703 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.440738 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.440824 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:53.440866 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.440931 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.441056 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.492403 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 429) took 1837 ms. Trace:
I20260709 13:16:53.492784 10664 rpcz_store.cc:276] 0709 13:16:51.655309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.476323 (+1821014us) service_pool.cc:224] Handling call
0709 13:16:53.476740 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.492159 (+ 15419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.492347 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.495882 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2266) took 2110 ms. Trace:
I20260709 13:16:53.495908 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.496302 10661 rpcz_store.cc:276] 0709 13:16:51.384900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.459967 (+1075067us) service_pool.cc:224] Handling call
0709 13:16:52.460574 (+   607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.775909 (+315335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.775940 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.808363 (+ 32423us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.909412 (+101049us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:52.909464 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.909552 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.466846 (+557294us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:16:53.490915 (+ 24069us) raft_consensus.cc:1685] finished
0709 13:16:53.490939 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.495693 (+  4754us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198185,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4468,"spinlock_wait_cycles":5249408,"thread_start_us":334061,"threads_started":2,"wal-append.queue_time_us":137445}
I20260709 13:16:53.513615 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.507767 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.518600 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.519371 11418 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:53.516103 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:53.521238 10736 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:16:53.464483 14074 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.499835 14397 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:53.501174 14067 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.534044 10591 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:16:53.524821 10594 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:53.525120 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.521714 10736 pending_rounds.cc:85] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:16:53.528376 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:53.534904 10736 pending_rounds.cc:107] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:16:53.535308 10736 raft_consensus.cc:2889] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.539219 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:53.525511 14457 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:53.540060 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:53.539391 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:53.542366 10586 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:53.544781 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:53.549198 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 152853us
I20260709 13:16:53.550786 10664 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.554814 14394 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.556257 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:53.557628 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.568895 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:53.569836 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:53.573294 10661 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 13:16:53.575151 10706 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13.
I20260709 13:16:53.575578 10706 leader_election.cc:403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.583077 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.597657 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:53.605281 14425 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13.
I20260709 13:16:53.594681 14319 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.558035 14397 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:16:53.608911 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 60522.3us
I20260709 13:16:53.611927 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:53.614127 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.560431 14074 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.619266 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:53.624015 11418 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:53.627120 14423 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.627693 14423 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:53.628206 14423 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.613626 14172 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.638769 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.629232 10664 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:16:53.643378 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.658509 11409 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:53.635531 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:53.636389 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.638375 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.661579 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.661998 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 425) took 2181 ms. Trace:
I20260709 13:16:53.642972 10587 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.660987 11413 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:16:53.662489 10590 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:16:53.641600 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77542.6us
I20260709 13:16:53.638059 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.643816 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:53.660379 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.623277 14234 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:53.668906 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.666644 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.639748 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.642220 14204 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:53.670950 13959 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.671272 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:53.672073 10590 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:53.672847 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:53.674193 14397 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:53.675174 14211 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.674193 10590 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:53.677839 10663 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:53.677521 14172 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:53.639348 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.682863 10635 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:53.662460 10666 rpcz_store.cc:276] 0709 13:16:51.471233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.371941 (+1900708us) service_pool.cc:224] Handling call
0709 13:16:53.387807 (+ 15866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.406072 (+ 18265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:53.406389 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.572794 (+166405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.622487 (+ 49693us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.625257 (+  2770us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:53.625308 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.625430 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.652086 (+ 26656us) raft_consensus.cc:1685] finished
0709 13:16:53.652109 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.652253 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30107,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":16257,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7109,"thread_start_us":111078,"threads_started":1,"wal-append.queue_time_us":215341}
I20260709 13:16:53.629611 14212 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.685779 14212 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.686116 10666 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:53.686170 14212 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.687883 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:53.688913 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.690462 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.692868 14230 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:53.693454 14230 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.692188 14305 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:53.693907 10592 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
W20260709 13:16:54.036731 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.763123 10664 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:54.037437 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 420558us
I20260709 13:16:54.037967 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2002) took 1311 ms. Trace:
W20260709 13:16:54.038079 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 330620us
W20260709 13:16:53.887215 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62517.9us
W20260709 13:16:53.754777 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 111042us
I20260709 13:16:54.039561 10664 rpcz_store.cc:276] 0709 13:16:52.726839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.669867 (+943028us) service_pool.cc:224] Handling call
0709 13:16:53.727705 (+ 57838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.037599 (+309894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.037846 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:53.802317 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.707747 11414 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:53.848404 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:54.048156 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:54.055994 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.888010 14332 consensus_meta.cc:287] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.003s
I20260709 13:16:54.061868 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.024222 14231 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:53.712641 14234 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.065447 14231 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:54.066349 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.066960 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.067487 10588 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13.
I20260709 13:16:54.067616 14231 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:53.751616 14151 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.068086 14371 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.068567 14151 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.072031 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.072558 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2264) took 2688 ms. Trace:
I20260709 13:16:53.743333 14074 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.060999 14211 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:54.073418 14424 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.075194 14336 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.079059 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:54.065783 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 382977us
I20260709 13:16:54.068939 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:53.854737 14160 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.844405 14064 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.750923 14204 consensus_queue.cc:1243] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:54.102241 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:53.750149 14230 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.110783 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:54.114398 11411 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:54.115221 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:54.117192 11379 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.107470 11418 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
W20260709 13:16:54.103344 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.117287 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:54.066949 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.101567 14234 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.116407 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 1999) took 1390 ms. Trace:
I20260709 13:16:54.120627 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.128016 10669 rpcz_store.cc:276] 0709 13:16:52.726161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.078764 (+1352603us) service_pool.cc:224] Handling call
0709 13:16:54.116349 (+ 37585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:54.081025 10593 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:16:54.112133 14064 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.133803 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:54.117261 14444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.024s
I20260709 13:16:54.138175 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.098410 10662 rpcz_store.cc:276] 0709 13:16:51.384401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.452486 (+1068085us) service_pool.cc:224] Handling call
0709 13:16:53.297878 (+845392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.303775 (+  5897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.303820 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.304633 (+   813us) log.cc:844] Serialized 52 byte log entry
0709 13:16:53.373497 (+ 68864us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.383898 (+ 10401us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.384317 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.384519 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.384593 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.494956 (+110363us) raft_consensus.cc:1685] finished
0709 13:16:53.494984 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.622783 (+127799us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b180045a720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:54.072231 (+449448us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400182c50. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:54.072365 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14953,"prepare.queue_time_us":9806,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":3283,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":1974,"spinlock_wait_cycles":1945501312,"thread_start_us":68407,"threads_started":1,"wal-append.queue_time_us":105104}
I20260709 13:16:54.141486 14064 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.142100 10594 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:54.141983 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:54.142989 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 74122.2us
I20260709 13:16:54.130403 14204 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:54.149046 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 82325.8us
W20260709 13:16:54.138907 14444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.018s	sys 0.024s
I20260709 13:16:54.151576 10632 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.136567 14074 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:54.149760 14300 consensus_meta.cc:287] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.680s	user 0.003s	sys 0.011s
I20260709 13:16:54.153566 14074 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:54.147492 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.153734 14300 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:54.156522 10668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.023s	sys 0.047s
W20260709 13:16:54.156814 10668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.023s	sys 0.047s
I20260709 13:16:54.144994 14211 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:54.160230 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:54.149721 14227 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:54.122416 14336 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.148422 14204 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:54.165066 14204 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:54.150476 14448 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.165133 14376 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.136942 14424 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.139226 14234 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.172551 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:54.173287 10594 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.168021 10559 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.159885 14211 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.171486 11412 raft_consensus.cc:2368] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:54.169137 14376 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:54.155148 14064 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:16:54.163260 14227 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:54.175590 10593 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:54.178719 14151 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.177337 14376 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.179220 14409 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:54.167433 14160 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.180169 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.180249 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:54.172540 14332 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:54.184226 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 70741.4us
I20260709 13:16:54.176083 14211 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.182765 14380 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:54.182080 14227 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.191316 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:54.191999 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.181792 14409 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:54.187865 14151 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:54.186241 14172 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:54.193358 14373 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.182883 14247 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.186515 14332 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:54.198848 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.170729 14074 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.203244 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.203724 11379 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.204448 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.204985 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.201992 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:54.207144 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1990) took 2734 ms. Trace:
I20260709 13:16:54.208829 10669 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.208830 11411 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.200476 14373 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.211930 14373 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.186916 14212 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.196599 14305 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.199502 14172 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:54.217484 14172 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.217528 14365 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:54.218520 14365 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.218879 14365 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:54.218951 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79878.6us
I20260709 13:16:54.219770 14365 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.204207 14151 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:54.222113 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.221071 14365 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.207768 14332 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.222636 10666 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.223407 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 430) took 2403 ms. Trace:
I20260709 13:16:54.228804 14339 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:54.229352 11410 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:54.229997 14339 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:54.230386 14339 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:54.231488 14420 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.231321 14339 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.231909 14420 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:54.232246 14319 consensus_meta.cc:287] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.608s	user 0.001s	sys 0.006s
I20260709 13:16:54.232513 14339 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.231336 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:54.233075 10739 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:16:54.233453 10739 pending_rounds.cc:85] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 7
I20260709 13:16:54.200910 14444 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:16:54.233675 10739 pending_rounds.cc:107] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:16:54.234033 10739 raft_consensus.cc:2889] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.234558 14234 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.197393 14380 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:54.216043 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.208992 10667 rpcz_store.cc:276] 0709 13:16:51.472325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.443609 (+1971284us) service_pool.cc:224] Handling call
0709 13:16:53.444059 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.444666 (+   607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.444706 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.445277 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.840471 (+395194us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.840524 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.840629 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.206929 (+366300us) raft_consensus.cc:1685] finished
0709 13:16:54.206951 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.207089 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6586,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9514,"thread_start_us":328731,"threads_started":1,"wal-append.queue_time_us":637021}
I20260709 13:16:54.232335 14420 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.228608 10660 rpcz_store.cc:276] 0709 13:16:51.819542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.501765 (+1682223us) service_pool.cc:224] Handling call
0709 13:16:53.526460 (+ 24695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.620682 (+ 94222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.620728 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.667644 (+ 46916us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.139791 (+472147us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:54.139826 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.139961 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.223218 (+ 83257us) raft_consensus.cc:1685] finished
0709 13:16:54.223240 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.223356 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46192,"raft.queue_time_us":56014,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":27590,"thread_start_us":463795,"threads_started":1,"wal-append.queue_time_us":518767}
I20260709 13:16:54.243805 11413 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:54.243947 14295 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.244490 14295 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.224584 14425 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:16:54.247084 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.235080 14340 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.249456 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.233718 14300 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.267496 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.268204 10660 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.268057 10632 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.272369 10666 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:54.272933 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1991) took 1549 ms. Trace:
I20260709 13:16:54.297477 10662 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:54.300231 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 76087.2us
I20260709 13:16:54.300704 10592 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:54.321302 10667 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:54.216125 14247 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.246443 14305 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.221441 14151 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.273412 10668 rpcz_store.cc:276] 0709 13:16:52.723871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.501842 (+777971us) service_pool.cc:224] Handling call
0709 13:16:53.536144 (+ 34302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.562761 (+ 26617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.562805 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.599578 (+ 36773us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.160769 (+561191us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:54.161296 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.161384 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.272658 (+111274us) raft_consensus.cc:1685] finished
0709 13:16:54.272686 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.272863 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46493,"raft.queue_time_us":11592,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9140,"thread_start_us":533285,"threads_started":1,"wal-append.queue_time_us":595312}
I20260709 13:16:54.351843 10664 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.352062 10632 leader_election.cc:400] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:54.352352 10632 leader_election.cc:403] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:16:54.352947 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 157644us
W20260709 13:16:54.357486 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 141762us
W20260709 13:16:54.358800 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 168068us
I20260709 13:16:54.325099 14424 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:54.361397 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 251294us
W20260709 13:16:54.362185 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.331794 14319 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:16:54.357808 14305 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.366529 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:54.379125 14403 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.379519 14403 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.379887 14403 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.382167 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.377960 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:54.383530 10738 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.363586 14212 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.363934 14336 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:54.404066 10663 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:54.404445 10663 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:54.405660 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2084) took 1574 ms. Trace:
I20260709 13:16:54.406050 10739 rpcz_store.cc:276] 0709 13:16:52.831523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.145987 (+314464us) service_pool.cc:224] Handling call
0709 13:16:53.165879 (+ 19892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.234525 (+1068646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.403109 (+168584us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540036b5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:54.405593 (+  2484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453413632}
I20260709 13:16:54.411440 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.422081 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:54.423700 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 59672us
I20260709 13:16:54.411680 14424 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:54.403501 14064 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:16:54.432086 14424 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.444864 11411 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:54.446651 14424 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:54.422205 14333 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.435087 14061 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.447269 14333 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.374066 14380 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.384930 14409 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.438089 10635 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.439424 14332 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.444303 14373 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.454885 14230 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:16:54.460605 14332 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.462719 10593 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:54.449651 14300 raft_consensus.cc:2764] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:54.449538 14333 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.505504 14337 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.505774 14478 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:16:54.506215 14477 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:16:54.506117 14337 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.454748 14481 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:16:54.468441 14064 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.487124 14333 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:54.516801 10594 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:54.517658 14295 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:54.520231 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 82259.4us
I20260709 13:16:54.521044 14227 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:54.549897 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 224662us
W20260709 13:16:54.551312 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 144572us
W20260709 13:16:54.566831 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.567461 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.570242 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.571378 10736 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:54.572386 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.573770 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:54.586495 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.565281 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:54.596309 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 230842us
I20260709 13:16:54.598201 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:54.598734 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.551537 14333 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.600268 10738 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:54.522907 14172 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:54.605301 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 162844us
W20260709 13:16:54.611359 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 260451us
I20260709 13:16:54.610306 10740 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:54.611975 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.614530 10742 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:16:54.617586 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.618191 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 266221us
I20260709 13:16:54.600730 14333 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:54.620718 11379 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.627418 11415 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:54.600210 14211 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.618538 14337 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.625689 14227 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.672401 14420 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:54.694942 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 73365.5us
I20260709 13:16:54.674644 14333 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.676936 14305 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:54.677591 14503 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:54.679589 14300 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:54.680589 14247 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:54.685014 14204 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.003s
I20260709 13:16:54.693374 10739 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:54.673775 14493 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:54.698036 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 84533.1us
W20260709 13:16:54.699019 14371 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.005s
I20260709 13:16:54.703747 11411 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:54.704264 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.700232 14300 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:54.704263 14423 consensus_meta.cc:287] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.075s	user 0.010s	sys 0.004s
I20260709 13:16:54.668002 14492 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:16:54.721987 10668 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:54.731225 14211 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.732005 10664 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:54.736136 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:54.737802 10669 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:54.739022 14498 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.064s	user 0.004s	sys 0.000s
I20260709 13:16:54.739787 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:54.740386 11418 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:54.740597 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 140364us
I20260709 13:16:54.741751 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:54.742524 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 169049us
I20260709 13:16:54.744493 14333 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.747938 14448 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:54.748328 14448 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:54.713598 14300 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.751845 10666 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:54.754796 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.721587 14397 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:54.781623 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.781832 14397 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:54.782192 10662 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.782689 14397 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.783715 10660 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.783802 14397 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.784799 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.787173 14373 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.789327 14409 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.731328 14420 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:54.792423 10660 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:54.795758 14444 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.795825 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.796484 10593 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:54.797562 14420 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:54.797730 14503 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:54.799978 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:54.801643 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.803574 14488 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:54.803959 14488 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:54.808809 14492 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:54.809228 14492 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:54.809988 14492 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.811317 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.796535 10660 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:54.812384 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.812947 10669 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:54.813225 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.813728 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.814060 10660 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.814786 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.814905 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.815483 10669 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.816031 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.817706 14332 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:54.818135 10662 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:54.749200 14448 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.819025 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.757193 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:54.758322 14376 consensus_meta.cc:287] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 13:16:54.819938 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.820640 10739 raft_consensus.cc:2368] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:54.820403 14376 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.753389 14371 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:54.821579 14371 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.755640 11418 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:16:54.822845 10592 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:54.763567 10668 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:54.763809 14211 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:54.702977 14403 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.764021 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.765357 14064 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:54.713353 14500 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.722882 14423 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.706202 14204 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:54.767153 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.770866 14490 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.771245 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 175110us
W20260709 13:16:54.870090 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45683.7us
I20260709 13:16:54.772200 14489 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:54.772928 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:54.726223 14504 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.773873 14212 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:54.873857 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.877743 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.755157 14172 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:54.776131 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:54.878350 10739 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:16:54.776234 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.776818 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:54.879405 10741 raft_consensus.cc:2368] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:54.780997 14424 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:54.819036 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1656) took 1532 ms. Trace:
I20260709 13:16:54.819303 14448 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:54.887043 14424 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.887807 10585 rpcz_store.cc:276] 0709 13:16:53.286386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.111880 (+825494us) service_pool.cc:224] Handling call
0709 13:16:54.118693 (+  6813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.135756 (+ 17063us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:54.453470 (+317714us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.674630 (+221160us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b18002664a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:54.738735 (+ 64105us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b2400168bd8. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420b09d 00007f4256e3d10e 00007f4256e5488c 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221
0709 13:16:54.817009 (+ 78274us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18002664a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e5923a
0709 13:16:54.818739 (+  1730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.818786 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:54.818830 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.818890 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.818987 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1503,"prepare.queue_time_us":376918,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":20800,"raft.queue_time_us":2562,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":60463232,"thread_start_us":426144,"threads_started":2,"wal-append.queue_time_us":134889}
I20260709 13:16:54.892113 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.893158 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.893683 10666 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:54.894400 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:54.895000 10666 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.895213 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:54.897034 14319 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:54.794395 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 43693.2us
I20260709 13:16:54.904021 10557 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:54.824580 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.824457 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:54.817162 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:54.826738 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 119134us
I20260709 13:16:54.833565 10662 raft_consensus.cc:2393] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.828251 10588 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:16:54.804804 14488 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.771669 14336 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.827952 14340 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:54.872612 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.774472 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.879951 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:54.916863 10589 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.881791 10665 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:54.875195 14230 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:54.898773 10664 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 14.
I20260709 13:16:54.915205 10742 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:54.899572 10661 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.895661 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.762987 10663 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.900579 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:54.901072 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:54.826128 14376 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:54.901645 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 149369us
I20260709 13:16:54.923849 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:54.879452 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 135613us
W20260709 13:16:54.902391 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47300.2us
W20260709 13:16:54.902509 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 110982us
I20260709 13:16:54.912046 11382 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:54.869401 14211 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:54.903885 10668 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:54.933679 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:54.918285 10660 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:54.926600 10663 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.934556 10740 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.928881 10585 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:54.929996 10593 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:54.934736 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.935659 10591 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:54.936362 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:54.938413 10662 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:54.941743 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.913241 14373 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:54.945045 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.913841 14064 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.945124 10666 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:54.887063 14339 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:54.948994 10586 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:54.950424 10594 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:54.954739 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:54.956975 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 132621us
I20260709 13:16:54.922959 14319 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:54.901921 14212 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.921917 14340 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.191569 10591 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.192528 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:54.921972 14425 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:54.937613 14172 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.947191 14295 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:54.947124 14373 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:54.919551 14336 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:54.880950 14490 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:54.823711 14444 consensus_queue.cc:1175] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "18f1a9f5e66846dba474825fb5b2b784" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:54.903101 14489 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.943219 14230 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:54.958304 14064 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:55.060258 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 110755us
W20260709 13:16:55.100262 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 199213us
W20260709 13:16:55.116941 14477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.008s	sys 0.005s
I20260709 13:16:54.955348 10587 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:55.047772 14211 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.206686 14373 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.911638 14503 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:55.173998 10740 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
W20260709 13:16:55.181581 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 248386us
I20260709 13:16:54.953879 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:55.188607 14371 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.189352 14424 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.189664 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.191269 14212 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.194005 10593 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:55.233958 10593 pending_rounds.cc:85] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 5
W20260709 13:16:55.221798 14477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.005s
I20260709 13:16:55.234213 10593 pending_rounds.cc:107] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:55.234479 10593 raft_consensus.cc:2889] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.194085 10736 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:55.235361 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.235896 10736 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:16:55.198577 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47105.7us
I20260709 13:16:55.193116 10743 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 4.
I20260709 13:16:55.200160 10589 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:16:55.201238 10663 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:55.236868 10663 pending_rounds.cc:85] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 3
I20260709 13:16:55.237102 10663 pending_rounds.cc:107] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:55.237335 10663 raft_consensus.cc:2889] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.237211 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:55.203017 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.171257 14376 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.206169 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.189424 14500 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:55.209339 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 291502us
I20260709 13:16:55.209810 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.210541 10588 raft_consensus.cc:1240] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:16:55.210988 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 301952us
I20260709 13:16:55.211364 10585 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:55.203303 14295 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.899106 14486 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:16:55.204898 14505 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:55.203478 14340 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.231964 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:55.195086 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 237433us
I20260709 13:16:55.238237 10589 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 14.
I20260709 13:16:55.243818 10734 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:55.248281 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.251158 10594 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:55.250654 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.255556 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2006) took 2190 ms. Trace:
I20260709 13:16:55.257445 10663 rpcz_store.cc:276] 0709 13:16:53.064741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.679917 (+615176us) service_pool.cc:224] Handling call
0709 13:16:53.680203 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.403981 (+723778us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54003f69a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f4257230dc0 00007f42572bb1c0 00007f42572bc231 00007f42572b8d8f 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c
0709 13:16:54.762654 (+358673us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54003f69a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f425723706f 00007f42572aff60 00007f42572b17de 00007f42572bbb49 00007f42572bc416 00007f42572b8d8f 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62
0709 13:16:55.255343 (+492689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.255507 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055569920}
I20260709 13:16:55.258169 10591 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:55.250167 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 296347us
I20260709 13:16:55.262593 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.262807 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.211715 14300 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.264705 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.270783 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.271538 11418 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:55.271638 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.267273 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:55.275099 10736 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:55.276865 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.249944 14511 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:55.263651 13959 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:55.249971 14212 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:55.258317 14295 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.283231 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:16:55.291231 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.291916 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.265643 14376 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:55.265935 14403 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.291103 10559 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:55.299039 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 68159.3us
I20260709 13:16:55.277874 14505 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:55.282925 14423 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.280572 14204 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.280661 14340 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:55.279863 14515 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.296424 14365 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:55.324512 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:55.311550 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:55.310768 14319 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.330644 14230 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.337988 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:55.338222 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46353.5us
I20260709 13:16:55.337236 11414 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:55.318594 14074 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:55.263170 14500 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.318840 14340 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:55.308158 14212 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:55.346073 14333 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.601s	user 0.018s	sys 0.003s
I20260709 13:16:55.334298 14493 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:55.360711 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 75415.9us
I20260709 13:16:55.387115 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:55.362927 14510 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:16:55.369601 14505 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.358547 14503 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:55.374420 14490 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.450311 14492 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.374974 14376 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.378460 14336 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.379359 14064 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:55.453465 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.379662 14300 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.380247 14489 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.353056 14340 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.456483 14481 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:55.456844 14481 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:55.352152 14074 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.457511 14074 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:55.350576 14397 consensus_meta.cc:287] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.566s	user 0.018s	sys 0.004s
W20260709 13:16:55.431509 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44501.4us
W20260709 13:16:55.359681 14409 consensus_meta.cc:287] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.018s
I20260709 13:16:55.446466 14212 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.449496 14365 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:55.459189 10734 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
W20260709 13:16:55.461061 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 112878us
I20260709 13:16:55.471961 10635 leader_election.cc:400] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:55.326239 14515 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.457844 14481 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:55.477440 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.481570 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.482631 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.484481 10635 leader_election.cc:400] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:16:55.465126 14503 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:55.473192 14365 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:55.462612 14332 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:16:55.498550 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.500511 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:55.489223 14064 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:55.503720 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:55.505591 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.504657 10662 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:55.502743 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 153665us
I20260709 13:16:55.491513 14204 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.510380 10663 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:55.511006 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.512701 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:55.514430 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:55.515705 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 221295us
I20260709 13:16:55.515977 10669 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:55.502117 14234 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.521482 10666 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:55.522260 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.509498 14061 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:55.527693 14515 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.527736 14340 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.528599 10662 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:55.530879 10664 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:55.537439 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.504146 14064 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.501673 14493 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:55.549746 14365 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.552009 14373 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.552346 14295 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.552932 14061 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.506489 14529 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:55.554611 14503 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.555641 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.556542 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:55.540575 14234 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.560705 10663 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 4.
I20260709 13:16:55.565491 14064 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.578645 10669 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:55.588091 14074 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.597420 14373 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.574630 14527 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:55.599275 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.599912 14234 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.601230 10666 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:55.601015 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:55.543040 14376 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:16:55.573879 14212 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:16:55.604990 14380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.006s	sys 0.010s
I20260709 13:16:55.620811 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.622062 10663 raft_consensus.cc:1240] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:55.623982 14380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.006s	sys 0.010s
I20260709 13:16:55.635250 14333 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.627739 14212 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.651641 14212 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.641690 14234 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.652642 14234 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.654862 14234 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.642544 14340 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.655285 14061 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:55.656091 14509 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.790s	user 0.003s	sys 0.000s
I20260709 13:16:55.620702 14371 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:55.657648 14424 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:55.619525 14529 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:55.658023 14424 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:55.658910 14064 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.660951 14064 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.661602 10666 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:55.661440 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.658913 14424 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.663185 14424 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:55.643519 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.666481 14371 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:55.646137 14528 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:55.647469 14247 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.647843 14295 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.647861 14305 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.626726 14373 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:55.675707 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 155978us
I20260709 13:16:55.618985 14500 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.680941 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.615068 14332 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:16:55.686527 14373 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:55.686035 14247 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.709090 14247 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.695045 14371 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.688225 14305 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.714393 14337 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:55.714951 14305 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:55.715755 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.716224 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2014) took 1527 ms. Trace:
I20260709 13:16:55.716566 10661 rpcz_store.cc:276] 0709 13:16:54.188537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.191448 (+  2911us) service_pool.cc:224] Handling call
0709 13:16:55.716036 (+1524588us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540026a2d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:55.716172 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600813312}
W20260709 13:16:55.716967 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 480202us
I20260709 13:16:55.717643 10667 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:55.719476 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 436) took 1350 ms. Trace:
I20260709 13:16:55.719754 10667 rpcz_store.cc:276] 0709 13:16:54.369150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.369417 (+   267us) service_pool.cc:224] Handling call
0709 13:16:55.717476 (+1348059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.718243 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.719318 (+  1075us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540026a2d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:55.719427 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060447744}
I20260709 13:16:55.722249 14319 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:55.722730 14319 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.704418 14373 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:55.724853 14319 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.725517 14319 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.725641 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.725917 14319 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.726225 10739 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:16:55.727751 14319 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.728191 14319 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:55.729409 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.729945 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.730406 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.730495 10662 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:55.730844 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.731020 10660 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:55.731366 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:55.731827 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.731922 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.728579 14319 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.732647 14064 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:55.733282 14064 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:55.734201 14064 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.732736 14247 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:55.714906 14337 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:55.725136 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.732950 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.771453 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.776188 10663 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:16:55.777180 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:55.778116 10667 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:16:55.779100 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.779843 11414 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:55.779147 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.781275 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:55.783468 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.783864 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.687927 14504 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:16:55.784694 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.800479 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.801110 10737 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.801332 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.802525 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:55.811497 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:55.793670 14536 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:16:55.812790 11412 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:55.775580 14305 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:55.781921 13959 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.784731 14212 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.813524 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:55.818286 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.794435 14247 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:55.822587 10739 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.822942 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.816684 14305 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.825804 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:55.829164 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.814747 14211 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.831616 10743 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:55.836773 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.841596 10737 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:55.842442 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.843062 10737 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:55.844986 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:55.846316 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:55.821018 14537 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:55.825305 14503 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.848829 14503 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.850982 14503 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.832453 14211 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.851693 14211 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.821666 14319 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.828835 14305 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:55.859477 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46030.3us
I20260709 13:16:55.830724 13959 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.822589 14295 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:55.865878 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.863081 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:55.854192 14336 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.844072 14230 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:55.862166 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:55.825049 14212 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.822362 14409 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:55.854876 14489 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.857786 14425 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.835220 14397 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:55.859519 14490 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:55.872756 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.868978 14340 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:55.879132 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:55.864387 13959 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:55.867475 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:55.886637 10586 raft_consensus.cc:606] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:55.826898 14337 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.887243 10739 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:55.874668 14336 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:55.889465 14545 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:16:55.890311 14539 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:55.891186 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:55.892210 14337 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.891347 14336 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.890355 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.893592 11414 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:55.895730 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.896337 11414 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:55.898010 10743 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:55.897631 14247 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.898682 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:55.899420 10739 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:55.899848 10739 pending_rounds.cc:85] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:55.900125 10739 pending_rounds.cc:107] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:55.901654 10739 raft_consensus.cc:2889] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.902853 10739 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:55.904525 10739 pending_rounds.cc:85] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:55.904809 10739 pending_rounds.cc:107] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:55.905092 10739 raft_consensus.cc:2889] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.907111 10741 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:55.887624 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:55.908308 14212 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.920130 14074 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:55.923203 14397 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.925742 14397 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.886106 14295 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:55.929396 14409 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:55.929662 14336 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.929906 14409 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:55.931069 14409 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.932595 14409 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.880563 14503 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.930500 14336 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:16:55.936730 14319 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:55.937151 14319 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:55.938227 14319 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.880864 14490 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.939538 14490 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.941192 10735 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:16:55.944435 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56745.1us
I20260709 13:16:55.946473 14493 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:55.946393 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:55.947053 14493 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:55.885952 14489 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.947857 14493 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.948980 14493 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.949579 14489 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:55.953473 14295 consensus_queue.cc:1243] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:55.954021 14295 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:55.954360 14295 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:55.955068 14295 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:55.956180 14295 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.946303 14373 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.959556 14373 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.888134 13959 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:55.963899 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.964542 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.964926 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.966918 10737 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:55.973479 14397 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:55.974225 14397 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.976590 14397 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:55.978152 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:55.978731 10738 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:55.979192 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1554) took 1102 ms. Trace:
I20260709 13:16:55.979463 10738 rpcz_store.cc:276] 0709 13:16:54.876859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.876982 (+   123us) service_pool.cc:224] Handling call
0709 13:16:55.978028 (+1101046us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:16:55.979144 (+  1116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10752768}
I20260709 13:16:55.978571 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:55.984359 14503 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.984815 14503 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.985208 14503 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.986651 14501 consensus_queue.cc:1059] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:16:55.987279 14507 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:55.988204 14507 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:55.988493 14507 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:55.989295 14507 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:55.990892 14507 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:55.991214 10559 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:56.008431 14337 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.009016 14337 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.010605 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.012056 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.013005 10587 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:56.013636 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.014878 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.015461 10586 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.993415 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:55.993594 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 131512us
I20260709 13:16:55.993752 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.024844 10594 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:55.994612 10593 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.994679 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.024967 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:56.025739 10588 raft_consensus.cc:2410] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:55.996285 10585 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:16:55.997504 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:55.998525 14234 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:56.029606 14234 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.031550 14234 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:56.033598 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.034619 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.035776 10593 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:56.036883 10593 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:56.038645 14230 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:56.039103 14230 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.039710 10594 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:16:56.026223 10585 pending_rounds.cc:85] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 10
I20260709 13:16:56.041465 14397 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.042050 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.041541 10585 pending_rounds.cc:107] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 14.11
W20260709 13:16:56.044210 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 97896.8us
I20260709 13:16:56.044675 10585 raft_consensus.cc:2889] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:56.047690 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.007743 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.045809 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:56.072831 10586 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
I20260709 13:16:56.075860 10706 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 14.
I20260709 13:16:56.076543 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.076514 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:56.077894 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53014.7us
I20260709 13:16:56.023276 14501 raft_consensus.cc:3055] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:56.083487 14212 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:56.085903 14425 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.086939 14524 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:56.087828 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:56.088629 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1670) took 1705 ms. Trace:
I20260709 13:16:56.075137 14340 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:56.090193 14503 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.028534 14493 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:56.111280 14493 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:56.111982 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:56.112553 11411 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:56.095641 13959 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.028992 14172 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:56.113567 14172 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.114465 13959 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:56.114813 14305 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.115475 14172 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:56.105602 10592 rpcz_store.cc:276] 0709 13:16:54.382784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.382912 (+   128us) service_pool.cc:224] Handling call
0709 13:16:54.401009 (+ 18097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.823344 (+422335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.088404 (+1265060us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400299354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:56.088572 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969628544}
I20260709 13:16:56.116381 14503 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:56.106474 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:56.028739 14504 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:16:56.117455 14504 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:56.117779 14504 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:56.118742 14504 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.119897 14504 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.112151 14493 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.121884 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:56.122455 11413 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:56.097620 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 1984) took 4679 ms. Trace:
I20260709 13:16:56.123135 10665 rpcz_store.cc:276] 0709 13:16:51.409632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.846993 (+2437361us) service_pool.cc:224] Handling call
0709 13:16:53.847447 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.917365 (+1069918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.089135 (+1171770us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003ab6d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:56.089295 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378388736}
W20260709 13:16:56.124217 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.042075 14397 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:56.082221 14424 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:56.127286 10560 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:56.110961 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:56.135972 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.081614 14234 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:56.136034 11412 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:56.138366 10587 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:56.120770 14490 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.097868 14511 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:56.147985 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.097654 14501 raft_consensus.cc:740] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:56.105249 14524 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:56.154145 14524 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.155390 14524 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:56.160362 14549 log.cc:927] Time spent T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:16:56.141659 11411 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:16:56.166085 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.167470 14340 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:56.168742 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.169503 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:56.170665 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:56.173028 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:56.177155 14234 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.178381 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:56.134404 14397 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.073527 14211 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.185997 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:56.149348 14305 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:56.141747 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:56.141070 11413 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:56.139225 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:56.104986 14425 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:56.141032 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:56.266884 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 125945us
I20260709 13:16:56.148634 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:56.268396 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 119822us
W20260709 13:16:56.151587 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 63856.8us
I20260709 13:16:56.269044 10734 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:56.146658 14332 raft_consensus.cc:2764] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:56.269804 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:56.107739 14496 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:56.254597 10665 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:56.256111 10737 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:56.256785 10663 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:56.258127 10664 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:56.261080 10669 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:56.148563 14074 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:56.149158 14172 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.276348 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 137214us
I20260709 13:16:56.276944 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:56.278724 14305 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.279107 14305 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.269428 14425 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.279487 14305 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.285394 14424 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:56.285806 14424 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:56.286211 14424 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:56.274173 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 132483us
W20260709 13:16:56.275357 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 396279us
I20260709 13:16:56.289094 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:56.268980 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:56.150252 14503 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:56.291373 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:56.297464 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.295958 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:56.300721 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.301385 10737 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:56.295684 10560 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:56.339203 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 43592.8us
I20260709 13:16:56.339254 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:56.341730 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.344444 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.344851 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.345099 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:56.345674 10593 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:56.347460 10586 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:16:56.339300 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:56.348011 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:56.351565 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:56.352309 10660 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.353205 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:56.351781 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62757.5us
W20260709 13:16:56.362648 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.410115 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.292436 14515 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:56.294765 14172 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.294938 14064 raft_consensus.cc:2764] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:16:56.415575 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.336194 14336 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:56.433593 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.422169 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.293362 14503 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.296828 14376 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.424757 10585 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:56.422071 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:56.346861 14337 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:56.426713 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 87491.1us
I20260709 13:16:56.301699 14212 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:56.295097 14074 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:56.481986 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51865.3us
I20260709 13:16:56.431099 10587 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:56.431425 11379 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:56.297219 13959 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:56.437815 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.352730 14477 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.439502 14503 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.439651 14376 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.443810 14551 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:56.296672 14371 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:16:56.354563 14489 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:56.451365 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:56.525326 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 74017.9us
I20260709 13:16:56.444936 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:56.526259 10735 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.294585 14511 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:16:56.347034 14332 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:16:56.506047 10666 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:16:56.433367 14363 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.511984 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.433125 14247 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:56.512532 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 242792us
I20260709 13:16:56.355749 14409 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:56.438390 14336 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:56.548144 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.558229 10739 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:56.446606 14212 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:56.485581 14496 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.577184 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:56.570739 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.567581 10741 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:56.508993 13959 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.575767 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:56.581698 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:56.558043 14363 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.583596 14332 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:56.583844 14363 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.551435 14337 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:56.585706 14337 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:16:56.585834 14557 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:16:56.586681 14337 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.587673 14332 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.514681 14376 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.589435 14502 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:56.592435 14502 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:56.593354 14502 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.594487 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:56.597555 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 242529us
I20260709 13:16:56.598232 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:56.601199 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 169863us
I20260709 13:16:56.601877 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:56.605619 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 77844.7us
I20260709 13:16:56.573227 14336 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.578361 14212 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.508885 14527 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:16:56.574463 14551 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:56.508319 14425 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.403589 14525 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:16:56.430011 14501 consensus_queue.cc:260] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.545799 14305 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.577847 14409 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.613303 10632 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:56.598848 14566 log.cc:927] Time spent T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:16:56.591521 14496 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.558588 14489 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.590058 13959 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.594432 14488 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.652220 10737 raft_consensus.cc:2410] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:56.601828 14493 raft_consensus.cc:2764] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:56.623890 14247 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:16:56.649837 14371 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:56.611254 14497 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:56.627923 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 287741us
I20260709 13:16:56.546439 14477 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.597064 10557 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:56.680899 10668 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:56.681372 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 68134.9us
I20260709 13:16:56.675251 14234 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:56.613451 14204 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:16:56.684135 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:56.661551 14295 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:56.661845 14507 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.005s
W20260709 13:16:56.697633 14558 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:16:56.726259 14525 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.726740 14525 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.728899 14525 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:56.729553 14525 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:56.720443 14504 consensus_meta.cc:287] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.000s
I20260709 13:16:56.682101 14511 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:56.656976 14074 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.700670 14332 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:56.767982 10592 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:56.775024 14490 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:56.780413 14319 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:56.790710 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:56.794159 14211 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:56.798102 10668 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:56.808049 10668 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:56.808912 14373 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.809512 14425 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:56.730257 14550 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 13:16:56.810683 14565 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:16:56.811367 14563 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:16:56.815721 10660 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
W20260709 13:16:56.817703 14560 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:16:56.818775 14397 consensus_meta.cc:287] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.000s
I20260709 13:16:56.741632 14525 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:16:56.829164 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53170us
W20260709 13:16:56.831444 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 234423us
W20260709 13:16:56.809561 14561 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:56.806090 14172 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:56.717190 14551 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:56.860589 14424 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
I20260709 13:16:56.830226 14504 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.861812 14504 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.862087 14489 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:56.862233 14504 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.866050 14409 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:56.854216 14569 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:56.869760 14569 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:56.870559 14569 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.870926 14582 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:56.871829 14569 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.850730 14503 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.873984 14499 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:16:56.876039 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:56.876808 10740 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:16:56.750849 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:56.878959 10735 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 5.
I20260709 13:16:56.881791 14305 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:56.881861 14525 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.883332 14525 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.886409 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:56.872525 14363 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:56.894030 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 216672us
W20260709 13:16:56.854416 14230 consensus_meta.cc:287] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.815s	user 0.014s	sys 0.006s
I20260709 13:16:56.861028 14424 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:56.917062 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 237606us
W20260709 13:16:56.903920 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 185599us
I20260709 13:16:56.842439 14397 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:56.880970 14336 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.959746 11415 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:56.961051 10737 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:56.933336 14524 consensus_meta.cc:287] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.004s
I20260709 13:16:56.916630 14230 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.962558 14497 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.970674 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 286611us
W20260709 13:16:57.002635 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.965340 14503 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.011065 14380 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:57.011734 14380 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.012997 14380 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:56.962272 14590 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:16:57.016857 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45168.2us
I20260709 13:16:57.005239 14064 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:56.969856 14424 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:56.973578 14496 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:57.062382 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 464167us
I20260709 13:16:57.000710 14204 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:57.014127 14380 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.966511 14172 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:16:57.069213 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.070382 14336 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:57.073973 14576 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:16:57.001983 14497 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.075587 13959 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.074607 14363 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.079551 10738 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:16:57.080005 10738 pending_rounds.cc:85] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:16:57.080271 10738 pending_rounds.cc:107] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:16:57.080549 10738 raft_consensus.cc:2889] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.087783 14424 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.088625 14230 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.089993 14376 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.092150 14376 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.093741 14212 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.094388 10589 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:57.095327 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.095564 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.096063 10594 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.096369 11410 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:57.096529 14212 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.097517 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.098232 10588 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:16:57.099242 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.100391 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.102649 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.103235 10585 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:16:57.106910 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 412) took 1221 ms. Trace:
I20260709 13:16:57.107900 14397 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:16:57.108563 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 89864.2us
I20260709 13:16:57.096204 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.109345 10592 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.115176 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.107301 11418 rpcz_store.cc:276] 0709 13:16:55.885939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.886044 (+   105us) service_pool.cc:224] Handling call
0709 13:16:55.889119 (+  3075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.096625 (+207506us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:56.577436 (+480811us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.760504 (+183068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.760553 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:56.760595 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.105862 (+345267us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003f2e60. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419
0709 13:16:57.106697 (+   835us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400426b54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:57.106732 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.106840 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8358,"prepare.queue_time_us":578043,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":89,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":44845,"spinlock_wait_cycles":479954048,"thread_start_us":662281,"threads_started":2,"wal-append.queue_time_us":339551}
I20260709 13:16:57.124001 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.124761 10589 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:57.127278 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:57.131699 14597 log.cc:927] Time spent T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:57.021494 14589 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:16:57.138384 14481 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:57.138536 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 75126.3us
I20260709 13:16:57.159893 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.160871 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.144905 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.145177 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.145535 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.177824 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2127) took 1171 ms. Trace:
I20260709 13:16:57.145625 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.146207 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.178591 10590 raft_consensus.cc:2393] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.146272 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.179255 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:57.146947 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:57.147167 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.180369 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.142973 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.144933 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.152766 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.181734 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.182015 10665 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:57.182133 11413 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:16:57.182463 10594 raft_consensus.cc:2393] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.153251 10557 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:57.179826 10742 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:16:57.155597 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.182917 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.178171 10736 rpcz_store.cc:276] 0709 13:16:56.006054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.006431 (+   377us) service_pool.cc:224] Handling call
0709 13:16:56.006743 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.028638 (+ 21895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.028669 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.029108 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.935489 (+906381us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b1800396b20. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:57.002472 (+ 66983us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.002511 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.002578 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.157229 (+154651us) raft_consensus.cc:1685] finished
0709 13:16:57.157254 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.177764 (+ 20510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21534,"raft.queue_time_us":21688,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":17212672,"thread_start_us":66774,"threads_started":1,"wal-append.queue_time_us":1098035}
I20260709 13:16:57.183455 11411 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.184536 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.184741 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.185897 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.186833 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.186905 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.187574 10590 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.187665 10666 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:57.156370 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.189342 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.126039 14488 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:57.156845 10592 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:57.125886 14496 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:57.085605 14204 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.107118 14504 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.157876 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.195096 10669 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.133000 14502 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:57.126853 14212 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.161465 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.199329 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:57.142956 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 444417us
I20260709 13:16:57.162037 14397 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.203946 14397 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:57.204357 14397 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.205476 14212 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.207523 14212 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.209601 14336 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.210616 10586 raft_consensus.cc:2410] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:57.210532 14064 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:57.201586 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.211190 14064 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.211436 14340 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.212031 14340 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:57.162441 14319 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:57.192713 14488 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.215070 14488 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.198864 14211 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.220177 14504 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.196806 14537 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:57.165659 14587 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:57.166599 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.171789 11415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 584) took 1901 ms. Trace:
I20260709 13:16:57.173162 10743 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:57.173791 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:57.174417 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.174611 10735 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:57.175207 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.154888 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.191609 11411 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:57.232472 10660 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.188272 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.196110 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.197963 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.199631 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.200688 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.201591 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:57.203570 14562 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.522s	user 0.002s	sys 0.005s
I20260709 13:16:57.239301 14340 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.223390 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.240723 14340 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.241118 10588 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.241999 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.242545 10588 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:16:57.243387 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.244045 10588 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.244185 10590 raft_consensus.cc:2368] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:57.244881 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.227140 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.245291 10590 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:57.238408 10594 raft_consensus.cc:2410] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:57.184542 14590 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.227838 14569 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:57.248265 14569 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:57.248301 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.250718 10559 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:57.253535 14420 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.253752 14587 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:57.254292 14587 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.254163 14420 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.255330 14587 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.256343 14537 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.256773 14420 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.199044 14502 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.258991 14502 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.259954 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.224604 10585 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
W20260709 13:16:57.261394 14603 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:57.234582 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.263105 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:57.228965 11415 rpcz_store.cc:276] 0709 13:16:55.270704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.276657 (+  5953us) service_pool.cc:224] Handling call
0709 13:16:57.171599 (+1894942us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54005de154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:57.171701 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3868151168}
I20260709 13:16:57.264418 10588 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
W20260709 13:16:57.265496 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 67568.6us
I20260709 13:16:57.266402 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.193118 14591 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.263640 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.277067 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.280790 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.281565 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.281919 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:57.282739 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.283347 10662 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.285228 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.283548 14594 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.293424 10739 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:57.298579 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.299256 10739 pending_rounds.cc:85] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 3
I20260709 13:16:57.299535 10739 pending_rounds.cc:107] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:57.299813 10739 raft_consensus.cc:2889] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.299503 10742 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.301558 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.302083 10743 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.249277 14569 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.275497 14424 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.256789 14537 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.295630 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:57.230578 14230 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.222502 14204 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.284963 14337 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.294694 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:57.262434 14212 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.307333 10665 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.308490 10660 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:57.324976 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.287117 14319 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.325582 10587 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:16:57.310062 10662 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:57.287293 14582 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.290269 14409 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:57.284431 14550 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:57.295038 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:57.367641 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.289770 14524 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.279304 14295 raft_consensus.cc:2764] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:16:57.336158 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.299098 14594 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:57.364862 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 70226.4us
I20260709 13:16:57.367815 10736 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:57.287221 14496 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.369999 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:57.311194 14211 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:57.373389 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.325776 14425 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.286922 14591 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.296252 14504 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:57.329118 14319 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.397140 10668 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:57.396531 14319 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.402231 14583 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:57.402622 14583 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.402952 14583 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.372711 14524 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:57.405764 14524 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.408517 14497 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.371798 14212 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.411126 14212 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.408932 14319 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.412225 10736 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:57.412926 14515 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:57.413128 14319 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.413378 14515 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.416396 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.417251 10662 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.368958 14363 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.446404 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.315412 14424 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.376277 14496 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.330945 14230 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.377501 14594 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.475153 10591 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:16:57.475289 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 97311.5us
I20260709 13:16:57.476135 10593 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:57.480337 10589 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.390357 14551 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.391535 14489 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.483075 10587 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:16:57.483783 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 113859us
W20260709 13:16:57.473374 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 146790us
I20260709 13:16:57.484669 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:57.474871 14571 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:57.485868 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.486100 10590 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:57.480937 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.464851 14550 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.491756 10592 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:57.489579 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.475330 14496 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.494336 10632 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.395141 14425 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.498656 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.499483 11411 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:57.487525 14551 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:57.492049 14529 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:57.508186 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.473805 14363 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.511425 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:57.414314 14515 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.514045 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.515367 10589 raft_consensus.cc:606] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.518579 11414 raft_consensus.cc:2410] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:57.546247 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.528496 14619 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:57.528736 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:57.547487 14363 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.548250 14425 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.477012 14583 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.529639 14605 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:57.530820 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:57.538050 14607 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:57.603029 14336 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:57.549175 14524 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.610641 14570 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:57.609675 14489 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:57.620262 14570 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.620548 14489 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.621085 14570 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.621927 14524 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.622135 14570 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.549548 14211 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.550490 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2037) took 1382 ms. Trace:
I20260709 13:16:57.602476 14508 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:57.623925 14508 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.623472 10667 rpcz_store.cc:276] 0709 13:16:56.167843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.171557 (+  3714us) service_pool.cc:224] Handling call
0709 13:16:56.257750 (+ 86193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.277535 (+ 19785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.277593 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.277975 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.221138 (+943163us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003ed820. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:57.326744 (+105606us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.326797 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.326902 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.550158 (+223256us) raft_consensus.cc:1685] finished
0709 13:16:57.550184 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.550424 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87247,"raft.queue_time_us":31141,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":4963,"spinlock_wait_cycles":27330816,"thread_start_us":105416,"threads_started":1,"wal-append.queue_time_us":1051078}
I20260709 13:16:57.609129 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1575) took 1267 ms. Trace:
I20260709 13:16:57.626215 10738 rpcz_store.cc:276] 0709 13:16:56.341331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.402046 (+ 60715us) service_pool.cc:224] Handling call
0709 13:16:56.444703 (+ 42657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.081276 (+636573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.608861 (+527585us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54001ccd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:57.609062 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459026304}
I20260709 13:16:57.627095 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.627380 11411 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:57.627466 10738 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.629201 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.570971 14477 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.608109 10740 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:57.626101 14508 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.642949 14537 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.644203 14537 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.646934 11415 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.647137 10743 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:57.555624 10742 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:57.623106 14489 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.508747 14587 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.650355 14579 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.650800 14587 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.651453 10736 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:57.651808 10735 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:57.652124 10735 pending_rounds.cc:85] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 4
I20260709 13:16:57.652324 10735 pending_rounds.cc:107] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:57.652535 10735 raft_consensus.cc:2889] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.641229 10737 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.656950 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.657301 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.657651 10590 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 16: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:57.657694 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:57.658629 14380 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:57.659274 14380 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.659471 10592 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.660193 14380 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.663468 14508 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.663955 14508 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.664227 14499 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:57.666126 14594 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.666885 14499 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.631286 14605 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.669874 14499 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:57.549729 14337 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.572638 14591 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.672060 14499 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.507195 14074 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:57.514443 14397 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.607028 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:57.719203 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 112250us
I20260709 13:16:57.627135 14583 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.604076 13959 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.549628 14515 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.636545 14230 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.581292 14496 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.650832 14579 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.658682 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 416) took 1760 ms. Trace:
I20260709 13:16:57.667228 14376 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:57.555284 14501 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.728219 10592 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:16:57.673450 10735 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:57.631523 10740 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.616659 14424 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.619787 14336 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.746826 14336 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.677904 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.678580 14477 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:57.593683 14061 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:57.749504 14061 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:57.512012 14551 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.750490 14583 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.649194 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:57.556336 14488 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.703553 11415 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:57.552937 14064 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:57.704908 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 224028us
I20260709 13:16:57.707530 10669 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:57.709905 10662 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:57.710042 11412 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:57.711601 10664 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:57.750351 14496 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:57.711395 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 217140us
I20260709 13:16:57.721249 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.730132 10661 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:57.616174 14502 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.740859 10742 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.549120 14340 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.740494 11414 rpcz_store.cc:276] 0709 13:16:55.898323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.898456 (+   133us) service_pool.cc:224] Handling call
0709 13:16:57.658518 (+1760062us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400033754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:57.658632 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3722970496}
I20260709 13:16:57.740217 14587 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.744149 14605 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.728591 11410 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.742141 14376 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:57.725950 14489 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.744992 14499 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:57.686246 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 170688us
W20260709 13:16:57.750344 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 72545.1us
I20260709 13:16:57.725610 14569 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:57.752887 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 103766us
I20260709 13:16:57.756867 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:57.738309 14594 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.762001 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.768199 10706 leader_election.cc:400] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:57.768460 10706 leader_election.cc:403] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:57.736873 10665 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:57.765007 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:57.760272 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:57.766116 10668 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.763868 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.766129 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.774420 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.727859 14074 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:57.851401 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 91179.2us
W20260709 13:16:57.851464 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 85435.4us
W20260709 13:16:57.819274 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54330.5us
I20260709 13:16:57.845979 14525 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:57.847169 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.854689 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.854911 10664 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:16:57.847489 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 71893.4us
I20260709 13:16:57.854974 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.856254 10662 raft_consensus.cc:2410] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:57.847862 14502 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:16:57.848919 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:57.871783 11414 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:57.848938 14397 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:57.874217 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.875687 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.875943 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.877008 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.877306 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.877614 10660 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:57.877832 10662 raft_consensus.cc:2376] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9. Re-sending same reply.
W20260709 13:16:57.878909 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.878966 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.879825 10662 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:57.882474 10668 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:57.883273 10665 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:57.883527 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.884029 10559 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:57.884171 10668 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:57.884256 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.750324 14061 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:57.850740 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80744.7us
I20260709 13:16:57.871734 14340 raft_consensus.cc:2764] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:57.859019 14529 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:57.762732 14425 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:57.859920 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.860249 11410 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:57.860989 14337 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.860901 14610 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:57.861660 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.860935 14247 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:16:57.857558 10632 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:57.762396 14615 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:57.865921 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.867233 14064 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.853147 14336 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:16:57.850834 14605 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:57.943910 14336 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.944087 14605 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:57.944334 14336 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:57.945165 14605 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.945269 14336 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.946557 14336 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.956988 14579 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.957616 14624 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:57.958199 14624 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:57.959031 14624 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.936105 14337 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:57.963227 14337 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:57.968892 14074 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.969437 14618 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:57.870457 14488 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:57.776440 14622 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
W20260709 13:16:57.850188 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 74208.6us
W20260709 13:16:57.904284 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.984627 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:57.985591 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:57.986464 10592 raft_consensus.cc:2410] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:57.885226 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.901965 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:57.987841 10585 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.925084 14493 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:57.880939 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:57.780537 14230 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:57.913120 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.851538 14582 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.916853 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.003432 14064 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:57.923303 14616 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:16:57.918602 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.008687 10660 raft_consensus.cc:2393] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:58.009544 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.010224 10660 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:57.919569 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.021175 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.029023 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.858672 13959 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:57.915540 14332 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:58.041096 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.928609 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:57.915941 14525 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:57.936090 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:57.937223 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79755.3us
I20260709 13:16:57.938198 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:57.980296 14615 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:16:57.981101 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44339.4us
I20260709 13:16:57.995819 10585 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:16:57.901746 10663 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:58.000340 10740 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.003014 10664 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:58.002672 14511 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:58.004647 14064 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:58.007916 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:58.044039 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 115509us
I20260709 13:16:57.856791 14424 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:58.121876 14626 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:16:58.001606 14481 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.123790 14508 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:58.125793 14525 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.128790 14424 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:16:58.099438 14425 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.129850 14425 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:58.130244 10740 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:16:58.130743 14425 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:57.872781 14570 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.036970 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.043467 14493 consensus_queue.cc:1243] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:57.941529 14373 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:16:58.097944 10666 raft_consensus.cc:2393] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:58.134543 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.135247 10666 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:58.134990 14615 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.136001 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.135900 14204 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:58.046885 14380 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:16:58.137642 10666 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:16:58.138754 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.139801 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.140012 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:58.140631 10666 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:58.141189 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:58.100874 10559 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:57.921972 14376 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.141820 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:58.142218 14376 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.142565 10708 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:58.143141 14371 consensus_queue.cc:1175] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "18f1a9f5e66846dba474825fb5b2b784" responder_term: 11 status { last_received { term: 8 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:58.143451 14397 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.144342 14336 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.147326 11410 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:58.147922 14583 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.148614 14583 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:57.939150 14061 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.098438 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:58.106060 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.106459 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.001282 14230 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.110255 10743 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:58.110837 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.162737 10664 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:16:58.111377 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.111971 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.110256 14064 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.111996 14551 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.133033 14074 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:58.133335 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.103717 10669 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:58.141494 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:57.990727 14507 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.104346 10706 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:58.180383 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 76151.1us
I20260709 13:16:58.182144 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:58.160985 10660 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:16:58.159973 10667 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:58.165730 11414 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:58.169159 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:58.042001 13959 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:57.997483 14365 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:16:58.191295 14572 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.164940 14230 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.191946 14572 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.192395 14572 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.193979 10588 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:58.195948 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:58.187813 14524 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.189169 11415 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.191249 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:58.169865 14204 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:16:58.188344 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 87547.2us
I20260709 13:16:58.157343 14363 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:58.197993 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:58.198523 10586 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:16:58.209879 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:58.197670 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.227435 10594 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:58.210996 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:58.208489 10592 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:58.199591 14424 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.258863 14424 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.206218 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:58.198746 14551 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.199661 14587 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:58.254467 14594 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.261593 14594 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.263993 14594 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:58.210883 14572 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.266706 14230 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.267295 14572 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:58.268100 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 122589us
I20260709 13:16:58.268661 14230 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:58.268837 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:58.198746 14515 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.269255 14537 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.269652 14537 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:58.269533 14515 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.270417 14537 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.230741 14336 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.271538 14515 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.271633 14336 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.257941 13959 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.259224 14424 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:58.277643 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 238011us
I20260709 13:16:58.188220 14570 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:58.197290 14074 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:58.298424 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:58.299877 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.300608 10742 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:58.289463 14594 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.200326 14507 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.307121 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:16:58.303158 14499 consensus_meta.cc:287] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.004s
I20260709 13:16:58.306739 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.308151 10740 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:58.291802 14230 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:58.256400 14582 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.309257 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:58.314232 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:58.310066 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.310860 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:58.311555 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:58.318042 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.319253 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:58.312697 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.320557 10590 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:58.326790 14511 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:58.327270 14511 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:58.329509 14340 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:58.329988 14340 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:58.330967 14340 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.338828 14589 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.340384 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.344455 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:58.345110 10737 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.346530 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.349365 11418 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:58.354226 10739 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.347254 10736 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:16:58.357371 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.358140 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.359871 10734 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.366238 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:58.368973 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.372999 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:58.375829 11412 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:58.339342 14589 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.313010 14587 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.369635 11382 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:58.380499 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.381065 10743 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:58.299649 14074 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.355480 14572 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.379177 14499 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:58.384099 14570 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.386281 14336 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:58.387248 14489 consensus_meta.cc:287] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.003s
I20260709 13:16:58.350656 14230 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.312880 14594 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.394104 14587 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.396603 14582 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:58.323941 14332 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:58.406904 10585 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:16:58.424409 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:58.425064 14211 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:58.425647 14247 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:58.398608 14507 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.426578 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:58.468428 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 44121.6us
I20260709 13:16:58.427060 14204 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:58.427237 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.430506 14503 raft_consensus.cc:993] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:16:58.432459 10660 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.476605 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.477275 10660 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:58.478232 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:58.428742 14496 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:58.437966 10667 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:58.463233 14336 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.482359 14336 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:58.482791 14336 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:58.446734 10489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 197) took 24247 ms (client timeout 15000 ms). Trace:
I20260709 13:16:58.461910 10737 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:58.406116 14572 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.409862 14499 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.473572 10664 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.474987 10632 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:58.478814 10660 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.479180 11381 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:58.480111 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:58.459390 14489 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:58.523690 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44607.2us
I20260709 13:16:58.481626 14582 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:58.531311 14525 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.473544 14211 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.535090 14637 raft_consensus.cc:1081] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:16:58.536212 14637 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:58.534528 14525 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.537626 14525 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.537931 14424 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.539130 10742 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:58.485843 14524 raft_consensus.cc:2764] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 13:16:58.483502 10489 rpcz_store.cc:269] 0709 13:16:34.199470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.199801 (+   331us) service_pool.cc:224] Handling call
0709 13:16:58.446426 (+24246625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.975054 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.975608 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.975643 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:52.975665 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:53.006807 (+ 31142us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:53.006860 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:53.006885 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:16:53.008244 (+  1359us) tablet.cc:701] Row locks acquired
0709 13:16:53.008263 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:53.008398 (+   135us) write_op.cc:270] Start()
0709 13:16:53.008500 (+   102us) write_op.cc:276] Timestamp: P: 1783603013008355 usec, L: 0
0709 13:16:53.008519 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:53.013618 (+  5099us) log.cc:844] Serialized 8219 byte log entry
0709 13:16:53.490111 (+476493us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b180006c820. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:54.200210 (+710099us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.240780 (+ 40570us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b180006c820. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc522 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:16:54.660786 (+420006us) write_op.cc:301] APPLY: starting
0709 13:16:54.692776 (+ 31990us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.693505 (+   729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.693555 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.760120 (+ 66565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.760521 (+   401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:16:54.760566 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:54.761102 (+   536us) log.cc:844] Serialized 145 byte log entry
0709 13:16:54.761284 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.874372 (+113088us) write_op.cc:454] Released schema lock
0709 13:16:54.910731 (+ 36359us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:55.000640 (+ 89909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:55.002124 (+  1484us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4491851,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":416552,"apply.run_cpu_time_us":10514,"apply.run_wall_time_us":341087,"num_ops":21,"prepare.queue_time_us":206786,"prepare.run_cpu_time_us":7320,"prepare.run_wall_time_us":199660,"raft.queue_time_us":582783,"raft.run_cpu_time_us":40651,"raft.run_wall_time_us":422884,"replication_time_us":1172967,"spinlock_wait_cycles":251819648,"thread_start_us":904147,"threads_started":4,"wal-append.queue_time_us":1032,"wal-append.run_cpu_time_us":16813,"wal-append.run_wall_time_us":2279457}]]}
I20260709 13:16:58.535144 14582 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.543520 14230 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:58.544133 14230 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.544514 14230 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.544837 14230 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.546535 14589 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.549744 14615 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:58.523231 14499 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.550916 14640 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.553126 14525 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:58.554204 14625 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:58.557440 14525 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.485999 14624 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.560281 14332 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.562345 14493 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:58.562727 14493 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:16:58.563402 14493 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.564904 14493 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.524250 14572 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.572228 14064 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:58.575244 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 100354us
I20260709 13:16:58.576403 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:58.596580 14640 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.596866 14074 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.474356 14365 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.601445 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.601980 10737 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:58.606102 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.609683 10737 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:58.611204 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.611943 10737 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:16:58.613327 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:58.618695 10660 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:58.594485 14641 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.639812 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:58.640972 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:58.641975 10739 raft_consensus.cc:2393] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:58.642308 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.639971 14365 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.644279 10740 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:58.602947 14640 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:58.645501 14365 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:58.643147 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:58.650218 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:58.651880 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.673470 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:58.665158 10735 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
W20260709 13:16:58.665773 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 64212.6us
W20260709 13:16:58.679515 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.688450 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 309669us
W20260709 13:16:58.688876 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 381800us
I20260709 13:16:58.690128 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:58.675693 10632 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:58.699632 10585 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:16:58.796119 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59170.9us
I20260709 13:16:58.812484 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:16:58.818028 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.824062 10585 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:58.646411 14074 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:16:58.827029 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.708503 14641 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:58.735314 14610 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.835016 10593 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
W20260709 13:16:58.836037 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 487511us
I20260709 13:16:58.809110 14425 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.795815 14204 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.813804 14525 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.841166 14624 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:58.889657 14204 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.837401 14610 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.891289 14610 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.892066 14204 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:58.846158 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:58.893674 10742 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:16:58.846736 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:58.894696 10737 raft_consensus.cc:3060] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.851611 10664 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
W20260709 13:16:58.898170 14642 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:16:58.899092 14587 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:58.851929 14061 consensus_meta.cc:287] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.000s
I20260709 13:16:58.906486 10665 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:16:58.852573 11410 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:58.854465 10593 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:58.861864 10735 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:16:58.908478 10735 pending_rounds.cc:85] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 7
I20260709 13:16:58.908752 10735 pending_rounds.cc:107] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:58.908978 10735 raft_consensus.cc:2889] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.911098 14507 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:58.912221 14424 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:16:58.882640 14634 log.cc:927] Time spent T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:58.914067 14424 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.914160 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 463) took 1011 ms. Trace:
I20260709 13:16:58.646196 14640 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.914793 14424 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:58.915314 14424 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:58.916204 14424 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:58.914562 10589 rpcz_store.cc:276] 0709 13:16:57.903061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.903182 (+   121us) service_pool.cc:224] Handling call
0709 13:16:57.913440 (+ 10258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:57.923835 (+ 10395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.923869 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.928046 (+  4177us) log.cc:844] Serialized 26 byte log entry
0709 13:16:58.350954 (+422908us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:58.350996 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.351060 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.913941 (+562881us) raft_consensus.cc:1685] finished
0709 13:16:58.913966 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.914098 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16212,"raft.queue_time_us":11194,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5157,"thread_start_us":373002,"threads_started":1,"wal-append.queue_time_us":663773}
I20260709 13:16:58.921615 14651 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:58.922196 14651 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.889720 14525 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:58.927871 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.928766 10737 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:58.929883 11382 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:58.829098 14529 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.937822 14646 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:16:58.942461 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.941399 14376 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.792649 14644 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.227s
I20260709 13:16:58.946529 14376 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.839776 14641 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:58.967109 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.964079 10738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.027s	sys 0.049s
W20260709 13:16:58.971014 10738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.028s	sys 0.049s
I20260709 13:16:58.971920 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2140) took 1711 ms. Trace:
I20260709 13:16:58.926155 14489 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.934161 14488 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:16:58.971027 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 443142us
I20260709 13:16:58.975649 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:58.984014 10589 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:58.945160 14508 raft_consensus.cc:2804] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.924062 14651 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:58.943658 14587 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.974218 14397 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.985944 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:58.994102 10662 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.997531 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2327) took 1096 ms. Trace:
I20260709 13:16:58.999195 10665 rpcz_store.cc:276] 0709 13:16:57.901140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.919357 (+ 18217us) service_pool.cc:224] Handling call
0709 13:16:58.997342 (+1077985us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:16:58.997466 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997167488}
I20260709 13:16:58.972406 10738 rpcz_store.cc:276] 0709 13:16:57.260586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.628360 (+367774us) service_pool.cc:224] Handling call
0709 13:16:57.628655 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.628861 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:58.150980 (+522119us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.971476 (+820496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.971549 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:58.971597 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.971722 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.971857 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104762,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":254674,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4979,"thread_start_us":1282837,"threads_started":3,"wal-append.queue_time_us":514854}
W20260709 13:16:59.005206 10669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.035s
W20260709 13:16:59.006421 10669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.010s	sys 0.035s
I20260709 13:16:58.944069 14529 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:58.977033 14572 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.002635 14645 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:59.021528 14605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.013s	sys 0.037s
I20260709 13:16:59.010424 14525 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.003115 14587 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.034519 14635 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:16:59.060643 14605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.013s	sys 0.038s
I20260709 13:16:59.055439 14621 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.081449 14621 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.083407 14621 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.074153 14641 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:59.079579 14230 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.002s
W20260709 13:16:59.084197 14336 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.000s
W20260709 13:16:59.084506 14064 consensus_meta.cc:287] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:16:59.084372 14230 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.086355 14230 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.080518 14618 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:16:59.080650 14061 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:59.087533 14061 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:59.087152 10488 catalog_manager.cc:5697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 3 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 8 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.088353 14061 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.089308 10488 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 5, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 5 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.084656 14336 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.087270 14376 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.092157 10488 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 9, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:59.093698 14336 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.093894 10488 catalog_manager.cc:5697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:16:59.097831 14635 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.096921 10488 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 9, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.100270 14635 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.035779 14499 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:59.069916 14332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.029s	sys 0.049s
I20260709 13:16:59.100852 10488 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 9, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:16:59.101570 14332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.029s	sys 0.049s
I20260709 13:16:59.102250 14499 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:16:59.112833 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.113675 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 463527us
I20260709 13:16:59.115175 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.115916 10742 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:59.126708 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.127301 10743 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:16:59.065953 14582 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.134524 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.178624 10585 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:16:59.179770 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:59.144598 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:59.181946 10590 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:59.144881 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:59.144344 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.144532 10588 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:59.136049 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:16:59.184654 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48877.5us
I20260709 13:16:59.186942 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.181145 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:59.144763 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 318709us
I20260709 13:16:59.135135 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.151403 10738 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:59.152323 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:59.152336 10737 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:59.223752 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71509.9us
I20260709 13:16:59.224675 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:16:59.247082 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.126101 14336 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.254248 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.254637 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:59.259846 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:59.259953 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:16:59.255548 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45439.9us
I20260709 13:16:59.256870 10632 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.261935 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:59.262388 14624 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:59.262852 14624 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:59.261446 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.263792 14624 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.279929 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.281767 10743 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.283311 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.191286 14380 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.188532 14582 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.306063 14489 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.069689 14645 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.188864 14594 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.306087 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.320230 10738 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:59.087113 14618 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.280227 14524 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.210121 14641 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.191897 14363 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.255028 14619 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.258878 14537 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.150559 14551 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.158s
I20260709 13:16:59.128931 14652 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:16:59.347170 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.279119 14651 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.283950 14332 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.365972 10593 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:16:59.150669 14230 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 13:16:59.311904 14582 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.257812 13959 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:16:59.311282 14489 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:59.321556 14425 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:59.307873 14654 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:59.326797 14666 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.362414 14616 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.284192 14336 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:59.402035 14658 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:59.405552 14587 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.406682 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa932526573f47178aa5a402a17388ad"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:16:59.407882 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.423197 10589 raft_consensus.cc:606] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.423565 10589 raft_consensus.cc:614] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.423997 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:59.421862 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.426749 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.427461 10666 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:16:59.323663 14204 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:16:59.318127 14380 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.444172 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:16:59.430428 10741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.010s	sys 0.010s
I20260709 13:16:59.431747 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.433638 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.449597 10668 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:59.451395 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.452356 10668 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:16:59.453449 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:59.455060 10741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.010s	sys 0.010s
I20260709 13:16:59.428224 14529 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.399776 14489 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.458498 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:59.463451 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.499882 10736 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.500979 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.388234 14074 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:16:59.399614 14641 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:59.400302 14425 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.366775 14363 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.471035 14654 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:59.437826 14365 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:16:59.471905 10740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.010s	sys 0.059s
W20260709 13:16:59.484150 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 498266us
W20260709 13:16:59.525031 10740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.011s	sys 0.060s
I20260709 13:16:59.438223 14573 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:59.423434 14524 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:59.361958 14064 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:16:59.494114 10667 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:59.384174 14652 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:59.527830 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 258419us
I20260709 13:16:59.423214 14666 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:16:59.495456 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.019s	sys 0.025s
W20260709 13:16:59.469980 14640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.014s	sys 0.053s
I20260709 13:16:59.517449 14641 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.394593 14332 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.502061 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.426169 14660 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:16:59.483204 14572 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.482813 14488 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.471392 14507 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.519856 10735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.026s	sys 0.008s
W20260709 13:16:59.583089 10735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.026s	sys 0.008s
I20260709 13:16:59.438709 14616 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.494922 14508 raft_consensus.cc:697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:59.512172 14515 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:59.471313 14621 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:16:59.517566 14425 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.535236 10591 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:16:59.482600 10663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:16:59.594579 10663 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.594969 10663 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:59.534468 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.019s	sys 0.025s
W20260709 13:16:59.595927 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 905821us
I20260709 13:16:59.582592 14488 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.596318 14645 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.597656 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:59.516049 14529 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:59.598986 14529 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.599376 14529 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.600240 14380 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.604097 14508 consensus_queue.cc:237] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.606381 14332 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.608770 14674 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:59.609148 14674 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:59.609684 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.609911 14674 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:59.525923 14663 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:16:59.536587 10632 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.543339 10738 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:59.611028 14674 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.549249 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:59.611961 11418 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:59.549418 11412 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:59.612344 14488 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.573148 10590 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:16:59.541189 14640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.014s	sys 0.053s
I20260709 13:16:59.613003 14336 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.536978 14666 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.530181 14524 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:16:59.614543 14524 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.616068 14524 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.616487 14652 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.530413 14573 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.617514 14573 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.617051 14654 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:16:59.519608 14637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.010s	sys 0.010s
I20260709 13:16:59.546761 14525 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.583628 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2323) took 1703 ms. Trace:
I20260709 13:16:59.627714 10662 rpcz_store.cc:276] 0709 13:16:57.880098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.915200 (+ 35102us) service_pool.cc:224] Handling call
0709 13:16:57.915985 (+   785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.002986 (+1087001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.583342 (+580356us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400269dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:16:59.583553 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2478991104}
I20260709 13:16:59.629052 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:59.629808 10662 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.610270 10588 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:16:59.612500 10592 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:16:59.631108 10592 pending_rounds.cc:85] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 5
I20260709 13:16:59.631361 10592 pending_rounds.cc:107] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:16:59.631577 10592 raft_consensus.cc:2889] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.540457 10736 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:16:59.548962 14496 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.622678 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:16:59.596395 14657 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:16:59.571017 14587 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:16:59.672837 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.633220 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.633863 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:16:59.657711 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.673714 10738 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
W20260709 13:16:59.647794 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.585496 14649 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:59.666747 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 376738us
I20260709 13:16:59.594005 14371 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:59.685883 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 52090.7us
I20260709 13:16:59.680461 10662 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:16:59.688046 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 151550us
I20260709 13:16:59.688333 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.688453 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.688977 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.689350 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:16:59.690493 10594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.015s	sys 0.026s
W20260709 13:16:59.691534 10594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.015s	sys 0.026s
I20260709 13:16:59.690439 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.642326 14496 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.589498 14507 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.701166 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.701813 10588 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:16:59.627184 14527 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:16:59.690356 11381 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:16:59.692435 10662 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:16:59.705072 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.706180 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.628733 14618 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.706781 10662 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:59.707363 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:59.707614 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.708227 10662 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:59.708978 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.699510 11415 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:59.657879 14204 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.673771 14652 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.703356 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:16:59.693190 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.704128 10663 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.674024 14676 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:59.571833 14511 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.482961 10488 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 10 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.716810 10663 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.699935 14496 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.642632 14525 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.705874 14640 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:59.718704 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.717335 14204 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.728430 14641 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.729234 14204 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.730942 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:16:59.732084 14644 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.732456 14644 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.732771 14644 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:59.733409 14662 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 13:16:59.733584 14672 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:59.735930 14664 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:16:59.736901 14671 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:16:59.737972 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2160) took 1396 ms. Trace:
I20260709 13:16:59.738394 10663 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:59.738497 10741 rpcz_store.cc:276] 0709 13:16:58.342055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.343057 (+  1002us) service_pool.cc:224] Handling call
0709 13:16:58.343372 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.651567 (+308195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.651593 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.652045 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.492137 (+840092us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:59.492526 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.492623 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.737767 (+245144us) raft_consensus.cc:1685] finished
0709 13:16:59.737793 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.737922 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":297539,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":5062,"thread_start_us":958098,"threads_started":2,"wal-append.queue_time_us":807632}
W20260709 13:16:59.740958 14675 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:59.741906 14678 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.742326 14678 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.742635 14525 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.720431 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.744438 14652 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.744971 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.745987 10588 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:16:59.707316 14336 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.746835 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.747254 14508 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:59.747429 14507 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.747777 14508 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:16:59.747815 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.748342 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1721) took 1050 ms. Trace:
I20260709 13:16:59.748768 14508 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.749632 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2077) took 1325 ms. Trace:
I20260709 13:16:59.748687 10587 rpcz_store.cc:276] 0709 13:16:58.697890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.698039 (+   149us) service_pool.cc:224] Handling call
0709 13:16:58.807401 (+109362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.818242 (+ 10841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.818282 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.825106 (+  6824us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.111838 (+286732us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b180027fe20. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:16:59.586934 (+475096us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:59.586986 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.587076 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.748073 (+160997us) raft_consensus.cc:1685] finished
0709 13:16:59.748104 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.748290 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12777,"raft.queue_time_us":12585,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10063,"spinlock_wait_cycles":197152512,"thread_start_us":474888,"threads_started":1,"wal-append.queue_time_us":907003}
I20260709 13:16:59.744442 10488 catalog_manager.cc:5697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 3 to 4, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 4 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.750003 10669 rpcz_store.cc:276] 0709 13:16:58.424235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.424457 (+   222us) service_pool.cc:224] Handling call
0709 13:16:58.424847 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.425255 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.425288 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.425819 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.007602 (+581783us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:59.007656 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.007732 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.749384 (+741652us) raft_consensus.cc:1685] finished
0709 13:16:59.749404 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.749557 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6494,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":581283,"threads_started":1,"wal-append.queue_time_us":757717}
I20260709 13:16:59.751803 10669 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 9. Ops: []
I20260709 13:16:59.752516 14682 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.751725 10488 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 5, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 5 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.753039 14682 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:16:59.753849 14669 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:16:59.733448 14667 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.755275 14682 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.755491 14363 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.756111 11410 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:59.756574 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.759207 14667 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.759538 14616 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:16:59.759703 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1603) took 1144 ms. Trace:
I20260709 13:16:59.754839 10488 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 2 to 7, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), now has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:59.760030 10740 rpcz_store.cc:276] 0709 13:16:58.615284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.645179 (+ 29895us) service_pool.cc:224] Handling call
0709 13:16:58.647849 (+  2670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.648167 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:58.648216 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.648680 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.525413 (+876733us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:59.525458 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.525639 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.759492 (+233853us) raft_consensus.cc:1685] finished
0709 13:16:59.759512 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.759644 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":188096,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":82595,"thread_start_us":876424,"threads_started":1,"wal-append.queue_time_us":947206}
W20260709 13:16:59.718537 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.764406 14684 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:59.764052 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.764295 14644 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.766069 10665 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.767016 14667 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.738809 10663 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:16:59.769136 10662 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:16:59.769529 10662 pending_rounds.cc:85] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 9
I20260709 13:16:59.771656 10662 pending_rounds.cc:107] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:16:59.771942 10662 raft_consensus.cc:2889] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:59.774637 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.764451 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:16:59.737911 14670 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:59.701103 14551 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:59.770936 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:16:59.790428 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64006.3us
I20260709 13:16:59.769670 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1604) took 1130 ms. Trace:
I20260709 13:16:59.791318 10739 rpcz_store.cc:276] 0709 13:16:58.638933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.645902 (+  6969us) service_pool.cc:224] Handling call
0709 13:16:58.646241 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.646622 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.646657 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.647459 (+   802us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.232345 (+584886us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:59.232399 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.232485 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.769463 (+536978us) raft_consensus.cc:1685] finished
0709 13:16:59.769481 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.769614 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175543,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":9610,"thread_start_us":438633,"threads_started":1,"wal-append.queue_time_us":824519}
I20260709 13:16:59.769517 10663 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.792728 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.793946 10663 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:59.779214 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.779214 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.796056 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:16:59.801273 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.803221 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:16:59.807078 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:59.807628 11413 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:16:59.808369 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:16:59.808897 11411 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.810998 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:59.742660 14678 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.816176 10663 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:16:59.726895 14640 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:16:59.820989 10663 pending_rounds.cc:85] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 8
I20260709 13:16:59.809954 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:16:59.823098 10663 pending_rounds.cc:107] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:16:59.823721 10663 raft_consensus.cc:2889] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.822938 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.723105 14376 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:16:59.797184 14643 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.830241 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:16:59.833087 14687 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:16:59.834898 14496 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.806828 14397 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.842381 14666 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.847126 14204 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.806277 14624 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:59.852715 10739 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:16:59.825491 14640 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.839181 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.824021 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:16:59.858706 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.871585 10738 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:16:59.859593 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:16:59.871737 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 47785.9us
I20260709 13:16:59.872025 10743 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.818848 14667 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.855754 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.866279 10593 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:16:59.876164 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:16:59.866276 11411 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:59.867147 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:16:59.873957 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:16:59.828379 14649 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:59.877674 10588 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:59.879254 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:16:59.851117 14643 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.883720 10660 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:16:59.869485 14527 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:16:59.876825 14424 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.887074 14529 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.837155 14582 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:16:59.889443 14582 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:16:59.890276 11418 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:16:59.890445 14496 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.864781 14204 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:59.874740 14605 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:59.890969 14204 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.830551 14497 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:16:59.892437 14643 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:59.875090 14610 consensus_meta.cc:287] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.983s	user 0.013s	sys 0.000s
I20260709 13:16:59.900897 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:59.944285 10667 raft_consensus.cc:2410] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:16:59.901528 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.911618 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:59.945590 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.946230 10662 raft_consensus.cc:2368] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:16:59.946897 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:59.947405 10662 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.889106 14529 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.869900 14644 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.941773 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.950948 10708 leader_election.cc:400] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:16:59.955739 10708 leader_election.cc:403] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:59.948138 10665 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:16:59.919962 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.959820 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:16:59.865507 14336 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:16:59.881217 14649 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:16:59.977929 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:16:59.978446 10661 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.977201 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:16:59.973461 10743 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:16:59.896960 14340 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:59.883956 14397 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:16:59.986433 14424 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.990980 14424 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.994552 14211 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.996011 14635 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.996402 14635 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.009709 14656 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.010478 14656 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:00.010972 14656 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:00.012712 14337 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:00.015941 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:00.024657 14676 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.037931 14697 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:17:00.039230 14489 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 13:17:00.039691 14489 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.952677 14610 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.042493 10666 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:00.016995 10660 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:16:59.985991 10669 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:59.789621 10488 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:16:59.897486 14573 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.071583 14573 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:00.072459  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:00.074471 11415 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:00.074846  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:00.076267 14371 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:00.076728 14371 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.077237 14690 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:00.077806 14644 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:00.077968 14247 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:00.078347 14644 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.078590 14247 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.079361 14605 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:00.080415 14644 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:00.048178 14397 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.058382 14653 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:00.084738 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.090852 10738 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:00.091846 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.092485 10738 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:00.094866 10740 raft_consensus.cc:2410] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:00.095885 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.096810 10738 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:00.097772 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:00.098902 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.100579 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.102845 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:00.104187 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:00.106036 14061 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.077833 14690 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.108367 14690 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:16:59.982427 14652 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.121882 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.122195 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.123045 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.123584 10737 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:00.123699 14515 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.124444 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:00.124493 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2166) took 1010 ms. Trace:
I20260709 13:17:00.127002 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1725) took 1414 ms. Trace:
I20260709 13:17:00.127388 14365 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.127921 14365 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.127465 10594 rpcz_store.cc:276] 0709 13:16:58.712827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.740550 (+ 27723us) service_pool.cc:224] Handling call
0709 13:16:58.740889 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.741098 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:59.135367 (+394269us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.126620 (+991253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.126682 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.126738 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.126812 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.126939 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434665,"prepare.queue_time_us":123221,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":437399,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":870232,"threads_started":2,"wal-append.queue_time_us":589827}
I20260709 13:17:00.123548 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:00.131542 10736 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.128710 14365 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.123535 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:16:59.985288 14649 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.152114 10559 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:00.125056 10734 rpcz_store.cc:276] 0709 13:16:59.114170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.114288 (+   118us) service_pool.cc:224] Handling call
0709 13:16:59.114583 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.535445 (+420862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.535475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.535843 (+   368us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.785857 (+250014us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:59.954608 (+168751us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.964704 (+ 10096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.124031 (+159327us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400141254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:00.124094 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.124147 (+    53us) raft_consensus.cc:1685] finished
0709 13:17:00.124260 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.124431 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20361,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":69,"spinlock_wait_cycles":967346944,"thread_start_us":348281,"threads_started":2,"wal-append.queue_time_us":261427}
I20260709 13:16:59.974320 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:00.081105 14247 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:00.162837 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:00.075325 14425 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.993237 14424 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:00.165155 10734 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:00.166343 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1727) took 1350 ms. Trace:
W20260709 13:17:00.166917 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.165068 14496 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:00.025357 14676 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.124580 14515 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:16:59.997121 14635 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.090540 14397 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:00.090518 14653 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.064579 10488 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 8 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.180864 10559 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:00.223165 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:00.273491 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50432.3us
W20260709 13:17:00.273602 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 92807.2us
I20260709 13:17:00.259143 10738 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.274838 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:00.173276 10736 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:00.186916 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:00.189847 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:00.191394 10591 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:17:00.205125 10592 rpcz_store.cc:276] 0709 13:16:58.815821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.817221 (+  1400us) service_pool.cc:224] Handling call
0709 13:16:58.817921 (+   700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.631957 (+814036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.166078 (+534121us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54001bfb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:00.166277 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826687232}
I20260709 13:17:00.276175 10662 raft_consensus.cc:2410] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:00.240572 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:00.217464 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.277926 10592 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:00.214219 10666 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:00.220681 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:00.276203 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:00.346398 10739 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:00.346832 10739 pending_rounds.cc:85] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 8
I20260709 13:17:00.347086 10739 pending_rounds.cc:107] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:00.347311 10739 raft_consensus.cc:2889] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.288406 10743 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:00.348583 10591 pending_rounds.cc:85] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 10
I20260709 13:17:00.047385 14643 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.276576 10588 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:00.361845 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 85710.4us
I20260709 13:17:00.385118 10591 pending_rounds.cc:107] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:00.389583 10591 raft_consensus.cc:2889] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.388850 10736 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:00.224115 14616 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.347764 14591 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.394008 14591 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.173892 14641 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:00.394476 14591 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.394701 14641 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.396991 14641 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:00.398567 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:00.227470 14666 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:00.279040 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 64060.8us
I20260709 13:17:00.324138 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:00.329540 10738 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:00.404688 10594 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.214694 14621 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:00.189183 14701 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:17:00.178534 14637 raft_consensus.cc:3055] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:00.176025 14503 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.407670 10738 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:00.222882 14676 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:00.355962 14572 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:00.173578 14337 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.415812 10736 raft_consensus.cc:1275] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:00.390172 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:00.355755 14332 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.185377 14573 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.239s
I20260709 13:17:00.392256 14489 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:00.346693 14497 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.226771 14496 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.387821 14618 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.377732 14622 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.377987 14645 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.430349 10669 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:00.377770 14525 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:00.393064 14587 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.425060 10738 pending_rounds.cc:85] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:17:00.402773 14616 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.181452 14678 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:00.470651 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 80587.4us
I20260709 13:17:00.463253 14572 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.478366 14666 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.485272 10738 pending_rounds.cc:107] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:00.397679 14380 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:17:00.495862 14618 consensus_queue.cc:1059] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:00.428356 14667 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:00.497923 14667 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.500267 14667 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:00.500787 10738 raft_consensus.cc:2889] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.501055 14496 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.482038 14643 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:00.424762 14503 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.397809 14589 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:17:00.466558 14332 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.424554 14637 raft_consensus.cc:740] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:00.491470 10668 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:00.492668 10635 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:00.465677 14672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.082s	sys 0.164s
I20260709 13:17:00.512107 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:00.435380 14247 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:17:00.482415 14497 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.537673 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:00.464274 14211 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:00.430936 14621 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.528962 11417 raft_consensus.cc:2368] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13.
I20260709 13:17:00.534403 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:00.534934 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:00.428247 14653 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.517371 14503 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.548035 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:00.549208 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:00.567951 10594 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:00.569188 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:00.494330 14587 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.531553 14674 raft_consensus.cc:2804] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:00.563772 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:00.592227 11410 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:00.558983 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:00.522325 14332 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.490803 14645 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.599416 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:00.551106 10742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.009s	sys 0.007s
W20260709 13:17:00.600924 10742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.009s	sys 0.007s
I20260709 13:17:00.603689 11416 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.468415 14337 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:00.541970 14204 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
W20260709 13:17:00.580780 10661 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.000s
I20260709 13:17:00.616752 10661 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:00.575863 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:00.539902 14572 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.522398 14610 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:00.589071 10741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.020s
I20260709 13:17:00.590155 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:00.529752 14672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.082s	sys 0.164s
W20260709 13:17:00.566493 14508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.008s
I20260709 13:17:00.506172 14622 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.493996 14525 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.569976 10594 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:00.536906 14666 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:17:00.618985 10741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.005s	sys 0.020s
I20260709 13:17:00.537163 14643 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:17:00.596781 14707 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.595860 14653 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.599574 14644 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:00.631323 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55542.8us
W20260709 13:17:00.631790 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.642273 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:00.640225 14703 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:17:00.647579 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:00.623611 14508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.009s	sys 0.009s
W20260709 13:17:00.650224 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.650264 10588 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:00.653074 10632 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:00.653986 14690 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:00.654462 14690 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:00.655323 14690 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.604282 14637 consensus_queue.cc:260] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.657310 14511 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.628665 14610 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.659219 14610 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:00.661697 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 603) took 1130 ms. Trace:
I20260709 13:17:00.662083 11414 rpcz_store.cc:276] 0709 13:16:59.531759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.531870 (+   111us) service_pool.cc:224] Handling call
0709 13:16:59.532145 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.705120 (+172975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.705239 (+   119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.717279 (+ 12040us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.883050 (+165771us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:59.883084 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.883141 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.661500 (+778359us) raft_consensus.cc:1685] finished
0709 13:17:00.661518 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.661642 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9563,"raft.queue_time_us":43970,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6560,"thread_start_us":249811,"threads_started":2,"wal-append.queue_time_us":636677}
I20260709 13:17:00.663457 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.625550 14204 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.664018 10743 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:00.664945 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.665963 14204 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:00.668581 10743 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:00.669555 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:00.675355 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 285801us
I20260709 13:17:00.631103 14654 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:00.691825 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44352.8us
I20260709 13:17:00.696275 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:00.708452 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:00.709499 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 342913us
W20260709 13:17:00.712320 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 331955us
W20260709 13:17:00.695278 14340 consensus_meta.cc:287] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.001s
I20260709 13:17:00.717017 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:00.715714 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:00.528673 10488 catalog_manager.cc:5697] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 1 to 6, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:00.649550 14709 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:00.698226 14424 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:00.696985 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 394073us
W20260709 13:17:00.758446 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 82235.1us
W20260709 13:17:00.782603 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65685.1us
I20260709 13:17:00.714802 14489 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:00.651432 14707 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:00.806126 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:00.718477 14397 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.801481 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:00.804980 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:00.859872 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54952us
I20260709 13:17:00.799417 14064 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.831813 14489 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.714561 14667 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:17:00.807013 14709 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.848136 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:00.785790 14676 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:00.858156 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.833386 14616 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:00.834149 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:00.791467 14615 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:17:00.831954 14497 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:17:00.851910 14589 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.957854 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:00.991719 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 157644us
I20260709 13:17:00.885488 14424 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.006440 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:00.884198 14678 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:00.953364 14489 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:01.030741 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 146938us
W20260709 13:17:01.025930 11381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.031s	sys 0.059s
W20260709 13:17:01.080248 11381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.032s	sys 0.060s
W20260709 13:17:01.080606 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 704485us
W20260709 13:17:01.064873 14652 consensus_meta.cc:287] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.012s
I20260709 13:17:01.058899 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:00.866694 14508 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:17:00.997391 14397 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:01.044121 14711 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:17:01.074756 10660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.010s	sys 0.032s
W20260709 13:17:01.098444 10660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.011s	sys 0.033s
W20260709 13:17:01.098670 10706 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 1.968s (SENT) [suppressed 21 similar messages]
I20260709 13:17:01.076330 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:00.953182 14064 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.084592 10663 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:01.090134 14706 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.422s	user 0.001s	sys 0.000s
I20260709 13:17:01.089389 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.039242 14610 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.000546 14616 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:17:01.113699 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.090127 14496 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:01.094214 14365 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.060333 14587 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.073617 14572 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.101862 14707 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.098518 14719 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:01.103813 14710 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:17:01.104516 14718 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:01.125054 14496 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.105861 14714 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:01.107945 14652 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:01.108443 14721 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:01.043247 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:01.075287 14645 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.075958 14424 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.110553 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.109216 14397 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:01.144838 14640 consensus_meta.cc:287] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 1.262s	user 0.007s	sys 0.004s
I20260709 13:17:01.089272 14674 raft_consensus.cc:697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:01.125108 10661 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.091446 14525 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.128350 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.042534 14332 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.130329 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.203156 10662 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.042610 14676 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:01.195045 10663 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:01.206215 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.098852 14337 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.136561 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.208797 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.095896 14529 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:01.113729 14477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.024s	sys 0.035s
I20260709 13:17:01.103188 14667 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:01.111261 14605 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.103056 14582 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.105170 14712 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 13:17:01.108549 14376 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:17:01.155056 10743 raft_consensus.cc:2393] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:17:01.077045 14708 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:17:01.040983 14709 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.204109 10666 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.210454 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.247082 10663 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:01.209211 10664 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:17:01.242811 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 527104us
I20260709 13:17:01.218683 14676 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.251766 14709 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.252317 14676 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.225231 14529 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:01.253683  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.253809 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:01.254215 14529 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.244760 10662 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:01.194084 14424 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.257973 14508 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:01.258347 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1609) took 1406 ms. Trace:
I20260709 13:17:01.258514 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:01.258929 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:01.258734 10742 rpcz_store.cc:276] 0709 13:16:59.851978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.852385 (+   407us) service_pool.cc:224] Handling call
0709 13:16:59.852656 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.857829 (+  5173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.857858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.867273 (+  9415us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.889505 (+ 22232us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b4800011ad8. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:17:00.601891 (+712386us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.601970 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.602069 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.257917 (+655848us) raft_consensus.cc:1685] finished
0709 13:17:01.257935 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.258288 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4829,"raft.queue_time_us":5282,"raft.run_cpu_time_us":1884,"raft.run_wall_time_us":27985,"spinlock_wait_cycles":11231616,"thread_start_us":653008,"threads_started":1,"wal-append.queue_time_us":836842}
I20260709 13:17:01.260898 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.261680 10742 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:17:01.261925 14713 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.470s	user 0.000s	sys 0.005s
I20260709 13:17:01.263054 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1730) took 1564 ms. Trace:
I20260709 13:17:01.263350 14678 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.264433 14497 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:01.263394 10590 rpcz_store.cc:276] 0709 13:16:59.698822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.699838 (+  1016us) service_pool.cc:224] Handling call
0709 13:16:59.708437 (+  8599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.129661 (+421224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.129703 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.130188 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.533402 (+403214us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.533456 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.533545 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.655701 (+122156us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4800002958. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:17:01.261444 (+605743us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:01.262852 (+  1408us) raft_consensus.cc:1685] finished
0709 13:17:01.262872 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.263000 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420809,"raft.queue_time_us":441272,"raft.run_cpu_time_us":3271,"raft.run_wall_time_us":499098,"spinlock_wait_cycles":38372096,"thread_start_us":402752,"threads_started":1,"wal-append.queue_time_us":560692}
I20260709 13:17:01.265587 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.266702 14725 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:01.266875 10662 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:01.267102 14725 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:01.267720 14637 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.258342 14508 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.268649 14508 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:01.268947 14537 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:01.269579 14537 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.271670 14064 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.271878 14537 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:01.219309 14477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.024s	sys 0.035s
I20260709 13:17:01.273135 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 437) took 1190 ms. Trace:
I20260709 13:17:01.214859 14652 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:01.274147 14652 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:01.275100 14652 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:01.277058 14716 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 13:17:01.273561 11409 rpcz_store.cc:276] 0709 13:17:00.082269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.082740 (+   471us) service_pool.cc:224] Handling call
0709 13:17:00.083038 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.083375 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.083402 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.083801 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.550689 (+466888us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:00.550735 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.550815 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.272924 (+722109us) raft_consensus.cc:1685] finished
0709 13:17:01.272945 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.273072 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1016,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":18410,"thread_start_us":466529,"threads_started":1,"wal-append.queue_time_us":615761}
I20260709 13:17:01.278615 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 479) took 1086 ms. Trace:
W20260709 13:17:01.278697 14726 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:17:01.258949 14424 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.262598 10742 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:01.278993 10667 rpcz_store.cc:276] 0709 13:17:00.192713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.195680 (+  2967us) service_pool.cc:224] Handling call
0709 13:17:00.196040 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.196495 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.196534 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.197028 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.597423 (+400395us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:00.597460 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.597537 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.276546 (+679009us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:01.278358 (+  1812us) raft_consensus.cc:1685] finished
0709 13:17:01.278380 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.278562 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132012,"raft.queue_time_us":1074,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7055,"spinlock_wait_cycles":9149312,"thread_start_us":400031,"threads_started":1,"wal-append.queue_time_us":601058}
I20260709 13:17:01.283566 14508 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.238843 14616 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.286202 14616 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.288049 14508 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.288955 14622 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.242794 14582 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.291285 14424 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.291390 14582 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.291846 14424 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.238539 14667 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.292946 14332 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.202562 14640 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.267868 14725 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.353907 14725 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:01.354350 14728 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:01.356045 14572 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.146663 14496 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.358143 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1620) took 1006 ms. Trace:
I20260709 13:17:01.358543 10739 rpcz_store.cc:276] 0709 13:17:00.351431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.511066 (+159635us) service_pool.cc:224] Handling call
0709 13:17:00.511333 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.511567 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.511603 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.514991 (+  3388us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.700668 (+185677us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.700719 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.700807 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.357918 (+657111us) raft_consensus.cc:1685] finished
0709 13:17:01.357939 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.358087 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":154284,"threads_started":1,"wal-append.queue_time_us":614579}
I20260709 13:17:01.293872 14424 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.362303 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 477) took 1589 ms. Trace:
I20260709 13:17:01.340728 14667 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.349525 10665 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:01.249171 10663 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:01.241357 14605 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.259207 10743 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:01.295840 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1611) took 1442 ms. Trace:
I20260709 13:17:01.344998 10735 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:01.381557 10741 rpcz_store.cc:276] 0709 13:16:59.853579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.853687 (+   108us) service_pool.cc:224] Handling call
0709 13:16:59.853952 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.862881 (+  8929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.862909 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.863278 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.628528 (+765250us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.628595 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.628684 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.295585 (+666901us) raft_consensus.cc:1685] finished
0709 13:17:01.295613 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.295773 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8605,"raft.queue_time_us":9205,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":10134,"thread_start_us":731546,"threads_started":1,"wal-append.queue_time_us":903402}
W20260709 13:17:01.367668 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.021s	sys 0.041s
W20260709 13:17:01.385726 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.021s	sys 0.041s
I20260709 13:17:01.387550 14732 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.388116 14732 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.390308 14732 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.379277 10666 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:01.240511 10661 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:17:01.362973 14653 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 13:17:01.373250 10593 rpcz_store.cc:276] 0709 13:16:59.772823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.876293 (+103470us) service_pool.cc:224] Handling call
0709 13:16:59.876535 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.155694 (+279159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.155723 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.156180 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.550314 (+394134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:00.550366 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.550451 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.362117 (+811666us) raft_consensus.cc:1685] finished
0709 13:17:01.362139 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.362250 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276300,"raft.queue_time_us":298738,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":393757,"threads_started":1,"wal-append.queue_time_us":573389}
I20260709 13:17:01.357530 14589 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:01.362641 14635 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.340758 14640 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.432142 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:01.358201 14676 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.445966 10743 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:01.441766 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.021s	sys 0.034s
W20260709 13:17:01.451339 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.021s	sys 0.034s
W20260709 13:17:01.445910 11379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.041s	sys 0.079s
W20260709 13:17:01.452121 11379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.042s	sys 0.079s
W20260709 13:17:01.452306 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 658447us
I20260709 13:17:01.452900 11379 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:01.468108 14508 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:01.468664 14508 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:01.468752 14502 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.469240 14502 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.469580 14508 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:01.471979 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 389323us
I20260709 13:17:01.372370 14527 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.385524 14337 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.383667 14649 consensus_meta.cc:287] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.224s	user 0.011s	sys 0.000s
W20260709 13:17:01.459661 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 454303us
I20260709 13:17:01.383054 14643 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.393072 14340 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.430727 14667 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.438630 14589 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.439335 14424 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.477838 10743 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:01.538686 11382 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:01.481209 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:01.540668 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 59557.7us
I20260709 13:17:01.486619 14502 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:01.487370 14656 consensus_meta.cc:287] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 1.476s	user 0.011s	sys 0.001s
I20260709 13:17:01.492802 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:01.493501 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:01.493758 10668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2099) took 2052 ms (client timeout 1971 ms). Trace:
W20260709 13:17:01.544618 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 51885.2us
W20260709 13:17:01.532275 14511 consensus_meta.cc:287] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.001s
I20260709 13:17:01.500167 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:01.503031 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:01.472299 14371 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.395s	user 0.008s	sys 0.004s
I20260709 13:17:01.461611 14616 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.527275 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 481) took 1334 ms. Trace:
I20260709 13:17:01.535043 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.568071 10588 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.393656 14674 consensus_queue.cc:237] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.541990 10557 leader_election.cc:400] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13.
W20260709 13:17:01.544862 10668 rpcz_store.cc:269] 0709 13:16:59.441110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.453048 (+ 11938us) service_pool.cc:224] Handling call
0709 13:17:01.493589 (+2040541us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400368154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:01.493694 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385428736}
I20260709 13:17:01.544405 11412 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:01.497661 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:01.545866 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:01.456076 10661 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:01.571223 10593 raft_consensus.cc:2410] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:01.574465 11414 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
W20260709 13:17:01.572816 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 496558us
I20260709 13:17:01.568739 10660 rpcz_store.cc:276] 0709 13:17:00.193270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.209120 (+ 15850us) service_pool.cc:224] Handling call
0709 13:17:00.209610 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.241552 (+ 31942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.241596 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.242196 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.098964 (+856768us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:01.099153 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.099238 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.527033 (+427795us) raft_consensus.cc:1685] finished
0709 13:17:01.527060 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.527209 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31436,"raft.queue_time_us":136097,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":33443,"thread_start_us":856430,"threads_started":1,"wal-append.queue_time_us":1185890}
W20260709 13:17:01.569294 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 470614us
I20260709 13:17:01.502197 14582 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:01.574977 10743 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:01.580606 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.582213 10593 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:01.576738 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:01.573712 10557 leader_election.cc:403] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.567016 14709 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.578133 10587 raft_consensus.cc:3060] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.547536 14733 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.583206 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.508344 14737 consensus_queue.cc:1048] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:17:01.510224 14527 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.591029 10590 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:01.540270 14618 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.526381 14337 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.609701 14337 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.571938 14497 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:01.611157 14497 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:01.612845 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.613050 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.533969 14643 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.613829 10661 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
W20260709 13:17:01.588177 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 46371.3us
W20260709 13:17:01.593801 14730 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:17:01.594499 14729 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:01.528528 14649 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.534471 14332 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:01.460307 14676 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.544134 14424 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:01.597607 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 92193.5us
I20260709 13:17:01.601365 14589 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.541452 14667 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.606105 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:01.593192 14727 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:01.533499 14340 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:01.607229 14591 consensus_meta.cc:287] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.212s	user 0.011s	sys 0.002s
I20260709 13:17:01.613958 10668 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.579555 14660 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:01.617481 10588 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:01.589334 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:01.617481 10743 raft_consensus.cc:2468] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:01.676795 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.681437 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.592443 14739 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:01.574990 14371 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.571933 14656 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.703017 10737 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.708158 11416 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:01.708079 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:01.596280 14709 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.612224 14497 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.713740 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1748) took 1529 ms. Trace:
I20260709 13:17:01.714781 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1619) took 1363 ms. Trace:
I20260709 13:17:01.739964 10740 rpcz_store.cc:276] 0709 13:17:00.351172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.480082 (+128910us) service_pool.cc:224] Handling call
0709 13:17:00.480385 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.487785 (+  7400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.487820 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.495341 (+  7521us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.026476 (+531135us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.026531 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.026618 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.714600 (+687982us) raft_consensus.cc:1685] finished
0709 13:17:01.714621 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.714732 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8803,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20141,"thread_start_us":491761,"threads_started":1,"wal-append.queue_time_us":864192}
I20260709 13:17:01.742043 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.742914 10740 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:01.715698 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:01.738406 10592 rpcz_store.cc:276] 0709 13:17:00.183832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.278947 (+ 95115us) service_pool.cc:224] Handling call
0709 13:17:00.279269 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.521614 (+242345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.521652 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.531902 (+ 10250us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.083005 (+551103us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.083061 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.275754 (+192693us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540039dad4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:01.275797 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.713482 (+437685us) raft_consensus.cc:1685] finished
0709 13:17:01.713502 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.713685 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49068,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11888,"spinlock_wait_cycles":549924096,"thread_start_us":486472,"threads_started":1,"wal-append.queue_time_us":825200}
I20260709 13:17:01.750486 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:01.723133 14672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.012s	sys 0.008s
W20260709 13:17:01.764062 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 48469.7us
I20260709 13:17:01.721400 14511 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13.
I20260709 13:17:01.775125 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.775522 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.776825 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.778183 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.779014 10740 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:01.779850 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:01.780429 10740 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.783034 10734 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:01.770253 14672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.012s	sys 0.009s
I20260709 13:17:01.749591 14666 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:01.723661 14591 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.727010 14660 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.716500 10587 raft_consensus.cc:2468] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:01.783340 14742 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.722270 10666 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:01.724171 11382 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:01.812290 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88227.5us
I20260709 13:17:01.722558 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:01.725338 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 402159us
I20260709 13:17:01.815040 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.815584 10743 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:01.816319 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.816491 10737 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:01.725086 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.682646 14653 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:01.734218 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:01.732822 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51766.9us
I20260709 13:17:01.735877 11412 raft_consensus.cc:2410] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:17:01.737591 10589 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:01.775260 14425 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:01.798349 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2356) took 1252 ms. Trace:
I20260709 13:17:01.834952 10594 raft_consensus.cc:2368] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12.
I20260709 13:17:01.794104 14332 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.819702 11382 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:01.820302 10667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.007s
W20260709 13:17:01.850200 10667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.007s
W20260709 13:17:01.798245 10742 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.019s	sys 0.013s
I20260709 13:17:01.822212 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:01.826366 10734 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:01.828665 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:01.851027 10742 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.020s	sys 0.013s
I20260709 13:17:01.850970 10740 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:01.718870 14605 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.835119 10665 rpcz_store.cc:276] 0709 13:17:00.546273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.547355 (+  1082us) service_pool.cc:224] Handling call
0709 13:17:00.547689 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.373609 (+825920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.798084 (+424475us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400182c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:01.798260 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843585280}
I20260709 13:17:01.641052 14618 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:01.853834 14529 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.854772 14740 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:01.796301 14503 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.207s	user 0.008s	sys 0.004s
I20260709 13:17:01.855949 14503 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.858579 14503 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:01.734290 14739 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:01.848441 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 270131us
I20260709 13:17:01.848776 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 480) took 1655 ms. Trace:
I20260709 13:17:01.859649 10669 rpcz_store.cc:276] 0709 13:17:00.192993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.211953 (+ 18960us) service_pool.cc:224] Handling call
0709 13:17:01.848540 (+1636587us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002d9954. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:01.848710 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350802688}
I20260709 13:17:01.860194 10591 raft_consensus.cc:2368] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12.
I20260709 13:17:01.853195 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:01.861352 10559 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:01.862462 14572 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:01.862808 14572 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.832366 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.862938 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1755) took 1196 ms. Trace:
I20260709 13:17:01.864586 10559 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:01.868000 10591 rpcz_store.cc:276] 0709 13:17:00.666227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.998709 (+332482us) service_pool.cc:224] Handling call
0709 13:17:01.862711 (+864002us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54001e3cd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:01.862869 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766962432}
I20260709 13:17:01.854628 14618 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:01.869239 14503 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.870697 14503 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:01.864791 14537 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:01.872061 14503 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.873695 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.866966 14572 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.863261 14380 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.877841 14380 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:01.879026 14380 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:01.880723 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:01.885483 10632 leader_election.cc:400] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12.
I20260709 13:17:01.885949 10632 leader_election.cc:403] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.886618 14640 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.868646 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:01.891088 14537 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:01.891462 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.892270 10669 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.892977 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.893707 10665 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:01.891570 14537 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:01.896173 14537 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:01.897289 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.901039 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:01.907501 10665 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 9: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:17:01.915076 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 101744us
I20260709 13:17:01.916216 10669 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:01.917974 10743 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:01.920449 10743 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:01.922888 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:01.783092 14589 consensus_queue.cc:1059] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:17:01.795100 14397 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.928190 10743 raft_consensus.cc:1240] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 9. Ops: []
I20260709 13:17:01.831331 14743 raft_consensus.cc:2804] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:01.829522 14652 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:01.834542 14340 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:01.970291 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:01.970839 10588 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.975878 10743 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:01.980897 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1728) took 3160 ms. Trace:
I20260709 13:17:01.981448 10586 rpcz_store.cc:276] 0709 13:16:58.821015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.821936 (+   921us) service_pool.cc:224] Handling call
0709 13:16:58.839569 (+ 17633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.579333 (+2739764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.579362 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.579401 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.579437 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.980603 (+401166us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b540016a154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:01.980660 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.980808 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3721,"raft.queue_time_us":93,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6870,"spinlock_wait_cycles":6300058496}
I20260709 13:17:01.982936 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:01.983129 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.983698 10586 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:17:01.984277 14635 consensus_meta.cc:287] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.530s	user 0.000s	sys 0.006s
I20260709 13:17:01.984728 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:01.984905 10585 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
W20260709 13:17:01.985726 14735 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.475s	user 0.000s	sys 0.003s
W20260709 13:17:01.987143 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 220991us
I20260709 13:17:01.988333 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:01.964493 14489 consensus_meta.cc:287] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.002s
W20260709 13:17:01.964059 14725 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
W20260709 13:17:01.966584 14706 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:17:01.799827 14666 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:02.003824 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:01.841657 14653 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:02.039335 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.025300 10588 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:01.925697 14332 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:02.016834 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 439961us
W20260709 13:17:02.058133 10739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.011s
W20260709 13:17:02.058601 10739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.007s	sys 0.011s
W20260709 13:17:02.055806 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 467504us
W20260709 13:17:02.096689 10709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.076s	sys 0.152s
W20260709 13:17:02.098886 10709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.076s	sys 0.152s
I20260709 13:17:02.005182 14719 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.971998 14397 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:17:02.011204 14635 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:02.003369 14204 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:01.974303 14652 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.117664 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.054358 14649 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:02.138370 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:02.140123 10585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1750) took 1667 ms (client timeout 1733 ms). Trace:
W20260709 13:17:02.173779 10585 rpcz_store.cc:269] 0709 13:17:00.472910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.599119 (+126209us) service_pool.cc:224] Handling call
0709 13:17:02.139885 (+1540766us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001e46d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:02.140023 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3183711616}
I20260709 13:17:02.143647 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.152595 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:02.176956 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:02.153126 14733 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:02.153728 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:02.188942 10590 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.016451 14731 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:02.160269 10588 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:02.061615 14425 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.109537 14676 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:02.162643 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 332011us
I20260709 13:17:02.219450 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:02.163925 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:02.118255 14707 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.009s
I20260709 13:17:02.009903 14489 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.061303 14732 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.216605 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.224172 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:02.157226 14371 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.188423 14654 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.161057 14656 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:02.214529 14527 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.241071 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:02.166257 14643 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:02.284847 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 43867.2us
I20260709 13:17:02.240463 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:02.214570 14731 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.281024 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.248768 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:02.218650 14706 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:02.230993 14667 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:02.306458 10668 consensus_meta.cc:287] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:17:02.230471 14732 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:02.165074 14204 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.168848 14635 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:02.230494 14678 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:17:02.190582 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:02.257853 14649 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:17:02.679586 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.377941 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:02.643536 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:02.426935 10742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.001s	sys 0.008s
I20260709 13:17:02.687454 10738 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:02.689199 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:02.228470 14707 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.010s	sys 0.009s
W20260709 13:17:02.429746 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 252868us
I20260709 13:17:02.703071 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:02.690033 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:02.690680 10742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.010s	sys 0.010s
I20260709 13:17:02.704034 10738 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:02.690449 10668 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:02.688700 10588 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:17:02.409307 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 405525us
I20260709 13:17:02.257056 14737 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.692433 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2194) took 1169 ms. Trace:
I20260709 13:17:02.485889 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:02.687896 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:02.698702 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 458268us
I20260709 13:17:02.282099 14725 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.275146 14745 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:02.280656 14654 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.275702 14676 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.458s
I20260709 13:17:02.453238 10481 maintenance_manager.cc:419] P 956662ca83ea4bd99d8b7557260d32d7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033379
W20260709 13:17:02.962352 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1618) took 3094 ms (client timeout 1804 ms). Trace:
W20260709 13:17:03.232798 10667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.000s	sys 0.017s
W20260709 13:17:03.037228 10737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2186) took 2919 ms (client timeout 3245 ms). Trace:
W20260709 13:17:03.295668 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 592654us
W20260709 13:17:02.306942 14674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.015s	sys 0.009s
W20260709 13:17:02.378513 14712 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:17:02.650223 14753 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.370s	user 0.000s	sys 0.000s
W20260709 13:17:02.840159 10709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.022s	sys 0.047s
W20260709 13:17:03.329676 10709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.022s	sys 0.054s
I20260709 13:17:02.288798 14743 raft_consensus.cc:697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:03.296427 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:03.335104 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1759) took 1801 ms. Trace:
I20260709 13:17:03.335435 10593 rpcz_store.cc:276] 0709 13:17:01.533783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.882295 (+1348512us) service_pool.cc:224] Handling call
0709 13:17:03.335050 (+452755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.336395 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:03.296777 10734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2187) took 3129 ms (client timeout 2289 ms). Trace:
W20260709 13:17:03.231398 14397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.002s	sys 0.030s
W20260709 13:17:03.341665 14397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.002s	sys 0.030s
I20260709 13:17:03.305629 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:02.735781 14660 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:03.345407 14332 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:02.730789 14643 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:03.325918 14674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.714s	user 0.031s	sys 0.052s
W20260709 13:17:02.844924 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.005s	sys 0.005s
I20260709 13:17:03.128631 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 573) took 1688 ms. Trace:
I20260709 13:17:02.704931 14605 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:03.035699 14653 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.756968 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 569) took 2389 ms. Trace:
W20260709 13:17:03.315291 10735 rpcz_store.cc:269] 0709 13:16:59.868029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.951354 (+ 83325us) service_pool.cc:224] Handling call
0709 13:17:02.962108 (+3010754us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003304d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:02.962244 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798956416}
I20260709 13:17:03.392755 10736 rpcz_store.cc:276] 0709 13:17:00.367755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.070195 (+702440us) service_pool.cc:224] Handling call
0709 13:17:01.073510 (+  3315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.222060 (+148550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.222106 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.222175 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:01.222221 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.756711 (+1534490us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540036b0d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:02.756768 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.756906 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341056896}
W20260709 13:17:03.394151 11409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.024s	sys 0.028s
I20260709 13:17:02.734948 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:02.821807 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 100867us
W20260709 13:17:02.421545 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.002s
W20260709 13:17:03.756836 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.840s	user 0.022s	sys 0.011s
I20260709 13:17:03.300351 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:02.758783 10587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1736) took 2987 ms (client timeout 1788 ms). Trace:
W20260709 13:17:03.800130 10587 rpcz_store.cc:269] 0709 13:16:59.771519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.771623 (+   104us) service_pool.cc:224] Handling call
0709 13:17:02.758573 (+2986950us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540008aa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:02.758671 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4097016064}
I20260709 13:17:03.299950 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34318 (request call id 491) took 1277 ms. Trace:
W20260709 13:17:02.900744 10590 consensus_meta.cc:287] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.005s
I20260709 13:17:03.877676 10590 raft_consensus.cc:2410] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:03.878371 10590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2205) took 1726 ms (client timeout 1606 ms). Trace:
W20260709 13:17:03.878798 10590 rpcz_store.cc:269] 0709 13:17:02.151808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.153472 (+  1664us) service_pool.cc:224] Handling call
0709 13:17:03.878222 (+1724750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.880019 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:03.349339 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:03.987622 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:03.296054 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1745) took 3113 ms. Trace:
I20260709 13:17:03.993484 10589 rpcz_store.cc:276] 0709 13:17:00.183022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.188014 (+  4992us) service_pool.cc:224] Handling call
0709 13:17:00.188333 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.830651 (+1642318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.038752 (+1208101us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002c8dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:03.295974 (+257222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3562479488}
I20260709 13:17:02.739991 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:03.999228 10591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1775) took 2000 ms (client timeout 2203 ms). Trace:
W20260709 13:17:03.999583 10591 rpcz_store.cc:269] 0709 13:17:01.998483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.739722 (+741239us) service_pool.cc:224] Handling call
0709 13:17:03.999059 (+1259337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.000669 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:02.886149 10594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1749) took 2416 ms (client timeout 1769 ms). Trace:
W20260709 13:17:03.291814 10633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.000s	sys 0.018s
W20260709 13:17:03.317446 10632 connection.cc:256] RPC call timeout handler was delayed by -1.2965479279998817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:17:03.041201 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2123) took 1429 ms. Trace:
I20260709 13:17:03.049444 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 497) took 1369 ms. Trace:
I20260709 13:17:04.012892 10660 rpcz_store.cc:276] 0709 13:17:01.611574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.612432 (+   858us) service_pool.cc:224] Handling call
0709 13:17:01.612702 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.717748 (+105046us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:02.109541 (+391793us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.694286 (+584745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.694337 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:02.694379 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.040917 (+346538us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002da854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:03.040974 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.041117 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415612,"prepare.queue_time_us":269389,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":452403,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":241156480,"thread_start_us":560209,"threads_started":2,"wal-append.queue_time_us":868028,"wal-append.run_cpu_time_us":2552,"wal-append.run_wall_time_us":1001358}
I20260709 13:17:04.013852 10666 rpcz_store.cc:276] 0709 13:17:01.679993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.811489 (+131496us) service_pool.cc:224] Handling call
0709 13:17:01.811746 (+   257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:01.832821 (+ 21075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.832858 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.833514 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:17:02.306516 (+473002us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:02.484032 (+177516us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.770054 (+286022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.770150 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.049176 (+279026us) raft_consensus.cc:1685] finished
0709 13:17:03.049204 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.049381 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351150,"prepare.queue_time_us":291108,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":353877,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":36965,"thread_start_us":329554,"threads_started":1,"wal-append.queue_time_us":1012957}
W20260709 13:17:03.315456 10667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.002s	sys 0.018s
I20260709 13:17:03.369186 10740 rpcz_store.cc:276] 0709 13:17:01.439856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.852478 (+412622us) service_pool.cc:224] Handling call
0709 13:17:01.852857 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.923150 (+ 70293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.923195 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.961143 (+ 37948us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.257745 (+296602us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:02.257798 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.257873 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.128329 (+870456us) raft_consensus.cc:1685] finished
0709 13:17:03.128361 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.128557 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96439,"raft.queue_time_us":384497,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":31815,"thread_start_us":296280,"threads_started":1,"wal-append.queue_time_us":1013478}
W20260709 13:17:03.337133 10734 rpcz_store.cc:269] 0709 13:17:00.167607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.220387 (+ 52780us) service_pool.cc:224] Handling call
0709 13:17:03.040211 (+2819824us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540014cb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:03.296698 (+256487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299490560}
I20260709 13:17:04.022123 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:04.022928 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:04.023782 10734 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:04.024276 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1632) took 1945 ms. Trace:
I20260709 13:17:04.024634 10734 rpcz_store.cc:276] 0709 13:17:02.079019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.022493 (+1943474us) service_pool.cc:224] Handling call
0709 13:17:04.024225 (+  1732us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:03.315634 10737 rpcz_store.cc:269] 0709 13:17:00.117863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.124221 (+  6358us) service_pool.cc:224] Handling call
0709 13:17:03.037007 (+2912786us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003787d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:03.037159 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3628894976}
I20260709 13:17:02.732287 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:04.030966 10738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1636) took 1950 ms (client timeout 2166 ms). Trace:
W20260709 13:17:04.031409 10738 rpcz_store.cc:269] 0709 13:17:02.080514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.731892 (+651378us) service_pool.cc:224] Handling call
0709 13:17:04.030739 (+1298847us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:03.374845 10742 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.007s
W20260709 13:17:03.371071 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.005s	sys 0.025s
W20260709 13:17:04.064033 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 2.00465e+06us
I20260709 13:17:03.319521 10743 rpcz_store.cc:276] 0709 13:17:01.522833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.991432 (+468599us) service_pool.cc:224] Handling call
0709 13:17:01.991766 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.991987 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:02.053132 (+ 61145us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.692139 (+639007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.692186 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:02.692224 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.692279 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.692388 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3903,"prepare.queue_time_us":64222,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":4771,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":53165,"thread_start_us":346524,"threads_started":1}
I20260709 13:17:03.349786 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 572) took 1911 ms. Trace:
I20260709 13:17:04.086166 10739 rpcz_store.cc:276] 0709 13:17:01.438012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.438113 (+   101us) service_pool.cc:224] Handling call
0709 13:17:01.438399 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.438729 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.438759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.453992 (+ 15233us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.059035 (+605043us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.059087 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.059178 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.349449 (+1290271us) raft_consensus.cc:1685] finished
0709 13:17:03.349475 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.349696 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":263,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":17371,"thread_start_us":602410,"threads_started":1,"wal-append.queue_time_us":678416}
W20260709 13:17:03.300668 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.05732e+06us
I20260709 13:17:03.357493 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:03.338313 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:03.395107 11409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.024s	sys 0.028s
I20260709 13:17:04.125838 11409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 610) took 2453 ms. Trace:
I20260709 13:17:04.126189 11409 rpcz_store.cc:276] 0709 13:17:01.672620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.672815 (+   195us) service_pool.cc:224] Handling call
0709 13:17:01.715893 (+ 43078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:01.716243 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.716270 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.970913 (+254643us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b2c000478d8. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:17:01.991071 (+ 20158us) log.cc:844] Serialized 52 byte log entry
0709 13:17:04.125228 (+2134157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:04.125290 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.125418 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.125457 (+    39us) raft_consensus.cc:1685] finished
0709 13:17:04.125468 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.125696 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4149,"raft.queue_time_us":5647,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13343,"spinlock_wait_cycles":7940992,"thread_start_us":2063919,"threads_started":1,"wal-append.queue_time_us":1427757}
W20260709 13:17:03.586511 10663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.032s
W20260709 13:17:04.128628 10663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.008s	sys 0.033s
W20260709 13:17:03.658212 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.706537 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:03.726915 11417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 444) took 2233 ms. Trace:
I20260709 13:17:03.766770 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:03.788077 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:03.804410 10588 rpcz_store.cc:276] 0709 13:17:02.022107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.291671 (+269564us) service_pool.cc:224] Handling call
0709 13:17:03.299900 (+1008229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.826797 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:03.829598 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 529172us
I20260709 13:17:03.854826 10741 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:03.867684 14808 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:03.143414 14204 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.919345 14064 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.183257 14337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.000s	sys 0.017s
I20260709 13:17:03.869208 14363 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.156167 14064 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.157001 14363 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.159442 14363 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.159932 14363 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:04.160517 14363 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:02.421281 14365 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.292s	user 0.009s	sys 0.001s
W20260709 13:17:03.216691 14247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.034s	sys 0.039s
I20260709 13:17:04.165930 10592 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:04.166934 14064 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:04.167451 10592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1765) took 2514 ms (client timeout 2113 ms). Trace:
W20260709 13:17:04.167832 10592 rpcz_store.cc:269] 0709 13:17:01.653302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.775255 (+121953us) service_pool.cc:224] Handling call
0709 13:17:04.167223 (+2391968us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400299854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:04.167375 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5495026048}
I20260709 13:17:03.845093 14397 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:04.171345 14397 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:04.172416 14515 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.172952 14515 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:02.936998 14496 consensus_meta.cc:287] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.558s	user 0.008s	sys 0.004s
I20260709 13:17:04.178174 14496 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.180944 14496 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:03.376528 14477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.013s	sys 0.008s
W20260709 13:17:04.223096 14477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.016s	sys 0.008s
I20260709 13:17:03.401363 14497 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.225057 14497 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:03.405702 14489 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:02.879492 14425 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.880417 14503 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.234982 14503 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.422300 14527 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:02.840274 14537 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.006s
W20260709 13:17:02.771382 14572 consensus_meta.cc:287] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.890s	user 0.006s	sys 0.005s
I20260709 13:17:04.239709 14537 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.240595 14572 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.243129 14572 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.737545 14529 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:04.245019 14529 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.245529 14529 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.246024 14537 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:02.324985 14591 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:03.325919 14616 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.251129 10586 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:04.251430 14616 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:04.252651 10586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1772) took 2374 ms (client timeout 2070 ms). Trace:
I20260709 13:17:03.402124 14605 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:02.637235 14587 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:04.282830 14587 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:04.283988 14587 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:03.908762 10661 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.005s	sys 0.020s
W20260709 13:17:04.285832 10661 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.005s	sys 0.021s
I20260709 13:17:02.884630 14621 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:02.731532 14652 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:03.857759 14653 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.290723 14489 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.291278 14653 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.291740 14489 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.754355 14666 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:03.336769 14725 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.294776 14489 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:04.295456 14725 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.292093 14731 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:04.298698 14653 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.299578 14587 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.702204 14732 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.297165 14529 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.304411 14529 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:03.336315 14745 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:02.736124 14772 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:04.282830 14605 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.307588 14772 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:02.826295 14635 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.311918 14635 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.312742 10585 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:04.312085 10487 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 8, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:04.313815 10585 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2207) took 2159 ms (client timeout 2043 ms). Trace:
W20260709 13:17:04.314182 10585 rpcz_store.cc:269] 0709 13:17:02.153920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.687601 (+533681us) service_pool.cc:224] Handling call
0709 13:17:04.313624 (+1626023us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001bf654. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:04.313747 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329383296}
I20260709 13:17:03.398051 14649 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:04.317457 14649 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.314599 10487 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 2 to 6, term changed from 6 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to <none>, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:04.319581 14649 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.320274 14649 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.319653 10487 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:02.306804 14722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.028s
I20260709 13:17:03.870775 14637 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:04.332413 14772 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:03.426302 14743 consensus_queue.cc:237] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:02.755064 14739 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:02.636726 14721 raft_consensus.cc:3055] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:04.339993 14721 raft_consensus.cc:740] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:02.323513 14759 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:02.630564 14758 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.343735 14759 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.344611 14758 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.347007 14758 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:02.736334 14640 consensus_meta.cc:287] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.000s
I20260709 13:17:03.867805 14618 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:02.746248 14733 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.515707 14654 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:04.351166 14618 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:03.442191 14771 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:17:04.355918 14618 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:03.400693 14737 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.358186 14737 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.360741 14737 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:03.243922 14641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.000s	sys 0.018s
I20260709 13:17:02.852844 14667 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:04.366856 14667 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:03.396545 14709 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:02.486889 14756 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
I20260709 13:17:04.058909  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.940635 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:04.144704 10560 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:03.995523 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:05.358186 10589 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2210) took 2061 ms (client timeout 1826 ms). Trace:
W20260709 13:17:05.358543 10589 rpcz_store.cc:269] 0709 13:17:03.296671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.995225 (+698554us) service_pool.cc:224] Handling call
0709 13:17:05.358119 (+1362894us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.359963 10589 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:05.360525 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1758) took 3851 ms. Trace:
I20260709 13:17:05.360802 10589 rpcz_store.cc:276] 0709 13:17:01.509047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.359365 (+3850318us) service_pool.cc:224] Handling call
0709 13:17:05.359744 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.360272 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.360462 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:04.253028 10586 rpcz_store.cc:269] 0709 13:17:01.878008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.984522 (+106514us) service_pool.cc:224] Handling call
0709 13:17:04.252396 (+2267874us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54002a8854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:04.252579 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5210414848}
I20260709 13:17:05.362836 14838 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:05.363904 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1761) took 3819 ms. Trace:
I20260709 13:17:04.002734 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:04.139490 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:05.366145 10588 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1779) took 1649 ms (client timeout 2166 ms). Trace:
W20260709 13:17:05.366499 10588 rpcz_store.cc:269] 0709 13:17:03.716889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.139172 (+422283us) service_pool.cc:224] Handling call
0709 13:17:05.366089 (+1226917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.367870 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1763) took 3794 ms. Trace:
I20260709 13:17:05.368184 10588 rpcz_store.cc:276] 0709 13:17:01.573689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.367071 (+3793382us) service_pool.cc:224] Handling call
0709 13:17:05.367402 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.367567 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.367592 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.367646 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.367684 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.367731 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.367822 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.997386 10593 raft_consensus.cc:2376] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9. Re-sending same reply.
I20260709 13:17:04.218254 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 486) took 2716 ms. Trace:
I20260709 13:17:05.371868 10592 rpcz_store.cc:276] 0709 13:17:01.500502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.185547 (+2685045us) service_pool.cc:224] Handling call
0709 13:17:04.185838 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.200919 (+ 15081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.200947 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.208457 (+  7510us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.208503 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.217175 (+  8672us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540020ec54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:04.217222 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.217357 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26617728}
W20260709 13:17:04.003177 10594 rpcz_store.cc:269] 0709 13:17:00.469604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.642051 (+172447us) service_pool.cc:224] Handling call
0709 13:17:02.885898 (+2243847us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002cabd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:02.886066 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732095744}
I20260709 13:17:04.688515 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1757) took 3179 ms. Trace:
W20260709 13:17:04.289984 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 146739us
I20260709 13:17:03.316128 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:04.040946 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 578) took 2509 ms. Trace:
W20260709 13:17:04.137506 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1641) took 1985 ms (client timeout 2216 ms). Trace:
I20260709 13:17:04.039827 10738 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:04.219391 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2195) took 2688 ms. Trace:
W20260709 13:17:04.145709 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1637) took 2064 ms (client timeout 2175 ms). Trace:
W20260709 13:17:04.019476 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.004s	sys 0.018s
I20260709 13:17:05.373310 10592 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:04.019932 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.381767 14654 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.386874 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2142) took 1465 ms (client timeout 1926 ms). Trace:
W20260709 13:17:05.387393 10660 rpcz_store.cc:269] 0709 13:17:03.921047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.018171 (+ 97124us) service_pool.cc:224] Handling call
0709 13:17:05.386806 (+1368635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.384748 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:05.387588 14654 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.388770 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:03.959803 10664 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:05.382833 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 1.23824e+06us
I20260709 13:17:05.392402 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2132) took 1488 ms. Trace:
I20260709 13:17:04.270216 10663 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2131) took 2344 ms. Trace:
I20260709 13:17:04.034423 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:04.037189 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2118) took 2880 ms. Trace:
I20260709 13:17:02.704631 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2125) took 1092 ms. Trace:
W20260709 13:17:04.281334 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 575163us
I20260709 13:17:04.055769 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2199) took 2512 ms. Trace:
I20260709 13:17:04.089037 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1642) took 1938 ms. Trace:
W20260709 13:17:04.051290 10742 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.012s	sys 0.007s
I20260709 13:17:04.150048 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:04.269411 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 99640.8us
I20260709 13:17:04.152217 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1639) took 2002 ms. Trace:
I20260709 13:17:05.405589 10743 rpcz_store.cc:276] 0709 13:17:02.149965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.076495 (+1926530us) service_pool.cc:224] Handling call
0709 13:17:04.076997 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.077585 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.077623 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.078289 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.110389 (+ 32100us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.110425 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.110490 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.151819 (+ 41329us) raft_consensus.cc:1685] finished
0709 13:17:04.151847 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.152013 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2140,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":1393,"thread_start_us":31694,"threads_started":1,"wal-append.queue_time_us":69598,"wal-append.run_cpu_time_us":9229,"wal-append.run_wall_time_us":1067560}
I20260709 13:17:05.408032 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:04.129937 11417 rpcz_store.cc:276] 0709 13:17:01.493549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.498059 (+  4510us) service_pool.cc:224] Handling call
0709 13:17:01.796311 (+298252us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b58001f1798. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:17:01.796545 (+   234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.796814 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.796849 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.799922 (+  3073us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.399535 (+599613us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.399586 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.399763 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.726313 (+1326550us) raft_consensus.cc:1685] finished
0709 13:17:03.726355 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.726735 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9244544,"thread_start_us":435848,"threads_started":1,"wal-append.queue_time_us":1411357}
W20260709 13:17:04.219894 14337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.493s	user 0.003s	sys 0.018s
I20260709 13:17:04.276284 14363 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.396618 10588 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:05.416199 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2196) took 3755 ms. Trace:
I20260709 13:17:04.270927 14503 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.394204 14840 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:05.417352 10588 rpcz_store.cc:276] 0709 13:17:01.660735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.369166 (+3708431us) service_pool.cc:224] Handling call
0709 13:17:05.396439 (+ 27273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.415955 (+ 19516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.416133 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:04.332926 14637 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.424120 14637 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:05.382611 10591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2208) took 3227 ms (client timeout 3308 ms). Trace:
I20260709 13:17:04.290067 14652 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.401437 10589 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.426039 14652 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:05.400168 10488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 220) took 28281 ms (client timeout 15000 ms). Trace:
I20260709 13:17:05.428095 14652 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.400805 10737 rpcz_store.cc:276] 0709 13:17:01.543359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.026684 (+2483325us) service_pool.cc:224] Handling call
0709 13:17:04.027211 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.038207 (+ 10996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.038235 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.043630 (+  5395us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.053227 (+  9597us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.053267 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.053344 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.055447 (+  2103us) raft_consensus.cc:1685] finished
0709 13:17:04.055463 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.055607 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28456,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"thread_start_us":19034,"threads_started":2,"wal-append.queue_time_us":9565,"wal-append.run_cpu_time_us":26070,"wal-append.run_wall_time_us":1215290}
I20260709 13:17:05.428694 10590 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:05.430159 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 580) took 2604 ms. Trace:
I20260709 13:17:04.186532 14397 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:02.977377 14424 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.232808 14425 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.182658 14515 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.383867 14667 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:04.093916 14676 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.487558 14676 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.489586 14676 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.137269 14678 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:05.490490 10736 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:05.490862 14678 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.320750 14649 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:03.329768 14719 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 1.193s	user 0.010s	sys 0.001s
W20260709 13:17:04.332201 14722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.546s	user 0.015s	sys 0.075s
I20260709 13:17:04.298328 14725 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.336527 14731 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.517164 14731 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.377449 14732 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.520923 14732 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.389988 14739 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.522251 14739 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.522934 14731 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:05.523473 14731 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.524286 14739 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.333222 14745 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.362085 14759 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:02.594489 14760 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:05.527863 14760 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:03.827641 14774 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:03.442337 14773 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 13:17:04.349308 14640 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12.
I20260709 13:17:03.333642 14777 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.366044 14641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.209s	user 0.003s	sys 0.018s
I20260709 13:17:03.683780 14656 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:05.558116 14777 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.558465 14656 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:05.559549 14656 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:04.341279 14721 consensus_queue.cc:260] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:03.777772 14786 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.570508 14786 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:04.147538 14808 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.575270 14808 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:03.922061 14809 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.576630 14809 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.578823 14809 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.085011 14810 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:05.580166 14810 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.582126 14810 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.094465 14814 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.583493 14814 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.586175 14814 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:04.230022 14823 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:04.289184 14826 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:05.588374 14826 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.590360 14826 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:04.942378  9494 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1b00 after lost signal to thread 10635
W20260709 13:17:05.162791 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.674023 14829 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.591913 14829 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.593957 14829 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:05.201067 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08003055a0 after lost signal to thread 9492
W20260709 13:17:05.257462 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.294121 10480 maintenance_manager.cc:643] P 956662ca83ea4bd99d8b7557260d32d7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.396s	user 0.112s	sys 0.063s Metrics: {"bytes_written":29379,"cfile_init":1,"dirs.queue_time_us":13564,"dirs.run_cpu_time_us":604,"dirs.run_wall_time_us":1684,"drs_written":1,"lbm_read_time_us":379,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3970,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":15473,"threads_started":2,"wal-append.queue_time_us":2690}
W20260709 13:17:05.594687 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.305994 14836 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.595203 11439 debug-util.cc:398] Leaking SignalData structure 0x7b080031a100 after lost signal to thread 10526
I20260709 13:17:05.595281 14836 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.594726 14786 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:05.596652 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0d80 after lost signal to thread 10618
I20260709 13:17:05.597512 14836 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.310755 14709 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:05.313235 14666 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:05.598254 14666 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.598218 14709 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.599382 10481 maintenance_manager.cc:419] P 956662ca83ea4bd99d8b7557260d32d7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8476 bytes on disk
I20260709 13:17:05.600261 14666 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.340826 10487 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:05.364610 14839 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:05.601050 14839 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:05.601504 10487 catalog_manager.cc:5697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 8 to 9, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.602023 14839 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.603286 10487 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 6, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 6 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:05.370432 14838 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:05.604949 10487 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:05.605973 14838 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.606446 10487 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 9 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 10 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:05.607872 10487 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 9 to 10, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:05.385422 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2198) took 3724 ms. Trace:
I20260709 13:17:05.608999 10592 rpcz_store.cc:276] 0709 13:17:01.661681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.372839 (+3711158us) service_pool.cc:224] Handling call
0709 13:17:05.373142 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.385150 (+ 12008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.385346 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.364300 10586 rpcz_store.cc:276] 0709 13:17:01.544124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.363015 (+3818891us) service_pool.cc:224] Handling call
0709 13:17:05.363338 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.363573 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.363600 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.363643 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.363681 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.363734 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.363837 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.609839 10487 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.611048 10480 maintenance_manager.cc:643] P 956662ca83ea4bd99d8b7557260d32d7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":324,"lbm_reads_lt_1ms":4}
I20260709 13:17:05.378804 10734 rpcz_store.cc:276] 0709 13:17:01.531976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.032391 (+2500415us) service_pool.cc:224] Handling call
0709 13:17:04.040350 (+  7959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.040623 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.040646 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.040709 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.040738 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.040787 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.040881 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.611622 10487 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.381706 10740 rpcz_store.cc:276] 0709 13:17:01.523100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.023754 (+2500654us) service_pool.cc:224] Handling call
0709 13:17:04.024269 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.024717 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:04.089048 (+ 64331us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.211174 (+122126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.211217 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.211269 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.211330 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.211430 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81636,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":121935,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"thread_start_us":181256,"threads_started":3,"wal-append.queue_time_us":18897,"wal-append.run_cpu_time_us":26124,"wal-append.run_wall_time_us":1219944}
I20260709 13:17:05.613368 14709 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.613936 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 581) took 2316 ms. Trace:
I20260709 13:17:05.614307 10740 rpcz_store.cc:276] 0709 13:17:03.297389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.613083 (+2315694us) service_pool.cc:224] Handling call
0709 13:17:05.613468 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.613658 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.613681 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.613717 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.613751 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.613799 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.613890 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:05.616456 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800305440 after lost signal to thread 10693
W20260709 13:17:05.382349 10741 rpcz_store.cc:269] 0709 13:17:02.080856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.734557 (+653701us) service_pool.cc:224] Handling call
0709 13:17:04.143055 (+1408498us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:05.617707 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800340960 after lost signal to thread 10767
W20260709 13:17:05.617969 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08003db180 after lost signal to thread 10768
I20260709 13:17:05.618120 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 583) took 2307 ms. Trace:
I20260709 13:17:05.618494 10741 rpcz_store.cc:276] 0709 13:17:03.311163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.617338 (+2306175us) service_pool.cc:224] Handling call
0709 13:17:05.617682 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.617843 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.617867 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.617904 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.617933 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.617984 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.618070 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.620220 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 584) took 2307 ms. Trace:
I20260709 13:17:05.620522 10741 rpcz_store.cc:276] 0709 13:17:03.312726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.619385 (+2306659us) service_pool.cc:224] Handling call
0709 13:17:05.619685 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.619903 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.619928 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.619983 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:05.620021 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.620071 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.620174 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:05.621158 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3c80 after lost signal to thread 11442
I20260709 13:17:05.373931 10585 rpcz_store.cc:276] 0709 13:17:01.508791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.315046 (+2806255us) service_pool.cc:224] Handling call
0709 13:17:04.315567 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.315927 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.315953 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.362711 (+ 46758us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b180036d900. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a
0709 13:17:04.363135 (+   424us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b2c00000f48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:17:04.364412 (+  1277us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.688117 (+323705us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.688160 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.688233 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.688276 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:04.688288 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.688435 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9764,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":2494,"spinlock_wait_cycles":34678528,"thread_start_us":323232,"threads_started":1,"wal-append.queue_time_us":35104}
I20260709 13:17:05.381054 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1638) took 3299 ms. Trace:
I20260709 13:17:05.622696 10738 rpcz_store.cc:276] 0709 13:17:02.081183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.034335 (+1953152us) service_pool.cc:224] Handling call
0709 13:17:04.039401 (+  5066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.380795 (+1341394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.380984 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.623926 10738 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.624516 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2205) took 2293 ms. Trace:
I20260709 13:17:05.625591 10594 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:05.628170 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2200) took 3965 ms. Trace:
I20260709 13:17:05.628509 10594 rpcz_store.cc:276] 0709 13:17:01.662427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.373990 (+3711563us) service_pool.cc:224] Handling call
0709 13:17:05.374333 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.625953 (+251620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.627921 (+  1968us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002c9cd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:05.628099 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577200896}
W20260709 13:17:05.379586 10735 rpcz_store.cc:269] 0709 13:17:02.150753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.787553 (+1636800us) service_pool.cc:224] Handling call
0709 13:17:04.136240 (+348687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.630268 10735 raft_consensus.cc:1240] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:05.630892 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2206) took 2300 ms. Trace:
I20260709 13:17:05.631203 10735 rpcz_store.cc:276] 0709 13:17:03.330971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.629637 (+2298666us) service_pool.cc:224] Handling call
0709 13:17:05.630018 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.630643 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.630840 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.632915 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 585) took 1856 ms. Trace:
W20260709 13:17:05.370469 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1777) took 2041 ms (client timeout 1788 ms). Trace:
W20260709 13:17:05.633464 10593 rpcz_store.cc:269] 0709 13:17:03.328579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.987100 (+658521us) service_pool.cc:224] Handling call
0709 13:17:05.370405 (+1383305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.635103 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 492) took 3413 ms. Trace:
I20260709 13:17:05.635455 10593 rpcz_store.cc:276] 0709 13:17:02.221437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.634169 (+3412732us) service_pool.cc:224] Handling call
0709 13:17:05.634514 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.634793 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.634821 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.634863 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:05.634901 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.634959 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.635056 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.392834 10664 rpcz_store.cc:276] 0709 13:17:03.904534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.958575 (+ 54041us) service_pool.cc:224] Handling call
0709 13:17:03.959180 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.392050 (+1432870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.392312 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.638196 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:05.639015 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2141) took 1718 ms (client timeout 2185 ms). Trace:
W20260709 13:17:05.639380 10664 rpcz_store.cc:269] 0709 13:17:03.920644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.637899 (+1717255us) service_pool.cc:224] Handling call
0709 13:17:05.638951 (+  1052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.640208 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:05.640895 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2139) took 1724 ms. Trace:
W20260709 13:17:05.383431 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 1.44291e+06us
I20260709 13:17:05.395661 10667 rpcz_store.cc:276] 0709 13:17:01.156418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.280714 (+124296us) service_pool.cc:224] Handling call
0709 13:17:01.280947 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.281133 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:01.850662 (+569529us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.036473 (+2185811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.036585 (+   112us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:04.036652 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.036800 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.036977 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":705482,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":36045,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"thread_start_us":2740910,"threads_started":3,"wal-append.queue_time_us":1573442,"wal-append.run_cpu_time_us":3031,"wal-append.run_wall_time_us":1017903}
I20260709 13:17:05.641968 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.643123 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.644160 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.397428 14837 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.645588 14837 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.648514 14837 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:04.231357 14497 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:17:04.238719 14527 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.263057 14616 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.395054 10666 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:05.624864 10738 rpcz_store.cc:276] 0709 13:17:03.330701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.623469 (+2292768us) service_pool.cc:224] Handling call
0709 13:17:05.623765 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.624274 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.624467 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.400120 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:05.418534 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2137) took 1502 ms. Trace:
I20260709 13:17:05.653476 10660 rpcz_store.cc:276] 0709 13:17:03.916073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.388489 (+1472416us) service_pool.cc:224] Handling call
0709 13:17:05.418462 (+ 29973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.654430 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.633247 10735 rpcz_store.cc:276] 0709 13:17:03.776350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.631999 (+1855649us) service_pool.cc:224] Handling call
0709 13:17:05.632266 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.632598 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.632626 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.632669 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:05.632713 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.632767 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.632867 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":319,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60}
I20260709 13:17:05.655560 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:05.656069 10660 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.394023 10663 rpcz_store.cc:276] 0709 13:17:01.925982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.155408 (+229426us) service_pool.cc:224] Handling call
0709 13:17:02.155723 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:02.156065 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.156094 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:02.156707 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 13:17:03.077017 (+920310us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b1800151ae0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:17:04.129121 (+1052104us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.216869 (+ 87748us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.220370 (+  3501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.261635 (+ 41265us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.261678 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:04.269996 (+  8318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.270163 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437711,"prepare.queue_time_us":101357,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":69948,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":15586,"spinlock_wait_cycles":49284992,"thread_start_us":1129894,"threads_started":2,"wal-append.queue_time_us":1221668,"wal-append.run_cpu_time_us":10364,"wal-append.run_wall_time_us":1799952}
I20260709 13:17:05.637148 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 493) took 2789 ms. Trace:
I20260709 13:17:05.641201 10664 rpcz_store.cc:276] 0709 13:17:03.918188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.639964 (+1721776us) service_pool.cc:224] Handling call
0709 13:17:05.640830 (+   866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.419057 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 589) took 1002 ms. Trace:
I20260709 13:17:05.658495 10743 rpcz_store.cc:276] 0709 13:17:04.409528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.407772 (+998244us) service_pool.cc:224] Handling call
0709 13:17:05.412138 (+  4366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.420969 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1768) took 3706 ms. Trace:
I20260709 13:17:05.659147 14836 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:05.652760 10666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2135) took 1740 ms (client timeout 1971 ms). Trace:
I20260709 13:17:05.659291 10588 rpcz_store.cc:276] 0709 13:17:01.714482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.420097 (+3705615us) service_pool.cc:224] Handling call
0709 13:17:05.420498 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.420674 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.420710 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.420752 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:05.420780 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.420826 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.420922 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:05.660148 10666 rpcz_store.cc:269] 0709 13:17:03.915214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.031783 (+116569us) service_pool.cc:224] Handling call
0709 13:17:05.652705 (+1620922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.661043 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.661352 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 494) took 2364 ms. Trace:
I20260709 13:17:05.661566 10666 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:05.661748 10588 rpcz_store.cc:276] 0709 13:17:03.297367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.660542 (+2363175us) service_pool.cc:224] Handling call
0709 13:17:05.660840 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.661025 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.661052 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.661091 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:05.661130 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.661180 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.661276 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.662405 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:05.662962 10666 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.663661 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1776) took 2345 ms. Trace:
I20260709 13:17:05.664029 10588 rpcz_store.cc:276] 0709 13:17:03.317772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.662705 (+2344933us) service_pool.cc:224] Handling call
0709 13:17:05.662998 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.663352 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.663380 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.663435 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:05.663470 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.663524 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.663616 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:05.424726 10591 rpcz_store.cc:269] 0709 13:17:02.155379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.002434 (+1847055us) service_pool.cc:224] Handling call
0709 13:17:05.382543 (+1380109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.666038 10591 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:05.658906 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 258962us
I20260709 13:17:05.666848 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1781) took 1949 ms. Trace:
I20260709 13:17:05.667186 10591 rpcz_store.cc:276] 0709 13:17:03.717946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.665601 (+1947655us) service_pool.cc:224] Handling call
0709 13:17:05.665869 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.666638 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.666801 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.402194 10739 rpcz_store.cc:276] 0709 13:17:02.151051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.088044 (+1936993us) service_pool.cc:224] Handling call
0709 13:17:04.088423 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.088685 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.088709 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.088772 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.088815 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.088868 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.088964 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.668908 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:05.430212 10590 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1778) took 2090 ms (client timeout 1758 ms). Trace:
I20260709 13:17:05.665992 14527 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:05.670140 10590 rpcz_store.cc:269] 0709 13:17:03.340180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.879620 (+539440us) service_pool.cc:224] Handling call
0709 13:17:05.430070 (+1550450us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003ffcd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:05.430158 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560244608}
W20260709 13:17:04.221793 14247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.226s	user 0.034s	sys 0.043s
I20260709 13:17:04.222114 14365 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.675654 14365 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.433422 10737 rpcz_store.cc:276] 0709 13:17:02.825462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.429011 (+2603549us) service_pool.cc:224] Handling call
0709 13:17:05.429707 (+   696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.429879 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.429903 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.429939 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.429967 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.430014 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.430094 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.446049 14848 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.677623 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.677788 14848 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:05.678194 14848 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.449569 14843 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:05.450043 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56725.1us
I20260709 13:17:05.680810 10592 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:05.682035 10560 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:05.450551 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 1.30527e+06us
I20260709 13:17:05.684499 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.685129 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:05.685819 14365 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.464602 14844 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:05.689823 14844 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:05.690055 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:05.690788 11415 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.691150 14844 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.657567 10593 rpcz_store.cc:276] 0709 13:17:02.847711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.636373 (+2788662us) service_pool.cc:224] Handling call
0709 13:17:05.636682 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.636841 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.636863 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.636916 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.636952 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.637007 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.637101 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.480712 14397 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.693048 14848 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.693928 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.695091 14848 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.695982 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:05.483085 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 2.16673e+06us
I20260709 13:17:05.483635 14425 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.483786 14841 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.698871 14841 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:05.699826 14841 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.700831 14841 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.485937 14489 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:05.701604 14489 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.703475 14853 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:05.703970 14853 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.704375 14489 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.706049 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:05.706753 10743 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:05.708079 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.713272 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.714120 11418 raft_consensus.cc:2410] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:05.494518 14649 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:05.496039 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 579) took 2816 ms (client timeout 2138 ms). Trace:
I20260709 13:17:05.498503 14719 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.525377 14731 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.526681 14678 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.526599 14732 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:05.714951 10736 rpcz_store.cc:269] 0709 13:17:02.679858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.766078 (+1086220us) service_pool.cc:224] Handling call
0709 13:17:05.495864 (+1729786us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002bfa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:05.495978 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3127097088}
I20260709 13:17:05.715552 11412 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.715653 14732 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.716804 11412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 614) took 2980 ms. Trace:
I20260709 13:17:05.717121 11412 rpcz_store.cc:276] 0709 13:17:02.736887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.738451 (+  1564us) service_pool.cc:224] Handling call
0709 13:17:02.738794 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.716077 (+2977283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.716577 (+   500us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b54006801d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:05.716754 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6845124864}
I20260709 13:17:05.717730 14732 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.531092 14760 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.532898 10587 raft_consensus.cc:2410] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:05.718116 14774 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:05.719547 10587 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2199) took 4057 ms (client timeout 3363 ms). Trace:
W20260709 13:17:05.719930 10587 rpcz_store.cc:269] 0709 13:17:01.662132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.826229 (+2164097us) service_pool.cc:224] Handling call
0709 13:17:05.719328 (+1893099us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540039dad4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:05.719477 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3218522368}
I20260709 13:17:05.538239 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2129) took 3628 ms. Trace:
I20260709 13:17:05.689354 11409 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:05.721768 14616 consensus_queue.cc:1059] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:05.721997 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:05.722565 10736 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.722628 14616 raft_consensus.cc:3055] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:05.723104 14616 raft_consensus.cc:740] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:05.723881 14616 consensus_queue.cc:260] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.548730 10669 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:05.721004 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.721477 10665 rpcz_store.cc:276] 0709 13:17:01.909380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.909557 (+   177us) service_pool.cc:224] Handling call
0709 13:17:01.909890 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:01.910845 (+   955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.910914 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.912137 (+  1223us) log.cc:844] Serialized 52 byte log entry
0709 13:17:02.253204 (+341067us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:02.253255 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.253348 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.537738 (+3284390us) raft_consensus.cc:1685] finished
0709 13:17:05.537801 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.538050 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":278,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":340319,"threads_started":1,"wal-append.queue_time_us":1174796}
W20260709 13:17:05.726114 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2130) took 3810 ms (client timeout 1773 ms). Trace:
W20260709 13:17:05.726548 10669 rpcz_store.cc:269] 0709 13:17:01.916012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.922620 (+  6608us) service_pool.cc:224] Handling call
0709 13:17:05.725908 (+3803288us) spinlock_profiling.cc:243] Waited 3.62 s on lock 0x7b54000c3d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:05.726016 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8315108096}
I20260709 13:17:05.726917 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.727218 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:05.727485 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:05.556202 14856 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:05.725109 14616 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.728259 14856 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.560145 14777 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.561518 14721 raft_consensus.cc:3060] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.562479 14656 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:05.591426 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.304409 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2117) took 4148 ms. Trace:
I20260709 13:17:05.731304 10662 rpcz_store.cc:276] 0709 13:17:01.156123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.267561 (+111438us) service_pool.cc:224] Handling call
0709 13:17:01.267822 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.440556 (+172734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.440589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.440972 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.771231 (+330259us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:01.771270 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.152412 (+381142us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54000c4c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:02.152458 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.303925 (+3151467us) raft_consensus.cc:1685] finished
0709 13:17:05.303967 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.304226 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734,"raft.queue_time_us":4500,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":20502,"spinlock_wait_cycles":383167232,"thread_start_us":305596,"threads_started":1,"wal-append.queue_time_us":582252}
I20260709 13:17:05.733166 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.612353 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:05.734709 10734 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:04.397712 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 498) took 2717 ms. Trace:
I20260709 13:17:05.396636 10668 rpcz_store.cc:276] 0709 13:17:01.612106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.612857 (+   751us) service_pool.cc:224] Handling call
0709 13:17:02.704578 (+1091721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.657863 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.737797 10663 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:05.737862 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.738955 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.739313 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:05.739624 10663 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:05.740676 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.395323 14654 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.426342 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2204) took 3762 ms. Trace:
I20260709 13:17:05.741683 10589 rpcz_store.cc:276] 0709 13:17:01.663558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.400936 (+3737378us) service_pool.cc:224] Handling call
0709 13:17:05.401250 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.426134 (+ 24884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.426282 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.742631 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.743270 10589 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:05.669732 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2133) took 1764 ms. Trace:
I20260709 13:17:05.745117 10667 rpcz_store.cc:276] 0709 13:17:03.904983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.644910 (+1739927us) service_pool.cc:224] Handling call
0709 13:17:05.645140 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.645282 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.645305 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.669471 (+ 24166us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.669505 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.669559 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.669654 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.746630 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.747418 10663 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:17:05.748271 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:05.748791 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:05.749010 10734 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:05.749347 10737 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.698873 14527 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.673821 14836 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.752472 14836 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:05.752970 14836 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.755419 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.756064 10669 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:05.674788 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 588) took 1350 ms. Trace:
I20260709 13:17:05.682170 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1769) took 3967 ms. Trace:
I20260709 13:17:05.554416 14851 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.761210 14851 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.762431 14527 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.685948 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.687482 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.687783 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.461859 14842 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:05.764698 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:05.765084 14842 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:05.427407 10488 rpcz_store.cc:269] 0709 13:16:37.121698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.133261 (+ 11563us) service_pool.cc:224] Handling call
0709 13:17:05.399908 (+28266647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:02.223685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:02.676436 (+452751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:02.676502 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:17:02.676530 (+    28us) tablet.cc:662] Decoding operations
0709 13:17:02.757152 (+ 80622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:02.757276 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:02.757365 (+    89us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:02.758748 (+  1383us) tablet.cc:701] Row locks acquired
0709 13:17:02.758811 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:17:02.758992 (+   181us) write_op.cc:270] Start()
0709 13:17:02.759147 (+   155us) write_op.cc:276] Timestamp: P: 1783603022758923 usec, L: 0
0709 13:17:02.759186 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:17:02.997930 (+238744us) log.cc:844] Serialized 5395 byte log entry
0709 13:17:03.524222 (+526292us) op_driver.cc:464] REPLICATION: finished
0709 13:17:03.526514 (+  2292us) write_op.cc:301] APPLY: starting
0709 13:17:03.526730 (+   216us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:03.527321 (+   591us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:03.527541 (+   220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:03.529889 (+  2348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:03.530519 (+   630us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:17:03.530614 (+    95us) write_op.cc:312] APPLY: finished
0709 13:17:03.531278 (+   664us) log.cc:844] Serialized 95 byte log entry
0709 13:17:03.533092 (+  1814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.533835 (+   743us) write_op.cc:454] Released schema lock
0709 13:17:03.533939 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:03.534652 (+   713us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.534689 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":983163,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":1801,"apply.run_cpu_time_us":6593,"apply.run_wall_time_us":8145,"num_ops":13,"prepare.queue_time_us":745008,"prepare.run_cpu_time_us":37533,"prepare.run_wall_time_us":1245314,"raft.queue_time_us":71920,"raft.run_cpu_time_us":1690,"raft.run_wall_time_us":2967,"replication_time_us":764695,"spinlock_wait_cycles":466176,"thread_start_us":831886,"threads_started":4,"wal-append.queue_time_us":427051,"wal-append.run_cpu_time_us":9078,"wal-append.run_wall_time_us":1085240}]]}
I20260709 13:17:05.698392 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:05.486104 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1625) took 4958 ms. Trace:
I20260709 13:17:05.772404 10742 rpcz_store.cc:276] 0709 13:17:00.527635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.280339 (+752704us) service_pool.cc:224] Handling call
0709 13:17:01.280571 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.280750 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:01.851849 (+571099us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.403668 (+3551819us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.485630 (+ 81962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.485701 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.485773 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.485891 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.486036 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1227441,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":175545,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"spinlock_wait_cycles":704896,"thread_start_us":4199885,"threads_started":4,"wal-append.queue_time_us":1671175,"wal-append.run_cpu_time_us":3666,"wal-append.run_wall_time_us":1013362}
I20260709 13:17:05.709041 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.709694 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.775235 10590 raft_consensus.cc:2410] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:05.775166 14732 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.776296 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:05.777030 10590 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:05.779057 11411 raft_consensus.cc:2410] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:05.710276 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 490) took 3722 ms. Trace:
I20260709 13:17:05.711349 14853 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.727559 10665 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:05.780047 10594 rpcz_store.cc:276] 0709 13:17:01.988294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.672625 (+3684331us) service_pool.cc:224] Handling call
0709 13:17:05.673059 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.673209 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.673236 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.673274 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.710046 (+ 36772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.710112 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.710212 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.781270 10665 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:05.781541 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:05.781952 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2138) took 1865 ms. Trace:
I20260709 13:17:05.736788 10661 rpcz_store.cc:276] 0709 13:17:01.680634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.818281 (+137647us) service_pool.cc:224] Handling call
0709 13:17:01.818586 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.822074 (+  3488us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:02.880778 (+1058704us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4800160158. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425c1e2aa1 00007f425c1d9b37 00007f425c1d99ca 00007f425c2d126f 00007f425c2d0f37 00007f425c2e555c 00007f425c2e5508 00007f425c2e5488 00007f425c2e5443 00007f425c2e46ec 00007f425b20ea96
0709 13:17:03.032483 (+151705us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b1800388780. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf 00007f42572d3038
0709 13:17:04.286293 (+1253810us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.378762 (+ 92469us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.379323 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.379466 (+   143us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:04.379507 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.379583 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.397454 (+ 17871us) raft_consensus.cc:1685] finished
0709 13:17:04.397478 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.397648 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3065,"prepare.queue_time_us":165215,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":12515,"raft.run_cpu_time_us":3005,"raft.run_wall_time_us":1046645,"spinlock_wait_cycles":198639744,"thread_start_us":1344880,"threads_started":2,"wal-append.queue_time_us":107225,"wal-append.run_cpu_time_us":3770,"wal-append.run_wall_time_us":1007173}
I20260709 13:17:05.759976 10741 rpcz_store.cc:276] 0709 13:17:04.324330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.673931 (+1349601us) service_pool.cc:224] Handling call
0709 13:17:05.674209 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.674456 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.674485 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.674531 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.674583 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.674641 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.674739 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.686450 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.686554 14847 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:05.670739 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 495) took 1852 ms. Trace:
W20260709 13:17:05.462545 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 77993.7us
I20260709 13:17:05.782421 10594 raft_consensus.cc:606] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:05.784448 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2140) took 1864 ms. Trace:
I20260709 13:17:05.783711 11417 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:05.782485 10665 rpcz_store.cc:276] 0709 13:17:03.916505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.780580 (+1864075us) service_pool.cc:224] Handling call
0709 13:17:05.780919 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.781616 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.781858 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.766081 10667 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:17:05.688303 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.786593 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2143) took 1865 ms. Trace:
I20260709 13:17:05.785516 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:05.784001 14847 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:05.787619 11410 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:05.784855 10661 rpcz_store.cc:276] 0709 13:17:03.920011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.783590 (+1863579us) service_pool.cc:224] Handling call
0709 13:17:05.783845 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.784067 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.784093 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.784158 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.784209 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.784264 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.784367 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.788040 14732 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.787081 10665 rpcz_store.cc:276] 0709 13:17:03.921417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.785790 (+1864373us) service_pool.cc:224] Handling call
0709 13:17:05.786101 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.786307 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.786330 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.786365 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.786397 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.786442 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.786538 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.786677 10591 rpcz_store.cc:276] 0709 13:17:03.818041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.667905 (+1849864us) service_pool.cc:224] Handling call
0709 13:17:05.668187 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.670397 (+  2210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.670425 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.670468 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:05.670512 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.670572 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.670667 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1764,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47}
I20260709 13:17:05.795917 10591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:05.796556 14847 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:05.797688 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2144) took 1859 ms. Trace:
I20260709 13:17:05.798049 10667 rpcz_store.cc:276] 0709 13:17:03.938000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.786209 (+1848209us) service_pool.cc:224] Handling call
0709 13:17:05.786455 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.797368 (+ 10913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.797396 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.797437 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.797466 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.797519 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.797613 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.799827 11415 raft_consensus.cc:2410] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:05.760036 10592 rpcz_store.cc:276] 0709 13:17:01.714760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.609774 (+3895014us) service_pool.cc:224] Handling call
0709 13:17:05.610131 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.681188 (+ 71057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.681962 (+   774us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540016b054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:05.682098 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161806592}
I20260709 13:17:05.810952 14527 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.811340 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.748294 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.801381 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:05.801883 14732 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:05.802439 11379 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:05.846005 10737 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:05.802500 10662 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:05.847846 10590 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 17.
I20260709 13:17:05.807812 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:05.827167 10660 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:05.829596 10666 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
W20260709 13:17:05.848796 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47555.7us
W20260709 13:17:05.802923 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 104631us
I20260709 13:17:05.765080 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2136) took 1849 ms. Trace:
I20260709 13:17:05.849617 10664 rpcz_store.cc:276] 0709 13:17:03.915645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.764309 (+1848664us) service_pool.cc:224] Handling call
0709 13:17:05.764593 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.764769 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.764795 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.764838 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.764868 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.764917 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.765005 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.837587 10669 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:05.853209 10736 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:05.857774 10591 raft_consensus.cc:606] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:05.858148 10591 raft_consensus.cc:614] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:05.858891 10668 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:05.862739 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 582) took 2564 ms. Trace:
I20260709 13:17:05.862818 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:05.863706 10594 raft_consensus.cc:606] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:05.863372 10740 rpcz_store.cc:276] 0709 13:17:03.298272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.615195 (+2316923us) service_pool.cc:224] Handling call
0709 13:17:05.615572 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.615944 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.615968 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.616367 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.859917 (+243550us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:05.859957 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.860016 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.862504 (+  2488us) raft_consensus.cc:1685] finished
0709 13:17:05.862528 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.862675 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16752,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":243219,"threads_started":1,"wal-append.queue_time_us":243537}
W20260709 13:17:05.868160 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 211352us
W20260709 13:17:05.868348 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 245656us
I20260709 13:17:05.813244 10587 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:17:05.872581 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 64824.6us
I20260709 13:17:05.874894 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2134) took 1945 ms. Trace:
I20260709 13:17:05.875401 10669 rpcz_store.cc:276] 0709 13:17:03.906722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.756760 (+1850038us) service_pool.cc:224] Handling call
0709 13:17:05.757012 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.850949 (+ 93937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.851183 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:05.818105 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:05.878334 10735 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:05.873698 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:05.881691 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79325.4us
W20260709 13:17:05.884895 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 66868.8us
I20260709 13:17:05.888707 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:05.890826 10741 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:05.870553 14841 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.852085 10487 catalog_manager.cc:5697] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 7, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 7 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:05.895242 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:05.897624 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.911999 14856 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:05.913368 14842 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:05.884441 14676 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.914948 14676 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:05.905398 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:05.919204 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.919253 10667 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:05.887131 14774 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:05.887867 14847 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:05.931861 10559 leader_election.cc:336] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.971s (SENT)
I20260709 13:17:05.933686 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:05.932808 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.934052 10559 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:05.892608 14853 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.937511 11415 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:05.893936 14777 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:05.948303 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.905257 14841 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.985749 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:05.919538 14839 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:05.940337 10594 raft_consensus.cc:606] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:05.925915 14774 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.991986 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.990891 10594 raft_consensus.cc:614] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:05.994359 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:06.006400 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 74573.4us
I20260709 13:17:06.007230 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:05.996325 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54797.3us
I20260709 13:17:05.987335 14616 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.937515 14853 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:05.939797 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51967.5us
I20260709 13:17:06.015197 14851 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:06.015884 14880 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:05.995121 14774 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.015746 14836 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.036221 10632 leader_election.cc:400] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12.
I20260709 13:17:06.037843 14836 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:06.039096 14852 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:06.023646 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.039930 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1780) took 2322 ms. Trace:
W20260709 13:17:06.043399 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 156077us
I20260709 13:17:05.933658 14842 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:17:06.026510 10635 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:06.033601 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.035040 14853 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.020879 14838 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:05.988011 14841 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.043655 10743 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.987967 14837 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:06.034374 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.044893 10593 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:06.047237 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.050232 10587 raft_consensus.cc:2368] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:06.042702 10588 rpcz_store.cc:276] 0709 13:17:03.717547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.664889 (+1947342us) service_pool.cc:224] Handling call
0709 13:17:05.665189 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.826045 (+160856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.826084 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.867534 (+ 41450us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.932001 (+ 64467us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:05.932116 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.932350 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.039722 (+107372us) raft_consensus.cc:1685] finished
0709 13:17:06.039741 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.039873 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":37519,"threads_started":1,"wal-append.queue_time_us":47874}
I20260709 13:17:06.047250 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:06.052829 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:06.071044 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:06.074213 11379 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:06.075057 14641 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:06.075618 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49185.4us
I20260709 13:17:06.075845 14855 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:06.053259 14837 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.057590 14808 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:06.123883 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.124873 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.128151 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:05.995450 14839 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.136058 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.141935 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:06.154789 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.990011 14777 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:06.156814 10594 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.122531 14847 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:06.118708 14855 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:06.162252 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 85272.2us
I20260709 13:17:06.130903 14837 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:06.164227 14641 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:06.165004 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.175981 11411 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:06.166153 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:06.169836 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1ee0 after lost signal to thread 9492
W20260709 13:17:06.177973 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1a40 after lost signal to thread 10526
I20260709 13:17:06.128578 14808 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:06.141039 14656 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.176136 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:06.179535 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08001ce1a0 after lost signal to thread 10618
W20260709 13:17:06.185070 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6de0 after lost signal to thread 10635
W20260709 13:17:06.185961 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800354940 after lost signal to thread 10668
W20260709 13:17:06.186661 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08003df580 after lost signal to thread 10693
W20260709 13:17:06.188002 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800271980 after lost signal to thread 10767
W20260709 13:17:06.188323 10615 debug-util.cc:398] Leaking SignalData structure 0x7b080037f9e0 after lost signal to thread 10768
I20260709 13:17:06.192049 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.192728 11409 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:06.161098 14777 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:06.195747 10615 debug-util.cc:398] Leaking SignalData structure 0x7b080033b920 after lost signal to thread 11442
W20260709 13:17:06.196444 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3940 after lost signal to thread 14424
W20260709 13:17:06.196807 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad100 after lost signal to thread 14496
W20260709 13:17:06.197958 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800347b40 after lost signal to thread 14656
W20260709 13:17:06.198488 10615 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5600 after lost signal to thread 14719
W20260709 13:17:06.205570 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800334e20 after lost signal to thread 14760
I20260709 13:17:06.205543 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:06.206610 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800392a60 after lost signal to thread 14773
W20260709 13:17:06.207818 10615 debug-util.cc:398] Leaking SignalData structure 0x7b080035b440 after lost signal to thread 14774
W20260709 13:17:06.208096 10615 debug-util.cc:398] Leaking SignalData structure 0x7b0800394e80 after lost signal to thread 14777
W20260709 13:17:06.208452 10615 debug-util.cc:398] Leaking SignalData structure 0x7b080024c440 after lost signal to thread 14786
I20260709 13:17:06.211575 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.211685 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:06.209913 14425 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.214967 14425 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.182281 14808 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:06.222558 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:06.203866 14865 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:17:06.227408 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.179493 14878 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.229933 10593 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:17:06.236018 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:06.248471 14397 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.248620 10706 connection.cc:256] RPC call timeout handler was delayed by -2.3009323440001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33630000000000004s for a response
W20260709 13:17:06.249171 10706 connection.cc:256] RPC call timeout handler was delayed by -1.8799937970002247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:17:06.249670 10706 connection.cc:256] RPC call timeout handler was delayed by -1.8799937970002247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:17:06.250025 10706 connection.cc:256] RPC call timeout handler was delayed by -1.8583937970001898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:17:06.250392 10706 connection.cc:256] RPC call timeout handler was delayed by -1.6846937970001363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:17:06.250743 10706 connection.cc:256] RPC call timeout handler was delayed by -1.6414937970000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 13:17:06.250840 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.239262 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1771) took 4358 ms. Trace:
I20260709 13:17:06.206281 14656 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:06.324219 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 250096us
I20260709 13:17:06.251607 10593 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
W20260709 13:17:06.334535 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 83165.6us
I20260709 13:17:06.249058 14397 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:06.331096 14865 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:06.253062 10586 rpcz_store.cc:276] 0709 13:17:01.877068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.610652 (+3733584us) service_pool.cc:224] Handling call
0709 13:17:05.610933 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.611128 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:05.868072 (+256944us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.235199 (+367127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.235281 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:06.235351 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.235467 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.235635 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192496,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":40930,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4203,"thread_start_us":583758,"threads_started":3,"wal-append.queue_time_us":342702}
I20260709 13:17:06.341173 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.350419 10594 raft_consensus.cc:2410] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:06.333907 14666 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.329672 14654 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:06.343567 14640 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:06.365244 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 152071us
I20260709 13:17:06.405990 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:06.412068 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.412307 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.413621 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.413839 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.414733 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.415493 10592 raft_consensus.cc:2410] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:06.416141 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.416739 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.416903 10590 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:06.417553 10587 raft_consensus.cc:2410] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:06.413093 10593 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.415266 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.450349 14397 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:06.353876 10487 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:06.340157 14855 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.457998 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.460726 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.461338 10737 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:06.461544 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.462034 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.462445 10594 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.463114 10735 raft_consensus.cc:2410] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:17:06.463802 14883 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:06.461228 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.464560 10741 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:17:06.469427 14881 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:17:06.407557 14425 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:06.471238 14879 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:17:06.363320 14654 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.473078 14844 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:06.477654 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.473654 14844 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:06.479609 14844 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.481038 14844 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.484702 14676 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:06.490321 10741 raft_consensus.cc:1240] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:17:06.492897 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 382476us
I20260709 13:17:06.360563 14847 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:06.498132 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 167443us
I20260709 13:17:06.366765 14666 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.497758 14810 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.512385 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.510138 10559 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:06.513099 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.512708 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.498541 14839 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:06.517206 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 111285us
I20260709 13:17:06.517230 10735 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:17:06.517942 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.524325 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:06.534564 10706 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.65:41805 timed out after 1.826s (SENT) [suppressed 15 similar messages]
I20260709 13:17:06.537700 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.537657 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.538795 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.539830 10593 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:06.513907 14810 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.512353 14654 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:06.543469 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.542680 10592 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:06.532335 14887 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:06.549248 10737 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:06.551357 14852 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:06.551503 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:06.552322 14843 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.554101 14666 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:06.559151 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.559176 10559 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:06.560222 14839 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:06.560633 14839 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.560957 14839 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.561681 14247 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.562175 14247 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.564864 14247 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:06.559147 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1774) took 4637 ms. Trace:
I20260709 13:17:06.565696 14843 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.566262 14843 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.565948 10585 rpcz_store.cc:276] 0709 13:17:01.922112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.622125 (+3700013us) service_pool.cc:224] Handling call
0709 13:17:05.725378 (+103253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.725549 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:05.877139 (+151590us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.040907 (+163768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.040976 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.041050 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.041166 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.559009 (+517843us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540039dad0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:06.559101 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78395,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":150,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7298,"spinlock_wait_cycles":236532608,"thread_start_us":274967,"threads_started":2,"wal-append.queue_time_us":271639}
I20260709 13:17:06.568372 14843 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:06.569221 14247 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:06.569327 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.569836 14247 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.570101 14839 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.572361 14247 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:06.572924 10635 connection.cc:256] RPC call timeout handler was delayed by -2.3948141829998804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:17:06.574324 10669 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 13:17:06.576821 14839 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:06.577739 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.579012 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.579893 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.580111 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.580600 14721 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.581081 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.581198 14721 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:06.581746 14721 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:06.582185 14721 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.583109 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.583878 10660 raft_consensus.cc:2410] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:06.581223 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.585505 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.587548 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.588477 10660 raft_consensus.cc:2368] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:06.542512 14810 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.600075 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.602208 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.602413 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:06.604347 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.605718 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.606901 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.607236 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.606498 14721 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.608466 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.609989 14721 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:06.610725 14721 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:06.611687 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.610114 10661 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: [10.8-11.9]
I20260709 13:17:06.611699 10588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
W20260709 13:17:06.613242 14890 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:06.613308 10588 raft_consensus.cc:606] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:06.616528 14852 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.602483 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.618409 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.619114 10660 raft_consensus.cc:2368] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:17:06.606914 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.620447 10664 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.621148 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.569904 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:06.623023 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53193.9us
I20260709 13:17:06.554757 14887 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.624294 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.622269 10665 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.626806 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.627413 10741 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:17:06.628365 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:06.624858 10662 raft_consensus.cc:2376] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12. Re-sending same reply.
I20260709 13:17:06.596522 14656 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:06.647787 10735 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:06.656090 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.557363 14808 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.668527 10663 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:06.626950 14887 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.672752 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 587) took 2552 ms. Trace:
I20260709 13:17:06.673142 10739 rpcz_store.cc:276] 0709 13:17:04.120512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.668800 (+1548288us) service_pool.cc:224] Handling call
0709 13:17:05.669077 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.669325 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:06.570414 (+901089us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b180041fec0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf
0709 13:17:06.570528 (+   114us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.672140 (+101612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.672198 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:06.672242 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.672306 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.672406 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211582,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"spinlock_wait_cycles":22437760,"thread_start_us":316143,"threads_started":2}
I20260709 13:17:06.679176 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.679817 10735 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:06.617010 14852 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.690439 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 586) took 2631 ms. Trace:
W20260709 13:17:06.705856 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 171318us
W20260709 13:17:06.678793 14774 consensus_meta.cc:287] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.006s
W20260709 13:17:06.681497 14841 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.005s
W20260709 13:17:06.680389 14848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.005s
I20260709 13:17:06.709430 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.713195 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.705965 10738 rpcz_store.cc:276] 0709 13:17:04.058805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.653180 (+1594375us) service_pool.cc:224] Handling call
0709 13:17:05.653927 (+   747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.654206 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:06.560141 (+905935us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b180030a540. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf
0709 13:17:06.560278 (+   137us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.684664 (+124386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.690086 (+  5422us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:06.690154 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.690241 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.690370 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226237,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":5636,"raft.queue_time_us":9128,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10664,"spinlock_wait_cycles":16629120,"thread_start_us":347377,"threads_started":2}
I20260709 13:17:06.719635 14656 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:06.720341 14656 consensus_queue.cc:1243] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:06.721329 14676 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:06.721480 14893 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:06.721695 14853 consensus_meta.cc:287] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:17:06.722142 14853 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.722746 11411 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:06.724303 14654 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:06.724642 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.725427 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.725739 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.726086 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.726457 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.726747 10665 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.726943 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.727147 14425 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.497092 10487 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 2 to 4, term changed from 7 to 9, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65), VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66), VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67), VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.727547 14425 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:06.728020 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.728443 14425 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.728868 10487 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:06.729811 14425 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.730724 10487 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 10, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 10 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.721715 14676 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:06.734416 14676 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.735446 14676 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.737761 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.739806 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:06.742563 14808 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:06.742725 14397 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.743275 10706 leader_election.cc:400] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:06.745440 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.746107 14397 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.740655 14425 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.750815 11412 raft_consensus.cc:1240] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:06.729157 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.716619 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.725741 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:06.710577 14848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.005s	sys 0.005s
I20260709 13:17:06.649782 14847 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.754914 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:06.756102 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 167319us
I20260709 13:17:06.756786 10660 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:06.752590 10739 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:06.724114 14853 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:06.732537 10487 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 8 to 11, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 11 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:06.759040 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:06.761404 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:06.764675 10663 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:06.764845 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.764716 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.767561 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:06.756506 14837 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.001s
I20260709 13:17:06.768707 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:06.769523 10739 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:06.770619 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.708530 14774 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.785670 10586 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:06.786199 14774 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:06.786449 10585 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:06.711772 14841 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.786867 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.787552 10587 raft_consensus.cc:2368] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:06.776664 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:06.777815 14891 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:06.790642 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 108184us
I20260709 13:17:06.791530 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.777638 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.791980 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.778373 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.780506 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.781208 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.792837 10660 raft_consensus.cc:2410] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:06.781375 14397 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:06.794678 14397 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.795090 14397 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.795246 10594 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:17:06.795661 10594 pending_rounds.cc:85] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 11
I20260709 13:17:06.795961 10594 pending_rounds.cc:107] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:17:06.782603 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.796271 10594 raft_consensus.cc:2889] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.796689 10734 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:06.783337 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.783612 10588 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:06.797854 10587 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.799321 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.800410 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.781917 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:06.776087 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.789165 10664 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:17:06.784232 14777 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
I20260709 13:17:06.764438 14425 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.809170 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.809453 14425 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:06.792866 10743 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:06.795737 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.798533 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.802850 10737 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.809031 10735 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:06.804160 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.794943 14836 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:06.814953 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:06.817809 10593 raft_consensus.cc:2368] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:06.817854 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.818897 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:06.819563 10586 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 17: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:06.801851 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:06.807273 10742 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
I20260709 13:17:06.810549 10589 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:17:06.784333 14882 log.cc:927] Time spent T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.379s	user 0.000s	sys 0.007s
I20260709 13:17:06.812115 10663 raft_consensus.cc:2368] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:06.809857 14425 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.834733 10666 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:06.820587 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:06.782631 14852 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:06.810025 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.835244 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:06.841866 10738 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:06.821131  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:06.842097 10585 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:06.844956 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:06.843573  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:06.775077 14837 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.855852 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.854817 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.859136 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.829797 14808 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.865418 10738 raft_consensus.cc:1275] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:06.867551 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.868144 10664 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:06.868981 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:06.869801 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 47073.3us
I20260709 13:17:06.871970 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.900501 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.900806 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:06.815613 14777 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:06.903116 10668 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:06.902922 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.907445 10661 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:06.901432 10586 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:06.903244 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.908604 10660 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:06.910089 10663 raft_consensus.cc:2410] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:17:06.910167 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:06.910828 10667 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
W20260709 13:17:06.900161 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 98452.3us
I20260709 13:17:06.841271 14851 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:17:06.871181 14808 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.922426 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 80955.7us
I20260709 13:17:06.923974 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.956954 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:06.908661 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:06.906582 14731 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:06.901609 14836 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.961439 10590 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:06.923053 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:06.959633 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:06.962703 10586 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:06.966281 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.966957 10743 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:06.967468 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:06.976861 10737 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:06.925350 14808 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:06.996778 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 92663.8us
I20260709 13:17:06.994834 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:07.008211 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:06.913540 14810 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:06.964694 14731 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:06.968477 14836 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.014089 10632 leader_election.cc:400] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:07.015215 10632 leader_election.cc:403] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.916451 14901 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:07.026175 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:07.028759 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.863687 10487 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:07.033670 10669 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:17:07.027994 14616 consensus_meta.cc:287] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.000s
I20260709 13:17:07.017340 14836 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.040134 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:07.043519 10740 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.039889 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 45146.6us
I20260709 13:17:07.053570 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:07.054294 10742 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.050082 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.034909 14904 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:07.035655 14852 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.058951 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:07.061939 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 64158.2us
I20260709 13:17:07.057391 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.039292 14911 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.052757 14616 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.060467 10743 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:07.057813 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51035.8us
W20260709 13:17:07.088418 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.089480 10737 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:07.089823 10737 pending_rounds.cc:85] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 8
I20260709 13:17:07.090034 10737 pending_rounds.cc:107] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:07.090245 10737 raft_consensus.cc:2889] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.092314 14777 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:07.148406 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.055627 14903 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.162981 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 113006us
I20260709 13:17:07.163614 10632 leader_election.cc:400] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:07.163990 10632 leader_election.cc:403] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.064872 14841 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.166040 10591 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:07.170935 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:07.101279 14904 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:07.059717 14915 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:17:07.158712 14774 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.185918 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:07.187207 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 264204us
I20260709 13:17:07.169209 14837 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.168377 14676 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.203470 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:07.155242 14844 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:07.183063 14911 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.063114 14731 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:07.218760 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 161576us
I20260709 13:17:07.203222 14841 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:07.178184 14921 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.157663 14922 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:17:07.205758 14901 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:07.212963 14676 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.221837 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:07.167917 14903 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:07.229187 14916 log.cc:927] Time spent T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:07.222681 14777 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:07.276021 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.291705 10560 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.221302 14911 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:07.268069 14676 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.297670 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 75898.1us
I20260709 13:17:07.305505 14901 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:07.264456 14837 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:07.309813 14918 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:07.267966 14616 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:07.310580 14917 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.310786 14777 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:07.162593 10487 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 6, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 6 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:07.265489 14920 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:07.293594 14908 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:17:07.311384 14921 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.292481 14928 log.cc:927] Time spent T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:17:07.273344 14774 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:17:07.325974 14915 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.229856 14904 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.321238 14911 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.350600 14921 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.337968 14918 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:07.384797 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 339565us
W20260709 13:17:07.361912 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 70302.8us
W20260709 13:17:07.388469 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58274.2us
I20260709 13:17:07.389144 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.294740 14731 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.390478 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:07.390904 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 182109us
I20260709 13:17:07.392812 10594 raft_consensus.cc:2393] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:17:07.393281 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 117499us
I20260709 13:17:07.393980 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.396974 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.399219 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.400640 14921 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:07.401270 14397 consensus_meta.cc:287] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.606s	user 0.015s	sys 0.001s
I20260709 13:17:07.401459 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.401674 14397 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.402770 10741 raft_consensus.cc:2393] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:07.404398 14397 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:07.394197 14810 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:07.420897 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.413988 10632 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:07.392398 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:07.363039 14902 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:17:07.420012 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:07.420769 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.421686 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:07.412755 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.394986 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.428256 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.430850 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.423336 14936 raft_consensus.cc:2764] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:07.421384 14901 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.433539 14903 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:07.436669 14425 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.010s
I20260709 13:17:07.437037 14425 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.438988 14616 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.439378 14616 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.439693 14616 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.441186 10736 raft_consensus.cc:2393] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:07.444867 10740 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:07.421799 14921 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.450838 14676 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.453377 14853 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.454759 10487 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:07.420454 14915 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.455413 10742 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:07.456718 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.457572 14918 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.463518 14938 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.466656 10738 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:07.470616 10709 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.470917 10735 raft_consensus.cc:1275] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:07.422705 14920 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:07.465512 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.348237 14777 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:07.473625 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78729.6us
I20260709 13:17:07.482347 10743 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:07.483989 14907 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:07.484272 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56115.5us
I20260709 13:17:07.485034 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.485702 14944 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.486920 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.489485 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.491737 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.492177 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:07.464804 14936 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:07.493683 14936 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.494076 14936 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.494326 10487 catalog_manager.cc:5697] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:07.495848 10487 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 8 to 11, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.496421 14616 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.426559 14808 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.498111 10594 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:07.501052 10743 raft_consensus.cc:2368] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:07.505635 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.506162 10666 raft_consensus.cc:2376] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12. Re-sending same reply.
I20260709 13:17:07.507624 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.508697 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.511145 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.504029 14907 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.514155 14907 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:07.514637 14907 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.472074 14397 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.472334 14930 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.519258 10661 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.520771 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.503286 14938 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:07.532269 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 52443.3us
I20260709 13:17:07.534658 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.534715 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.535388 10743 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:07.540614 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.541847 10663 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:07.542021 10666 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:07.521157 14930 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:07.520434 14810 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:07.546810 10666 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:07.543401 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.517014 14936 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.526070 14907 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:07.530697 14837 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:07.549487 14887 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.868s	user 0.014s	sys 0.002s
I20260709 13:17:07.536468 14939 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:07.547971 14930 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.561805 14936 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:07.561996 14616 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.564970 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:07.565200 14893 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:07.566092 14893 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:07.566201 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:07.566483 14893 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:07.567447 14893 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.568821 14893 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.569799 14527 consensus_queue.cc:1048] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:07.571398 14678 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.571756 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.571888 14678 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:07.574098 14678 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.575582 14678 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.576335 10742 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.576952 14847 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:07.526010 10487 catalog_manager.cc:5697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.579003 10487 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.583742 14808 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.584393 14808 consensus_queue.cc:1059] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:07.559348 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.587718 10743 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:07.550719 14810 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.589331 14808 raft_consensus.cc:3055] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:07.559741 14887 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.591493 14922 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:07.631017 10669 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:07.581027 10487 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 10 to 11, leader changed from <none> to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:07.634238 14887 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.634173 10487 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:07.623466 14640 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:07.640704 14640 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.559324 14837 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.650465 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.651227 10669 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:07.663034 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 176191us
I20260709 13:17:07.664003 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:07.665035 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 131999us
I20260709 13:17:07.628885 14808 raft_consensus.cc:740] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:07.675446 10592 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:07.675422 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.642009 14922 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:07.551764 14920 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.680908 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:07.683180 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:07.679595 14397 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:07.679876 14915 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:17:07.665289 14836 consensus_meta.cc:287] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.006s
I20260709 13:17:07.684531 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.689845 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.686101 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.636564 10487 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 8, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.693455 10585 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:07.667822 14676 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:07.699271 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.709584 10740 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:07.711323 10587 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:07.712224 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:07.713951 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.586288 14939 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.716568 10593 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:07.720674 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:07.721347 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.722672 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.727169 10669 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:07.683599 14925 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.728308 10560 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.728226 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.686142 14640 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:07.710057 14719 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.685519 14397 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.686228 14878 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:17:07.736858 10708 leader_election.cc:400] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:07.753383 10708 leader_election.cc:403] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.754093 10669 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.721654 14847 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.766474 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.729382 14941 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.696612 14904 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:07.732911 14676 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.711836 14836 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.734192 14903 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.760753 14397 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:07.779278 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48589.6us
I20260709 13:17:07.780987 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.781199 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:07.687101 14922 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.767987 14938 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:07.717386 10487 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:07.738282 14808 consensus_queue.cc:260] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.727632 14947 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:17:07.786206 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.771096 14721 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.785213 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:07.794961 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:07.771677 14954 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.770831 14918 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.785976 14950 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:17:07.797148 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.783800 10664 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:07.799363 10736 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:07.788733 14656 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:07.800522 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 66673.4us
I20260709 13:17:07.804209 10661 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:07.804612 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.777599 14911 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.813360 10664 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:07.810690 10735 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:07.791831 14957 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:17:07.802927 14676 raft_consensus.cc:2764] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:17:07.817200 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 906719us
I20260709 13:17:07.824819 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.825676 10735 raft_consensus.cc:2393] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:17:07.826161 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 97924.1us
I20260709 13:17:07.818290 14841 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.834682 14841 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:07.810333 14656 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.835856 14656 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.835559 14841 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.836760 14841 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:07.818712 14852 consensus_meta.cc:287] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.746s	user 0.017s	sys 0.000s
I20260709 13:17:07.837539 14852 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:07.803470 14922 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.812655 14808 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.842387 14654 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.844305 14911 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:07.845713 10743 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.822757 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1784) took 1028 ms. Trace:
I20260709 13:17:07.823027 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.846355 10591 rpcz_store.cc:276] 0709 13:17:06.794841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.808955 (+ 14114us) service_pool.cc:224] Handling call
0709 13:17:07.822596 (+1013641us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001abdd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:07.822699 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819280640}
I20260709 13:17:07.827132 10560 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.830911 10487 catalog_manager.cc:5697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:07.833772 14949 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:17:07.809202 14938 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.848755 10669 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
W20260709 13:17:07.854485 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49939.7us
I20260709 13:17:07.861588 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:07.864588 14910 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.834s	user 0.003s	sys 0.000s
I20260709 13:17:07.859707 10664 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:07.764487 14719 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.871661 14719 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:07.871937 14853 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:07.872421 14853 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.879516 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1793) took 1082 ms. Trace:
I20260709 13:17:07.879904 10590 rpcz_store.cc:276] 0709 13:17:06.798757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.811947 (+ 13190us) service_pool.cc:224] Handling call
0709 13:17:06.839364 (+ 27417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.964974 (+125610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.879226 (+914252us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001e37d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:07.879422 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280137088}
I20260709 13:17:07.885327 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 491) took 1841 ms. Trace:
I20260709 13:17:07.869829 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.885794 11416 rpcz_store.cc:276] 0709 13:17:06.046155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.052545 (+  6390us) service_pool.cc:224] Handling call
0709 13:17:07.885051 (+1832506us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540065e5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:07.885218 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822628096}
I20260709 13:17:07.891389 14425 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:07.892407 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:07.892675 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 65666.9us
I20260709 13:17:07.889022 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.893779 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.896720  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:07.904045 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54112.3us
I20260709 13:17:07.815270 14810 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:07.905153 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:07.914973 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 86531.6us
I20260709 13:17:07.915452 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.915035 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.917471 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.860653 14721 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.920292 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.918442 10664 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:07.900401 14676 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.921986 10734 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:07.901162 14616 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.922681 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.923329 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:07.923213 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:07.810958 14918 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:07.935696 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.939548 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:07.938038 10735 raft_consensus.cc:1240] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.941473 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.892227 14938 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.944578 10664 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:07.946561 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.942865 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.944780 10590 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:07.919238 14961 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:07.949888 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.950984 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:07.951398 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46337.8us
I20260709 13:17:07.959486 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:07.949497 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.958082 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.960075 10664 raft_consensus.cc:2368] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:17:07.962261 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.967754 10664 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:07.948875 14925 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.970829 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.971661 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.968782 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:07.942926 14425 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.942107 14911 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.939108 14676 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:07.958328 14777 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.942493 14616 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:07.978330 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.947425 14654 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.947219 14721 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.991525 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.010188 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:07.958043 14903 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:07.970618 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:08.017704 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47187us
I20260709 13:17:07.957162 14961 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:07.948998 14938 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.977530 10664 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:17:08.034921 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.013422 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.023715 14853 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.025477 10487 catalog_manager.cc:5697] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 1 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:08.028759 14731 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.000s
I20260709 13:17:08.015892 14721 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:08.030028 14654 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.030405 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:07.992082 14917 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.992214 14915 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.013396 14616 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.038049 10664 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:08.006605 14676 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.082242 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48459us
I20260709 13:17:08.085860 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.112432 10669 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:07.976663 14397 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:07.991554 14887 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:17:08.092492 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:08.101402 11379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.136608 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.140741 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:08.141417 10664 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:08.141662 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:08.155287 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 124950us
I20260709 13:17:08.157514 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.083226 14855 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.098090 14721 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.135702 14951 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:17:08.098709 14917 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:08.173409 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 195330us
W20260709 13:17:08.171671 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 85957.1us
I20260709 13:17:08.132577 14925 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:08.173569 14952 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:17:08.154914 14810 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:08.195670 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.203019 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 226814us
I20260709 13:17:08.177188 14917 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.179088 14654 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.173396 14939 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:08.181922 14839 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:17:08.254247 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 79557.5us
W20260709 13:17:08.204013 14956 log.cc:927] Time spent T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:08.205808 14925 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:08.263381 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 88052.4us
W20260709 13:17:08.246518 14955 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:08.259241 10560 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:08.266314 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 110195us
W20260709 13:17:08.259262 14959 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:08.268047 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.268663 10708 leader_election.cc:400] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:17:08.270408 10708 leader_election.cc:403] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:08.219364 14654 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.275456 14654 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.275975 14654 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:08.277374 14958 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:08.182533 14961 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.279019 14911 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:08.280596 14941 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:17:08.280995 14941 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.286015 14397 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:08.286837 14946 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:17:08.287919 14885 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:08.288321 14885 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.288653 14885 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:08.298238 14969 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:08.299364 14886 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:17:08.300068 14676 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.301020 14961 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.310413 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2241) took 1314 ms. Trace:
W20260709 13:17:08.310704 14967 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:17:08.310817 10737 rpcz_store.cc:276] 0709 13:17:06.996160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.996394 (+   234us) service_pool.cc:224] Handling call
0709 13:17:06.996756 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.090659 (+ 93903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.310182 (+1219523us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b540036bad4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:08.310356 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212318592}
I20260709 13:17:08.312198 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:08.312732 10737 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:08.313879 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:08.314558 10737 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
W20260709 13:17:08.304698 14970 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:08.315297 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:08.315840 10737 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
W20260709 13:17:08.305615 14973 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:17:08.306461 14853 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.316679 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:08.306540 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:08.317576 14930 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.725s	user 0.002s	sys 0.007s
I20260709 13:17:08.317744 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.317951 14930 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.318323 10737 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.319607 10589 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:08.319768 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 516) took 1546 ms. Trace:
I20260709 13:17:08.320164 10662 rpcz_store.cc:276] 0709 13:17:06.773645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.773744 (+    99us) service_pool.cc:224] Handling call
0709 13:17:06.774030 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.774256 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.774285 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.775897 (+  1612us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.912812 (+136915us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:06.965411 (+ 52599us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.970150 (+  4739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.970222 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.464864 (+494642us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b18003fb320. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc522 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:08.315625 (+850761us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18003fb320. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:08.319597 (+  3972us) raft_consensus.cc:1685] finished
0709 13:17:08.319616 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.319719 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2198,"prepare.queue_time_us":53011,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":6444,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":19161,"spinlock_wait_cycles":20369024,"thread_start_us":136589,"threads_started":1,"wal-append.queue_time_us":249031}
I20260709 13:17:08.322459 10734 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:08.323101 10660 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:08.326447 14938 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.332332 14938 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.328673 10667 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:08.330274 14885 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.327569 14425 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:08.220166 14975 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
W20260709 13:17:08.334918 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 242520us
W20260709 13:17:08.340529 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.342039 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78034.2us
I20260709 13:17:08.343016 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.344532 10635 leader_election.cc:400] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:08.358916 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:08.359200 10740 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:08.346939 14837 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:08.347278 14810 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:08.347798 14936 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:08.347973 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 91509.1us
W20260709 13:17:08.370414 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.349864 14933 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.350306 14907 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.351076 14904 raft_consensus.cc:993] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:08.354027 14930 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.335031 14885 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.355260 14676 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.337908 10706 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.356460 14616 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.357802 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.263170 14903 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:17:08.361209 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 102077us
I20260709 13:17:08.398073 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.363499 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.348519 14731 consensus_queue.cc:1048] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:08.373661 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 215847us
I20260709 13:17:08.374796 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.370705 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:08.374704 14939 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.402217 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.402500 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.403110 10662 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.403967 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:08.393564 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126140us
I20260709 13:17:08.395067 10587 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.408280 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.269275 14656 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.411670 10737 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:08.403985 14939 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.413995 14939 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.413134 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.417910 14977 raft_consensus.cc:1081] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Signalling peer fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:08.418104 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 515) took 1644 ms. Trace:
I20260709 13:17:08.419206 14918 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:08.419747 14982 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 8. Current term is 9.
I20260709 13:17:08.418535 10665 rpcz_store.cc:276] 0709 13:17:06.773382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.773485 (+   103us) service_pool.cc:224] Handling call
0709 13:17:06.773747 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.773918 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:06.881075 (+107157us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.417661 (+1536586us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003fb560. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256e614bc 00007f42541af48b 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287
0709 13:17:08.417772 (+   111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.417821 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:08.417873 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.417944 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.418052 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12000,"prepare.queue_time_us":86575,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":73852,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4361,"spinlock_wait_cycles":27631872,"thread_start_us":436514,"threads_started":3,"wal-append.queue_time_us":325732,"wal-append.run_cpu_time_us":1954,"wal-append.run_wall_time_us":1134710}
I20260709 13:17:08.385968 14902 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:08.421857 14937 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:08.424201 10560 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:08.436427 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 65799.7us
I20260709 13:17:08.424228 10587 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
W20260709 13:17:08.442126 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 104277us
I20260709 13:17:08.442797 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:08.446354 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46938us
W20260709 13:17:08.448055 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45893.1us
I20260709 13:17:08.448942 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:08.460204 10735 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:17:08.460300 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.462476 10560 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.413153 14940 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:08.426229 14954 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.468808  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:08.399914 14841 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:17:08.444484 14918 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:08.393025 14907 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.444926 14977 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:08.461066 14937 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:08.479125 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70952.1us
I20260709 13:17:08.482409 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.458374 14933 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:08.482421 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45220.4us
I20260709 13:17:08.486805 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.488372 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.489646 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.490891 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.491858 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.492312 10585 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.493690 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:08.494117 14721 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.495580 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2165) took 1007 ms. Trace:
I20260709 13:17:08.495949 10738 pending_rounds.cc:85] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 9
I20260709 13:17:08.496115 14721 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.496275 10738 pending_rounds.cc:107] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:08.496605 10738 raft_consensus.cc:2889] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.489171 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:08.498291 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:08.498940 11412 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:08.500797 14656 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.495958 10668 rpcz_store.cc:276] 0709 13:17:07.488366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.488477 (+   111us) service_pool.cc:224] Handling call
0709 13:17:07.507152 (+ 18675us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.530807 (+ 23655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.530838 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.540310 (+  9472us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.325382 (+785072us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b18003b01a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:17:08.425488 (+100106us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:08.425526 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.425640 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.495281 (+ 69641us) raft_consensus.cc:1685] finished
0709 13:17:08.495313 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.495524 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9250,"raft.queue_time_us":9786,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8460,"spinlock_wait_cycles":8076544,"thread_start_us":99931,"threads_started":1,"wal-append.queue_time_us":949684}
I20260709 13:17:08.501246 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.501546 14940 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.502251 14616 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.502380 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.472610 14915 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.473059 14983 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.502506 14940 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.467628 14982 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.484468 14937 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.493536 14774 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:08.486713 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.483381 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:08.517297 11414 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.516991 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.503167 10593 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:08.504864 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:08.506245 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.518841 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.510353 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.508119 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.520004 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:08.516875 10737 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.521616 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.514356 10739 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:08.472820 14904 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.528065 10590 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:08.528331 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:08.532217 14930 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:08.534274 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.535326 10743 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:08.536182 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:08.514192 14918 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.537508 14497 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:08.524806 14982 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.538206 14918 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.529078 14983 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:08.538226 14497 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.542455 14497 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.542971 14836 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:08.544376 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:08.545903 14902 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.556660 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.557641 10662 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
W20260709 13:17:08.557708 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47475.1us
I20260709 13:17:08.558480 11414 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:08.558562 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.504370 14977 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.559726 10588 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:08.516765 14937 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:08.562822 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45907.2us
I20260709 13:17:08.566367 14930 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.566756 14930 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.561379 14886 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.567480 14930 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.568636 14930 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.503961 14915 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.573556 14937 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.575271 14915 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.576557 14937 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.579811 14983 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.580123 14721 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:08.580265 14983 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:08.580436 14777 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:08.581235 14777 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.581343 14983 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.582274 14777 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:08.603829 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 85072.1us
I20260709 13:17:08.604782 10559 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.557085 14844 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:08.608512 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 86984.1us
I20260709 13:17:08.604802 10585 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:08.611564 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.608779 10737 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
W20260709 13:17:08.609009 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50527.7us
I20260709 13:17:08.609923 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:08.613832 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.609540 14616 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:08.564229 14954 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.582760 14983 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.503515 14917 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.621079 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.623050 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.623350 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.624994 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:08.626322 10662 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:08.628777 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 177972us
I20260709 13:17:08.522455 14933 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:17:08.632052 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.622318 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.632185 11412 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.641884 10665 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:08.632784 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.647441 10665 pending_rounds.cc:85] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 5
I20260709 13:17:08.647670 10665 pending_rounds.cc:107] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:08.647903 10665 raft_consensus.cc:2889] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.648864 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.642833 14676 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.651422 14676 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.653425 14676 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:08.642977 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:08.609930 14836 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.610719 14844 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.657045 10737 raft_consensus.cc:1240] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:17:08.633984 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.610502 14915 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:08.633179 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.661033 10736 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:08.616678 14616 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:08.668278 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:08.668499 10592 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:08.667464 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.618709 14954 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:08.620831 14982 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:08.669293 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.643424 14656 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:08.670199 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:08.619827 14989 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.611191 14939 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.672825 10666 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:08.678675 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:08.679798 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:08.680119 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47432.2us
I20260709 13:17:08.666438 14844 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.670697 14425 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.673527 14954 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.665148 14774 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.679015 14982 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.691406 10666 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:08.693060 10737 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:08.683651 14944 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.688880 14676 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.699268 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:08.668583 14996 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:08.679421 14938 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.700657 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1658) took 1160 ms. Trace:
I20260709 13:17:08.701309 10666 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:08.685267 14904 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.616680 14977 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.702466 14616 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.680169 14941 consensus_queue.cc:1059] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:08.705333 10742 rpcz_store.cc:276] 0709 13:17:07.540138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.544364 (+  4226us) service_pool.cc:224] Handling call
0709 13:17:07.576115 (+ 31751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.576752 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.700481 (+1123729us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b540036e2d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:08.700602 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72210816}
W20260709 13:17:08.738456 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46225us
I20260709 13:17:08.671725 14915 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:08.741866 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:08.703256 14996 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:08.744014 10742 raft_consensus.cc:1240] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:08.745884 10593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:08.746443 10593 raft_consensus.cc:606] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.746762 10593 raft_consensus.cc:614] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:08.746917 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.700727 14774 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.686427 14989 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:08.754774 14991 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:17:08.748189 14930 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:08.752817 14810 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.765187 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.767197 10635 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:08.752542 14907 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:08.768100 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:08.758072 14731 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.764086 14930 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:08.894804 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.750294 15001 consensus_queue.cc:1059] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:08.770332 14933 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.970010 14907 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:08.981817 14998 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:17:08.981575 14907 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:08.983327 15006 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:17:08.984555 14907 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.010644 14774 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.021852 14930 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.023427 14930 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.026599 14982 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.028561 14902 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.028736 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.035023 14915 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.042997 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:09.044029 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.051940 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 283912us
I20260709 13:17:09.056983 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:08.859342 14917 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.074854 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.075552 10661 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:09.075454 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:08.932245 14721 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:08.933718 14938 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.078780 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:09.079758 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:09.080140 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2167) took 1591 ms (client timeout 1765 ms). Trace:
W20260709 13:17:09.086364 10660 rpcz_store.cc:269] 0709 13:17:07.488883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.488997 (+   114us) service_pool.cc:224] Handling call
0709 13:17:09.079958 (+1590961us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400321c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.080068 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837177216}
I20260709 13:17:08.974795 14933 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.098117 14933 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.073964 14982 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.093178 14731 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:09.052769 14676 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.075958 14907 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.071134 15001 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.123906 11412 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:09.094435 14721 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.076514 14939 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.096227 15009 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.191851 10661 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:09.166700 14917 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.228403 14917 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.231099 14917 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.166832 14915 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.231819 14983 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.001s
I20260709 13:17:09.270028 14983 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.270601 14983 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.181332 14907 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.279068 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:09.280119 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 193342us
I20260709 13:17:09.096812 14938 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.177810 14982 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:08.952279 14996 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.179955 14676 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:09.294008 10664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.029s
I20260709 13:17:09.283290 14907 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:09.311237 10664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.029s
I20260709 13:17:09.197009 14844 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.330047 15020 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.330691 15014 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:17:09.330637 15020 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.332849 15020 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.278899 14939 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:09.278426 14915 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:09.363515 10662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.021s	sys 0.019s
I20260709 13:17:09.316826 15000 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:09.364724 10662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.021s	sys 0.019s
I20260709 13:17:09.327212 14996 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:09.398790 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 146627us
W20260709 13:17:09.399772 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.365135 14989 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.395838 10739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:17:09.405650 10739 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:09.406008 10739 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:09.417687 15010 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:17:09.418207 14954 consensus_meta.cc:287] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.003s
I20260709 13:17:09.418640 14954 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.420657 14954 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:09.422127 15013 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:17:09.425179 14938 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.426867 14721 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.430688 14676 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.462906 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.471114 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.471906 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.473827 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 522) took 1556 ms. Trace:
I20260709 13:17:09.476219 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.469535 15009 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.481717 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.475049 10591 rpcz_store.cc:276] 0709 13:17:07.917124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.917269 (+   145us) service_pool.cc:224] Handling call
0709 13:17:07.917670 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.974844 (+ 57174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.974877 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.978726 (+  3849us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.165578 (+186852us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:08.178044 (+ 12466us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.179148 (+  1104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.435081 (+1255933us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:09.462512 (+ 27431us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.462937 (+   425us) raft_consensus.cc:1685] finished
0709 13:17:09.473498 (+ 10561us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.473687 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16478,"prepare.queue_time_us":24908,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1670,"raft.queue_time_us":19858,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":14236,"spinlock_wait_cycles":125244160,"thread_start_us":131960,"threads_started":1,"wal-append.queue_time_us":301273,"wal-append.run_cpu_time_us":1833,"wal-append.run_wall_time_us":1003646}
I20260709 13:17:09.488047 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.479288 14937 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.488602 10594 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 5.
I20260709 13:17:09.506728 14911 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.507387 14911 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.508272 14936 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:09.508670 14936 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.509606 15027 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.509737 15026 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.510145 15027 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.510432 15026 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.512219 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.512804 10665 raft_consensus.cc:2376] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10. Re-sending same reply.
I20260709 13:17:09.512997 15026 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.513808 15026 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.514328 15026 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.516768 15026 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.513195 14844 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.520325 14915 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.526820 10741 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:09.523384 10739 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.531273 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.532017 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.533730 10739 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.536408 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.506381 15025 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.538582 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.527657 14982 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.540073 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.541340 10666 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:09.541802 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50140 (request call id 2263) took 1026 ms. Trace:
I20260709 13:17:09.541759 10661 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:09.542471 10739 rpcz_store.cc:276] 0709 13:17:08.515921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.286717 (+770796us) service_pool.cc:224] Handling call
0709 13:17:09.534179 (+247462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.543108 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.540377 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.545617 10665 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:09.545958 15003 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.819s	user 0.010s	sys 0.010s
I20260709 13:17:09.546144 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.546782 10668 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.547521 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2253) took 1060 ms. Trace:
I20260709 13:17:09.547899 10738 rpcz_store.cc:276] 0709 13:17:08.487200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.495524 (+  8324us) service_pool.cc:224] Handling call
0709 13:17:08.495796 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.497118 (+  1322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.497146 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.507940 (+ 10794us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.675923 (+167983us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:08.675954 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.676016 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.537831 (+861815us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:09.547147 (+  9316us) raft_consensus.cc:1685] finished
0709 13:17:09.547169 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.547452 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7405312,"thread_start_us":144693,"threads_started":1,"wal-append.queue_time_us":201784}
I20260709 13:17:09.549599 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.550788 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:09.551791 14983 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.552275 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.553596 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.553396 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.554193 10660 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:09.554520 10666 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:09.555380 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.556146 10738 raft_consensus.cc:2393] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:09.556982 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.557789 10738 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:09.558923 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1671) took 1617 ms. Trace:
I20260709 13:17:09.565600 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:09.566144 10734 rpcz_store.cc:276] 0709 13:17:07.941822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.941941 (+   119us) service_pool.cc:224] Handling call
0709 13:17:07.956622 (+ 14681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.322824 (+366202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.558708 (+1235884us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001586d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:09.558869 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840876800}
W20260709 13:17:09.561565 15017 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:09.563421 10663 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:09.567303 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:09.563843 10740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1675) took 1559 ms (client timeout 1504 ms). Trace:
W20260709 13:17:09.564750 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1674) took 1564 ms (client timeout 1524 ms). Trace:
I20260709 13:17:09.533542 14936 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.551858 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:09.571179 10734 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
W20260709 13:17:09.571333 10740 rpcz_store.cc:269] 0709 13:17:08.004827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.038960 (+ 34133us) service_pool.cc:224] Handling call
0709 13:17:09.563683 (+1524723us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54001ccd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.563780 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449476480}
I20260709 13:17:09.572563 14982 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:09.572701 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.572970 14982 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.573395 14982 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:09.571398 10741 rpcz_store.cc:269] 0709 13:17:07.999980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.000130 (+   150us) service_pool.cc:224] Handling call
0709 13:17:09.564591 (+1564461us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540014d054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.564690 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3313500544}
I20260709 13:17:09.570849 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:09.574494 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.574447 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.512301 14933 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.575281 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.575132 10741 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:09.576090 10738 raft_consensus.cc:2393] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:09.540997 15025 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.576470 10668 raft_consensus.cc:2468] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:09.576975 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:09.578742 10669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2412) took 1711 ms (client timeout 2234 ms). Trace:
W20260709 13:17:09.579203 10669 rpcz_store.cc:269] 0709 13:17:07.867199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.970538 (+103339us) service_pool.cc:224] Handling call
0709 13:17:09.578538 (+1608000us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54001de054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.578669 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311826688}
I20260709 13:17:09.579982 10734 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.580982 10741 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:09.581990 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2264) took 1065 ms. Trace:
I20260709 13:17:09.582201 10741 rpcz_store.cc:276] 0709 13:17:08.516280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.576223 (+1059943us) service_pool.cc:224] Handling call
0709 13:17:09.580831 (+  4608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.581370 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.581952 (+   582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.583577 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 617) took 1033 ms. Trace:
I20260709 13:17:09.584947 10738 rpcz_store.cc:276] 0709 13:17:08.550076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.577563 (+1027487us) service_pool.cc:224] Handling call
0709 13:17:09.583220 (+  5657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.583379 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.583407 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.583433 (+    26us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:09.583451 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.583482 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.583543 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.586180 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.586211 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 616) took 1036 ms. Trace:
I20260709 13:17:09.586889 10740 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:09.586756 10739 rpcz_store.cc:276] 0709 13:17:08.549804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.576813 (+1027009us) service_pool.cc:224] Handling call
0709 13:17:09.585649 (+  8836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.585831 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.585867 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.585921 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:09.585965 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.586033 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.586150 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.577152 14983 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:09.545105 15009 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.592304 10734 raft_consensus.cc:1240] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.585913 14810 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:09.610821 14810 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.613801 14964 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.614761 14964 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.597965 14907 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.602610 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.604569 15022 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:09.606423 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.610211 15025 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.589013 14983 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.623497 15022 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.625383 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2191) took 1002 ms. Trace:
I20260709 13:17:09.626073 14933 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.617444 10734 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
W20260709 13:17:09.636870 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 91845.5us
I20260709 13:17:09.634306 10664 rpcz_store.cc:276] 0709 13:17:08.623307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.623462 (+   155us) service_pool.cc:224] Handling call
0709 13:17:08.623763 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:08.688410 (+ 64647us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:08.723316 (+ 34906us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.322040 (+598724us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:09.327705 (+  5665us) log.cc:844] Serialized 52 byte log entry
0709 13:17:09.327881 (+   176us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:09.328125 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.478004 (+149879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.478079 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.625163 (+147084us) raft_consensus.cc:1685] finished
0709 13:17:09.625182 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.625306 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59815,"prepare.queue_time_us":35199,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":66,"raft.queue_time_us":67478,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"spinlock_wait_cycles":11672960,"thread_start_us":733505,"threads_started":2,"wal-append.queue_time_us":663264}
I20260709 13:17:09.644374 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:09.644730 15022 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.645038 10586 raft_consensus.cc:606] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:09.645459 10586 raft_consensus.cc:614] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.644816 15000 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:09.646032 15000 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.616230 14936 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.650405 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.655205 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.658036 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.658631 10734 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:09.658041 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.662089 10665 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
W20260709 13:17:09.664098 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.636808 14983 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.673930 14810 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.665728 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:09.674361 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.675603 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.689518 10593 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.690199 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.690894 10736 raft_consensus.cc:2376] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15. Re-sending same reply.
I20260709 13:17:09.665131 10587 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.676136 10588 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.676631 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:09.636309 14809 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.677304 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.679788 14997 raft_consensus.cc:3055] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:09.678756 14907 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.682646 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2260) took 1176 ms. Trace:
I20260709 13:17:09.698402 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.683269 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1672) took 1712 ms. Trace:
I20260709 13:17:09.683970 10734 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:09.684304 10737 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:09.692353 10594 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.654985 14902 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.695602 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.700606 10735 rpcz_store.cc:276] 0709 13:17:07.971233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.971384 (+   151us) service_pool.cc:224] Handling call
0709 13:17:09.683090 (+1711706us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540036bfd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.683216 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110360960}
I20260709 13:17:09.703315 10736 raft_consensus.cc:2376] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10. Re-sending same reply.
I20260709 13:17:09.683990 15001 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:09.698292 10742 rpcz_store.cc:276] 0709 13:17:08.506561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.749426 (+242865us) service_pool.cc:224] Handling call
0709 13:17:08.749750 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.753626 (+  3876us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:08.766355 (+ 12729us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.946581 (+180226us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.946817 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.946877 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:08.946942 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.681936 (+734994us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b18003734e0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419
0709 13:17:09.682445 (+   509us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b54001ce8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:09.682489 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.682596 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10709,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":2952,"raft.queue_time_us":87,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18008,"spinlock_wait_cycles":21848704,"thread_start_us":179506,"threads_started":1,"wal-append.queue_time_us":369801}
I20260709 13:17:09.707556 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.706259 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:09.708845 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.709271 10559 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.712174 10734 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:09.714115 10734 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:09.714854 10734 pending_rounds.cc:85] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
I20260709 13:17:09.715210 10734 pending_rounds.cc:107] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:09.715559 10734 raft_consensus.cc:2889] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.717247 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.720945 10735 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:09.723665 10735 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:17:09.724164 10735 pending_rounds.cc:85] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 8
I20260709 13:17:09.724486 10735 pending_rounds.cc:107] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:17:09.725257 10735 raft_consensus.cc:2889] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.726351 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.727074 10735 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:09.727558 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:09.696671 14997 raft_consensus.cc:740] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.697131 14809 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.734993 10736 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:09.719041 14886 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:09.716636 14977 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.706974 15001 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.701805 14930 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:09.735785 10735 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.702839 14616 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:09.754293 14964 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.756038 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 634) took 1839 ms. Trace:
I20260709 13:17:09.756616 10594 raft_consensus.cc:606] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.757045 10594 raft_consensus.cc:614] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.762642 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2258) took 1274 ms. Trace:
I20260709 13:17:09.762981 10737 rpcz_store.cc:276] 0709 13:17:08.488354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.703983 (+215629us) service_pool.cc:224] Handling call
0709 13:17:09.684053 (+980070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.701139 (+ 17086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.762478 (+ 61339us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540036bfd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.762592 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174737664}
I20260709 13:17:09.764644 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1820) took 1408 ms. Trace:
I20260709 13:17:09.765035 10592 rpcz_store.cc:276] 0709 13:17:08.356031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.358098 (+  2067us) service_pool.cc:224] Handling call
0709 13:17:08.358355 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.668945 (+310590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.764416 (+1095471us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400169254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:09.764589 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712880384}
I20260709 13:17:09.765614 14837 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:09.766090 14837 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.766541 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.766875 14837 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.768121 14837 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.716511 14902 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.771732 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.777951 11415 raft_consensus.cc:1240] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.778693 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:09.778330 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.773216 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.750650 10741 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:09.778754 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.780166 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:09.775820 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:09.788998 11411 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:09.789492 11410 raft_consensus.cc:2368] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.789898 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:09.790213 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.777448 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.790577 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:09.787077 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 77913.6us
I20260709 13:17:09.792223 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.781561 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.793846 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:09.792824 11414 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:09.790077 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:09.794631 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.794996 10589 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:09.792878 10559 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.795384 10589 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:09.797664 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:09.799244 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:09.733973 14365 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.802227 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:09.810868 10585 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:09.772377 14957 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.812045 10632 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.805572 14844 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:09.808290 14721 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.812497 14885 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:09.815347 14844 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.815979 14942 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:09.816793 14809 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.808485 15028 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.818449 15028 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.818950 15028 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.774909 14987 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.777990 14810 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.808578 14886 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:09.826994 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.808372 14640 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:09.829370 10591 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.801084 14731 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.756433 11416 rpcz_store.cc:276] 0709 13:17:07.916220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.916358 (+   138us) service_pool.cc:224] Handling call
0709 13:17:07.938874 (+ 22516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.939117 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:08.457617 (+518500us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.620160 (+162543us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.738541 (+1118381us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b18003c5560. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc522 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:09.755544 (+ 17003us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b18003c5560. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f42541cea40 00007f42541c94e4 00007f42541c9455 00007f42572b1060 00007f42572c3716 00007f42572d4287 00007f42572d4208
0709 13:17:09.755682 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.755731 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:09.755786 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.755851 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.755958 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1108317,"prepare.queue_time_us":217038,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":1149240,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":15030,"spinlock_wait_cycles":69053952,"thread_start_us":599513,"threads_started":2,"wal-append.queue_time_us":216189,"wal-append.run_cpu_time_us":1505,"wal-append.run_wall_time_us":1045169}
I20260709 13:17:09.813062 10589 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.776278 14911 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.812692 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.772567 14986 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:09.814838 10632 leader_election.cc:403] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.836331 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2254) took 1348 ms. Trace:
I20260709 13:17:09.818387 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:09.814658 10557 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:09.813516 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:09.823174 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:09.769279 14841 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.810765 14979 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.810528 14719 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.824926 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:09.855875 10736 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.826411 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.825924 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.856725 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:09.856948 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:09.858019 10591 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:09.813575 15022 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.836632 10743 rpcz_store.cc:276] 0709 13:17:08.487443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.537015 (+ 49572us) service_pool.cc:224] Handling call
0709 13:17:08.661702 (+124687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.668829 (+  7127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.668857 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.685244 (+ 16387us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.690643 (+  5399us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:08.690685 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.690745 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.953679 (+262934us) raft_consensus.cc:1685] finished
0709 13:17:08.953708 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.829813 (+876105us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003787d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:09.836269 (+  6456us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3326,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9023,"spinlock_wait_cycles":286051072,"thread_start_us":938,"threads_started":1,"wal-append.queue_time_us":1274}
I20260709 13:17:09.810958 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.830735 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2268) took 1214 ms. Trace:
W20260709 13:17:09.861697 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49069.3us
I20260709 13:17:09.861958 10740 rpcz_store.cc:276] 0709 13:17:08.616512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.587369 (+970857us) service_pool.cc:224] Handling call
0709 13:17:09.593905 (+  6536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.594266 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.594292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.594575 (+   283us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.723317 (+128742us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:09.723362 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.723429 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.830536 (+107107us) raft_consensus.cc:1685] finished
0709 13:17:09.830557 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.830687 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":869,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":846,"thread_start_us":121700,"threads_started":1,"wal-append.queue_time_us":189535}
I20260709 13:17:09.830838 10589 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.808205 14996 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.806080 15025 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.837675 10735 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:09.839673 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:09.840854 10632 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.841526 14986 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.842909 14937 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.843259 14902 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.828727 14640 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:09.853638 14810 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:09.825563 14957 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.864104 10708 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:09.885974 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:09.887382 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:09.867826 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 53228.7us
W20260709 13:17:09.867516 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 54056.2us
I20260709 13:17:09.866791 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:09.873404 11410 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:09.830158 14885 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:09.875254 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62578.3us
I20260709 13:17:09.865042 14892 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.862851 14911 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.825270 14964 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:09.882146 14640 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.869796 10632 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.887686 10736 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:09.889792 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:09.880489 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:09.874081 14844 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.861112 14915 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:09.865139 14996 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.871304 14942 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:09.869066 14676 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.895133 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:09.897559 14911 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.794348 14997 consensus_queue.cc:260] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.941298 14809 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:09.980388 14997 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.980651 14942 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.874032 14841 consensus_queue.cc:1059] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:09.981290 14942 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.982102 14841 raft_consensus.cc:3055] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.982585 14841 raft_consensus.cc:740] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:09.963691 14915 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.983567 14841 consensus_queue.cc:260] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.906098 14904 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:09.985500 14904 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:09.985821 14915 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:09.986454 14904 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.987959 14904 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.897478 14940 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.989686 14940 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.874282 14983 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.992579 14983 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.900116 14957 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:09.903609 15000 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.994813 15000 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.877246 14907 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.898578 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.995889 11416 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:09.874922 15022 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:09.997275 15022 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.920706 14986 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:09.868854 15001 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:09.999893 15001 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.869167 14719 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.869202 14979 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.924809 14989 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:10.001652 14936 consensus_queue.cc:1175] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:10.002386 14989 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.002795 14989 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.873265 14886 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.003851 14886 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.004202 14886 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.868184 15025 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.005391 15025 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.005520 14885 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:09.933012 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.834215 14987 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:09.894310 14954 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.008265 10742 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 6: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:09.925465 15020 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:09.943414 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 73753.1us
W20260709 13:17:09.944636 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64254us
W20260709 13:17:09.945655 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 56067.8us
I20260709 13:17:10.037295 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:09.893903 14930 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:09.959462 14977 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:09.960263 14917 consensus_queue.cc:1059] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:10.033836 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 138808us
I20260709 13:17:10.045780 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:09.951792 14893 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.041795 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:09.963406 14996 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.985056 14841 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.050800 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.045375 10635 leader_election.cc:400] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11.
I20260709 13:17:09.979159 14836 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.054560 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:10.070773 11417 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:10.034094 14954 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.080472 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.081054 10665 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:10.043184 14907 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.078558 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.060762 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.083063 10664 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:10.040861 14844 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.077265 11416 raft_consensus.cc:2376] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13. Re-sending same reply.
I20260709 13:17:10.035084 15020 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.051038 15000 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.961715 15009 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.047433 14731 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:10.091073 14844 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.091035 14731 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.094735 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.094944 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.051432 14676 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.034932 14616 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:17:10.095997 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.093153 14731 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.096379 14937 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:10.096740 14731 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.097052 14937 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.098469 14937 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:10.100601 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 213325us
I20260709 13:17:10.101459 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.102150 14676 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.102584 10708 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.097093 10635 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.107717 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:10.109607 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.112193 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.043610 14930 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.114552 10589 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:10.118508 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.119818 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.117178 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:09.963445 14903 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:17:10.122309 10708 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:10.116288 14982 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:17:10.125541 14915 raft_consensus.cc:2804] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:10.119609 14856 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.117779 14836 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:10.089181 14907 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.111279 14676 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.138139 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.087232 14954 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.120992 14810 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.126026 14979 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:10.143098 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.104590 15000 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.123963 15009 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.105012 14640 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:10.140923 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 179339us
I20260709 13:17:10.127279 14940 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.110647 14837 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.139180 14856 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.140972 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.126627 14983 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:10.163980 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.140559 15027 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.133088 14942 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.144321 14915 raft_consensus.cc:697] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:10.175767 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.137778 14982 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.172714 14856 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.182667 14942 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.183693 14915 consensus_queue.cc:237] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.176478 14836 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.201948 14982 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:10.202044 15034 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:10.202668 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.203603 10665 raft_consensus.cc:2393] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:10.206712 10668 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
W20260709 13:17:10.165442 15029 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.022s	sys 0.025s
I20260709 13:17:10.214084 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.214819 10663 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:10.163213 14987 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.224236 14719 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.223348 14731 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.227481 14954 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.228086 14731 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:10.228559 14731 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.230881 14933 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:10.231134 14731 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.231266 14933 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.232091 14933 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.233856 14930 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.234176 14996 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.234575 14640 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.235139 15025 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.236125 14996 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:10.221871 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 57955.5us
I20260709 13:17:10.223309 14810 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:10.221482 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 262765us
W20260709 13:17:10.251044 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.170007 15009 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.249051 10662 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.249571 10669 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:10.233139 14933 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.248575 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.137367 15020 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.253207 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.258685 10736 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:17:10.254520 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.260524 10737 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:10.253386 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.267117 10559 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.262714 10735 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:10.280041 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.282325 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:10.285687 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.221525 14837 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.319615 10663 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.319685 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.252815 14997 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.262311 14938 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:10.262508 14930 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.292100 15020 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.332357 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.314512 14982 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:10.263075 14810 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.281078 14954 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.326350 10706 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.340494 11410 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
W20260709 13:17:10.324967 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 205221us
I20260709 13:17:10.318390 14936 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.256923 14856 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.341281 11410 pending_rounds.cc:85] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Aborting all ops after (but not including) 9
I20260709 13:17:10.349200 11410 pending_rounds.cc:107] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:10.349589 11410 raft_consensus.cc:2889] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:10.335374 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.346272 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 94281.6us
I20260709 13:17:10.326593 15025 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.326530 15043 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.285377 14989 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.355014 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.318760 15028 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.366621 10735 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.339102 15027 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:10.341014 14903 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.368892 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.377422 10660 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.327104 14997 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.378513 11418 raft_consensus.cc:2368] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:10.349067 14954 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.331465 14930 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.381922 10737 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.359103 14915 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.387307 10661 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:10.384630 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:10.363008 15045 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:10.387814 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 105580us
I20260709 13:17:10.378399 14996 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.348488 14982 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.376314 15044 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.378304 15027 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.358320 14936 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.393303 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.398425 10734 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.382592 14954 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.409436 14907 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.409911 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:10.410624 10743 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.413573 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:10.414161 10738 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.414719 14982 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.396903 15044 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.415548 15044 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.421576 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.424612 10738 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:10.399206 15027 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.429719 10743 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:10.435436 10742 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:10.437577 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46418.3us
I20260709 13:17:10.387287 14983 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.369011 15043 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.375499 14940 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:10.381935 14903 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.462807 14903 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.445155 15049 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:10.463462 15049 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:10.446580 15042 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:17:10.447216 15047 log.cc:927] Time spent T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:17:10.447886 15052 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:10.465646 15000 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.467587 15049 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.468088 15049 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.468479 15049 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.454335 14930 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.455156 14982 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.470098 14856 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.469695 14917 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:10.469723 14982 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.471006 14917 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:10.472656 14982 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.472790 14902 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:10.460417 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.473382 14902 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.474625 14942 raft_consensus.cc:3055] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:10.474579 14902 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.476038 14902 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.477180 14997 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.479171 14989 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.481942 15028 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.384948 14837 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.485863 14886 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.487798 14886 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.494576 14936 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.426088 14996 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.495764 14996 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.496266 14893 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.475093 14942 raft_consensus.cc:740] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.504045 10660 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:10.507033 10559 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:10.399113 14915 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:10.438711 14907 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.535383 10740 raft_consensus.cc:1240] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.535303 15027 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.536923 15049 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:10.537843 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.535485 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.539368 10666 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.544432 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.552850 14676 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.554183 15027 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.553753 14676 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.530200 15046 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:10.555094 15046 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.527201 14886 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.555905 15046 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.556130 14886 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.556389 14676 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.558041 14886 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.559624 11382 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.560680 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.563350 14885 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.537798 14915 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.564482 14678 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.566166 14678 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.566509 14678 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.567577 15044 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.563357 15043 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.570749 14365 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:10.571094 14365 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.571174 15045 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.572155 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:10.570971 10632 leader_election.cc:400] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:10.573451 10632 leader_election.cc:403] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:10.563711 14885 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.498485 14983 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.571965 14365 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.574934 11417 raft_consensus.cc:2393] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:10.572974 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.440454 14810 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:10.582804 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 230944us
I20260709 13:17:10.583539 10741 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.586629 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.586982 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.577899 14885 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.590257 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.591681 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.592038 10666 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:10.593626 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.597868 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.595036 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.595253 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.595466 10589 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:10.598774 10589 pending_rounds.cc:85] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 5
I20260709 13:17:10.599040 10592 raft_consensus.cc:2410] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:10.599038 10589 pending_rounds.cc:107] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:10.599967 10589 raft_consensus.cc:2889] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:10.601169 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.601823 10660 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.602283 14938 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.602743 14938 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.589751 14893 consensus_queue.cc:1059] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:10.582944 14856 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.597932 15025 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:10.584749 14676 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.542520 14907 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.578823 14942 consensus_queue.cc:260] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.608606 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.627776 10594 raft_consensus.cc:2368] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14.
I20260709 13:17:10.611649 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.629122 10665 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:10.623555 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.609578 10741 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:10.628217 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.608014 10660 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:10.631078 10668 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:10.632375 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.632493 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.615924 10661 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:10.634352 10660 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 15: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:10.542954 14954 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.595984 14365 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.590443 15044 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.637995 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.649135 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.650063 10665 raft_consensus.cc:2410] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:10.650575 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.651292 10668 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:17:10.654611 10594 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 15: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:10.616887 14942 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.610607 14893 raft_consensus.cc:3055] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.636195 15043 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:10.645287 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.610837 14856 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.633235 10666 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:10.659272 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.603910 14731 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.656404 14774 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:10.687889 14774 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.641106 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.611763 14983 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.605551 15050 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.604861 14938 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.643193 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.664013 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.668107 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.708417 10632 leader_election.cc:400] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14.
I20260709 13:17:10.708899 10632 leader_election.cc:403] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:10.611639 14676 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.710772 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.711943 10664 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:10.714190 10594 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 15: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:10.685398 10667 raft_consensus.cc:1240] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.716041 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.706343 10588 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:17:10.603790 14678 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.667192 14893 raft_consensus.cc:740] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:10.691689 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.694435 10593 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:10.663470 14977 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:10.617240 15027 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:17:10.719732 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.722388 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.718075 14837 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:10.686239 14856 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.648314 14886 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:17:10.724504 10663 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:10.688629 14774 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.737059 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.737443 14903 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.646540 15066 consensus_queue.cc:1059] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:17:10.737912 14903 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.725565 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.738687 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.739231 10586 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.739565 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.739903 14903 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.740113 10667 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:10.740437 15043 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.741513 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.741286 15043 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.713253 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.742556 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:10.742858 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.743104 10663 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.744307 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.744982 10740 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:10.728722 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.745688 10669 raft_consensus.cc:2393] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:10.746706 11417 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:10.730250 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.747714 10734 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:10.686529 14989 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:10.748211 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.748507 14989 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.748898 10585 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:10.749729 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.749847 10664 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:10.750460 14989 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.750716 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.751009 10664 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:10.730865 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.735728 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.736302 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.736394 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.753583 10588 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:10.754186 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.684561 15059 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:10.754928 14938 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:10.755311 14938 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.755791 14915 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.756193 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.729627 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.757272 10741 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:10.738137 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.732514 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.758208 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:10.755612 15060 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:10.757285 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:10.759344 14904 raft_consensus.cc:3055] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.757606 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.759534 11410 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.759769 14904 raft_consensus.cc:740] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.758867 11414 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 15: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:10.760762 14904 consensus_queue.cc:260] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.761605 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.741000 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.762540 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:10.762080 14904 raft_consensus.cc:3060] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.763031 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:10.765867 11417 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:10.731524 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.766762 10661 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:10.745759 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:10.768844 10739 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.684666 15057 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:17:10.727751 14964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.011s
W20260709 13:17:10.773831 14964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.012s
I20260709 13:17:10.774511 10663 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:10.778169 10739 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:10.778824 14902 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:10.779688 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 109167us
I20260709 13:17:10.790694 10560 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.794716 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:10.795233 10741 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.795557 10742 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:17:10.702139 14731 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.779845 14774 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.785247 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.755648 14938 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.788453 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:10.787299 11410 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:10.797013 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.826139 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.802914 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.827116 10743 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:10.827229 10735 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:17:10.785545 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.828835 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:10.829715 10736 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:10.806172 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:10.807948 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 76207.7us
I20260709 13:17:10.814563 10741 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:10.815688 11417 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.822870 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.834666 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.725983 14936 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14.
I20260709 13:17:10.811563 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.822090 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.713869 15050 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.842643 10742 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:10.815095 15049 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.796367 14497 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.828282 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.849151 10737 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:10.779608 15059 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:10.828998 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.850589 10743 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:10.837947 10587 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:10.791530 15044 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
W20260709 13:17:10.846635 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 58254.8us
I20260709 13:17:10.852895 10557 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:10.853726 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:10.854327 10663 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:10.855177 10666 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.862613 10667 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:10.846405 14987 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:10.839389 14989 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.846148 14915 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.837303 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.854696 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.869165 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.873178 10666 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:10.875195 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.877506 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:10.878261 10592 raft_consensus.cc:606] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.875209 10739 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:17:10.883713 10663 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:10.850148 14497 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.892758 14731 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.874346 14917 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.893990 14676 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:10.893870 14917 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.894589 14987 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:10.895501 14987 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.896210 14917 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.897009 15057 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:10.897461 15057 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.898588 15050 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.898279 15057 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.881507 15060 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.838537 14893 consensus_queue.cc:260] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.899446 15060 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.879810 14989 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:10.899828 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 47008.5us
I20260709 13:17:10.900328 14989 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.901898 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.903353 14837 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:10.904734 10559 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:10.905674 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:10.907766 10635 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.909621 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:10.910333 10592 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:10.861876 14936 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:10.911809 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:10.854678 14810 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.929513 14940 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:10.901182 15067 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.899863 14893 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.934795 14954 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:10.935375 15045 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:10.936054 10591 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:10.862936 15073 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.864387 14904 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.941286 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:10.905356 14983 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:10.882144 15027 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:10.933293 15071 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:10.959235 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.918463 15025 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:10.933300 14915 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.936489 15035 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.974859 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:10.977957 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:10.949692 15073 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.116736 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:11.117370 10592 raft_consensus.cc:606] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:11.117470 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 284298us
I20260709 13:17:10.946797 14497 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:10.957657 14936 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:10.984050 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:10.939579 14721 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:17:11.000298 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 166751us
I20260709 13:17:11.132364  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:10.974689 14915 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.981153 15044 raft_consensus.cc:2764] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:10.978855 15035 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.981003 14983 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:10.983117 14942 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:10.947142 14810 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:10.949474 15067 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:10.985648 15027 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:10.936424 14731 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:10.979956 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:11.115410 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.167837 14915 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.946992 14940 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:10.949330 14917 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:11.116150 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:11.098924 15061 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:17:11.124253 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.218420 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:11.126062 14678 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.134526  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:11.136469 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:11.139631 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:11.139726 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 161859us
I20260709 13:17:11.148834 10735 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:11.152649 10741 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.223407 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:11.123785 15025 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:11.173452 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:11.165460 14885 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.011s
I20260709 13:17:11.176291 14889 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:11.183692 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.192368 15046 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:11.192710 15074 log.cc:927] Time spent T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:17:11.193814 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 282050us
I20260709 13:17:11.194628 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:11.123363 15073 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.168255 14616 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.257112 14616 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:11.184572 15081 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:10.980911 14997 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.169059 15000 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:11.208750 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 228842us
I20260709 13:17:11.178959 15035 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.129982 14856 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.212651 10588 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:11.209254 14907 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:11.237386 10587 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:11.208284 14836 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.243064 11410 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:11.258598 14841 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.296185 14940 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.297237 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.297994 10586 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:11.271436 15000 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.301101 15000 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.244362 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:11.317575 10662 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.209444 15060 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:11.301787 11417 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:11.240703 14885 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.246628 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:11.247282 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:11.248508 15025 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.212944 14941 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:11.212239 15043 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.259321 10632 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:11.259768 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 123368us
I20260709 13:17:11.212204 14917 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:11.223333 15050 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.267868 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:11.259042 15070 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:17:11.234854 14936 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:11.274360 15067 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.277899 15027 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.318630 10586 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:11.301204 14997 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:11.309017 10594 raft_consensus.cc:2410] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:11.302376 10588 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.392822 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:11.393567 10588 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:11.381865 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:11.323226 10587 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:11.306430 15088 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:11.395954 14954 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:11.396391 15088 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.352252 15043 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.397804 15043 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.399065 15088 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:11.347036 15089 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:17:11.401165 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:11.401892 11412 raft_consensus.cc:2393] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:11.265293 14960 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:11.403141 14960 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.403538 14960 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.324090 10591 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:11.347097 11414 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:11.406543 15043 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.353570 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:11.408072 11410 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
W20260709 13:17:11.355036 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 95788.3us
I20260709 13:17:11.408792 15043 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.409756 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:11.355044 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:11.356935 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 89150.6us
I20260709 13:17:11.306209 15090 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:11.411135 15090 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.412240 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:11.413848 15090 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:11.406994 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:11.414970 15067 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:11.415843 15090 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.416563 15067 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.416967 15067 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.394433 10588 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.419601 10588 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.423444 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.423791 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.424350 10666 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:11.427574 10667 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:11.427991 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.428587 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:11.429132 10661 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.417310 15067 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.290244 14856 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.355289 14917 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.437670 10661 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:11.437811 14885 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:11.439162 10588 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:11.439886 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 75754.5us
W20260709 13:17:11.440567 14938 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:17:11.441030 14938 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.442101 10743 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:11.442687 15060 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:11.438987 14885 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:11.326382 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 82088.1us
I20260709 13:17:11.350020 14907 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:11.462538 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:11.463346 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:11.464607 10740 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:11.355453 15050 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:11.473237 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.476656 11410 raft_consensus.cc:1240] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.490808 14904 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:11.495507 10559 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:11.497337 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:11.499740 10742 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:11.505013 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.505769 10663 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:11.508267 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:11.392267 14676 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:11.443311 14997 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:11.487198 14989 consensus_meta.cc:287] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.003s
I20260709 13:17:11.519495 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.521643 10586 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:11.484694 15028 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:11.519238 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:11.285780 14983 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.355475 14982 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
W20260709 13:17:11.574747 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55569.5us
I20260709 13:17:11.484975 14938 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:11.577603 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:11.286193 14616 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.512138 15059 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.516196 15085 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.497179 15050 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.612478 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:11.612824 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:11.703455 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 383458us
W20260709 13:17:11.709296 10708 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.662s (SENT) [suppressed 20 similar messages]
I20260709 13:17:11.517405 14907 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:11.605141 15090 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:11.723855 10708 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:11.668445 15059 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:11.605891 15094 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:17:11.698091 15046 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.620198 15057 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.586179 14940 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:11.720885 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45271.5us
I20260709 13:17:11.727061 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:11.738585 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 591488us
I20260709 13:17:11.739135 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:11.740893 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:11.741529 14954 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:11.667471 14893 consensus_meta.cc:287] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.003s
I20260709 13:17:11.612707 14809 raft_consensus.cc:3055] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.611414 14810 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:11.730669 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.733505 14616 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.574194 15009 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.525365 15028 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.732375 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:11.763156 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.763542 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.763862 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.764339 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.522835 14904 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.203s
I20260709 13:17:11.736106 10667 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:17:11.729689 14365 consensus_meta.cc:287] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.004s
W20260709 13:17:11.623541 15068 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:11.741918 10734 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:17:11.741815 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:11.524638 14676 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.722570 14938 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:11.744889 10742 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:11.725862 15090 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:11.730937 14836 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.731648 15059 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.607419 15088 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.529069 14989 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.759429 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:11.604409 14960 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.745637 14983 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.766629 15028 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:11.768571 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:11.768672 14837 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.763558 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 370795us
I20260709 13:17:11.769605 10708 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:11.771174 10593 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:11.772384 10736 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:11.773281 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:11.747387 14915 consensus_meta.cc:287] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:17:11.748993 14809 raft_consensus.cc:740] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:11.742501 14954 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:11.758903 15095 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.726534 14936 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.765146 15109 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.767441 11410 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:17:11.782078 15107 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:17:11.784744 11418 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 16: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:11.767774 14940 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:11.785735 15106 log.cc:927] Time spent T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:17:11.789039 15049 consensus_meta.cc:287] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.939s	user 0.004s	sys 0.003s
I20260709 13:17:11.789207 14989 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:11.778591 14938 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.788751 14997 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.768590 10735 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.793908 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:11.794562 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:11.810664 10667 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:11.813958 10594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2276) took 1078 ms. Trace:
I20260709 13:17:11.877167 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:11.877599 10594 rpcz_store.cc:276] 0709 13:17:10.735417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.735514 (+    97us) service_pool.cc:224] Handling call
0709 13:17:11.813796 (+1078282us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54002a8854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:11.813908 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277986176}
W20260709 13:17:11.815450 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 46934.2us
I20260709 13:17:11.879357 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:11.881661 10588 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.885629 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:11.886210 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:11.819878 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 50359.6us
I20260709 13:17:11.766884 15009 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.822065 14917 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.743374 15046 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.826576 14676 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:11.827165 14836 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.778254 15088 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.772938 15090 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.867427 15096 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.834555 10586 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:17:11.902719 10586 pending_rounds.cc:85] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 6
I20260709 13:17:11.902961 10586 pending_rounds.cc:107] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:17:11.903187 10586 raft_consensus.cc:2889] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.780172 14982 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:17:11.770565 15062 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:17:11.812068 14933 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:11.843648 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2299) took 1036 ms. Trace:
I20260709 13:17:11.850124 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:11.851090 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:11.854215 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 44425.3us
I20260709 13:17:11.855429 15067 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.909492 10663 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.774888 15035 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.843196 14810 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.849852 14930 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.854265 14954 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.872654 11381 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:11.873824 14940 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:11.921655 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 49120.3us
I20260709 13:17:11.923197 15085 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.875123 14938 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:11.869113 15049 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.849072 15027 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:11.844007 14837 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.777486 14907 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.857785 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:11.947844 10589 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.849004 14915 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.909027 10743 rpcz_store.cc:276] 0709 13:17:10.807011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.851288 (+ 44277us) service_pool.cc:224] Handling call
0709 13:17:10.874467 (+ 23179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.442420 (+567953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.843415 (+400995us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000794d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:11.843593 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304857984}
W20260709 13:17:11.912561 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 62550.4us
I20260709 13:17:11.948622 10590 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.915027 10660 raft_consensus.cc:1275] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:11.912321 14983 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.924345 10591 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:11.926405 10588 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:11.862255 15095 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:11.899449 14987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.014s	sys 0.035s
I20260709 13:17:11.906678 14676 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:11.923624 15085 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:11.868356 15109 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:11.941764 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 97612.8us
I20260709 13:17:11.891963 15045 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.923288 15043 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:11.958184 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:11.942440 14937 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:11.906821 14836 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:11.956679 15118 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:11.970436 10738 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:17:11.959256 14987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.014s	sys 0.035s
I20260709 13:17:11.924010 14810 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.000327 10667 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:11.913157 15096 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:11.960906 15085 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.972499 14937 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:12.003235 10664 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:12.012050 14937 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.012647 14836 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.013460 14937 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:12.013594 14933 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.014139 14933 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:11.938086 15113 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:17:11.997479 15114 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.015969 10589 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:12.016280 10735 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:11.923892 14809 consensus_queue.cc:260] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.071239 10661 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:17:12.017802 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 68648.7us
I20260709 13:17:12.097242 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:12.099673 15062 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:12.105123 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 219004us
I20260709 13:17:12.106151 10661 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:12.107132 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.107681 11410 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:12.108045 10661 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.065224 14837 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.003505 15066 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:12.045138 15105 log.cc:927] Time spent T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:17:12.074724 14997 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.015466 15114 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.100378 15062 consensus_queue.cc:1243] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:12.100423 15046 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:12.074110 15117 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:12.066593 14810 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.018718 15009 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.079324 15059 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.150655 15059 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.127691 14841 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.133709 15124 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:12.134021 15093 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.152508 15093 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.127974 14987 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:17:12.126269 15066 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.154628 15066 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.018493 14933 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:12.137831 15116 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:12.144409 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.159363 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.159848 15035 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.159900 10663 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:12.160629 15088 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.160836 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.161386 10663 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.161880 15096 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.144824 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.076217 15109 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.154672 15093 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.017557 14940 consensus_queue.cc:1059] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 13:17:12.156275 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49201.6us
I20260709 13:17:12.170364 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.171419 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.105621 14774 consensus_queue.cc:1059] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:12.172662 14989 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:12.173223 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2232) took 1698 ms. Trace:
I20260709 13:17:12.174016 14989 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.047693 15120 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:17:12.173640 10668 rpcz_store.cc:276] 0709 13:17:10.474408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.662837 (+188429us) service_pool.cc:224] Handling call
0709 13:17:10.702545 (+ 39708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.702742 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:10.871108 (+168366us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.243739 (+372631us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.276066 (+ 32327us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b1800046720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f425419a2a6 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1
0709 13:17:11.277585 (+  1519us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800046720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:12.172674 (+895089us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b1800046720. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f4256e6fd70 00007f4256e63293 00007f4256e58cea 00007f4256e5923a 00007f42572c3a2a 00007f42572d30bf 00007f42572d3038
0709 13:17:12.172890 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:12.172940 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:12.172989 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.173059 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.173168 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":977178,"prepare.queue_time_us":58908,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":104210,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"spinlock_wait_cycles":62883840,"thread_start_us":437468,"threads_started":2,"wal-append.queue_time_us":359355}
I20260709 13:17:12.162964 15095 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.176705 14902 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:12.147387 15114 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.178241 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.178589 15114 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.178943 15088 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.179576 15088 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.179910 15088 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:12.180248 15088 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.180796 15000 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:12.142589 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 184505us
I20260709 13:17:12.125795 15045 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:12.187072 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.170015 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.190397 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:12.191848 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.192037 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.194401 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.194672 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.194952 10742 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.195199 10736 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.195253 14915 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.195739 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.196504 10735 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:12.196165 15028 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.198436 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2230) took 1758 ms. Trace:
I20260709 13:17:12.193523 10632 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:12.198805 10662 rpcz_store.cc:276] 0709 13:17:10.439561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.656901 (+217340us) service_pool.cc:224] Handling call
0709 13:17:10.657164 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.317446 (+660282us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b54002eb1a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f4257230dc0 00007f42572bb1c0 00007f42572bc231 00007f42572b8d8f 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c
0709 13:17:11.322044 (+  4598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.198218 (+876174us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:12.198378 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732274688}
W20260709 13:17:12.199604 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.200012 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.197234 10666 raft_consensus.cc:1240] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:12.177142 14902 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:12.169116 14917 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.202569 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.210630 10735 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:12.211764 10663 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:12.212044 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.203188 10706 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.204284 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.212816 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.213294 11410 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:12.193348 14989 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.205756 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.219871 10743 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.221813 10662 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:12.206022 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.222985  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.223343 10668 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:12.197983 14938 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.198091 15027 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:17:12.209095 15090 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.213789 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.214301 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:12.217624 14940 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:12.218276 15114 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.186116 15093 raft_consensus.cc:3055] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.231313 10736 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:12.233091 10663 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:12.251041 10743 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:12.216849 14936 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.273523 10735 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.268064 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.269086 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.275300 10743 raft_consensus.cc:2393] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:12.275390 10736 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:12.276418 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.276580 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.276997 10736 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.234324 15049 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.282549 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.287449 10736 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:12.287665 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.282955 15045 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:12.251502 14938 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:12.246995 15093 raft_consensus.cc:740] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:12.235854 14917 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:12.289821 10736 raft_consensus.cc:1240] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:17:12.351534 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 148408us
I20260709 13:17:12.251665 15114 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.252547 14915 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.289484 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:12.358419 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 69004.8us
W20260709 13:17:12.346529 15133 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:17:12.237069 15128 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:17:12.265044 15095 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.301098 15049 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.358225 14915 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.377660 14915 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.378913 15090 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.353610 15096 consensus_queue.cc:1059] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:17:12.381340 15135 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.383070 10737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2297) took 1576 ms. Trace:
I20260709 13:17:12.356982 15045 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.381211 10635 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.300347 14936 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.390338 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.393162 10743 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.392115 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.397862 10635 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.381922 15096 raft_consensus.cc:3055] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:12.387567 10737 rpcz_store.cc:276] 0709 13:17:10.806485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.851257 (+ 44772us) service_pool.cc:224] Handling call
0709 13:17:10.875575 (+ 24318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:10.876044 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:11.131417 (+255373us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b1800349ae0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541c9455 00007f425acb13c7 00007f42572c39a7 00007f42572d30bf 00007f42572d3038
0709 13:17:11.382782 (+251365us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.881720 (+498938us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:11.902856 (+ 21136us) log.cc:844] Serialized 52 byte log entry
0709 13:17:11.903056 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.910518 (+  7462us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.910738 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.910805 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.382871 (+472066us) raft_consensus.cc:1685] finished
0709 13:17:12.382893 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.383018 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364304,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2575,"raft.queue_time_us":6623,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":37332,"spinlock_wait_cycles":12501376,"thread_start_us":616760,"threads_started":2,"wal-append.queue_time_us":456893}
I20260709 13:17:12.264869 15131 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.275887 14933 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.410382 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53346.6us
I20260709 13:17:12.376330 15067 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.359524 15009 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.419276 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.420327 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.419548 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.420382 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.280054 15060 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:17:12.420266 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.362360 14940 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.427038 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.427441 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.434717 10660 raft_consensus.cc:2393] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:12.427970 10635 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.428680 15142 raft_consensus.cc:2804] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.392354 15045 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.411664 15090 consensus_queue.cc:1048] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:12.381819 15135 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.431125 10585 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.415858 14917 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.395898 14810 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.434899 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.458325 10588 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.407966 14997 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.376489 15095 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.456305 10743 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:12.413389 15096 raft_consensus.cc:740] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:12.414408 15131 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.420095 15144 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:12.319796 15085 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.377259 15093 consensus_queue.cc:260] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:12.436730 15050 consensus_meta.cc:287] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:17:12.404318 14936 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.374612 14938 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.475803 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:12.432785 15134 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.516363 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.459991 15142 raft_consensus.cc:697] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:17:12.522171 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 46467.7us
I20260709 13:17:12.424757 14933 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.527364 10632 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:12.413545 15127 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:17:12.456563 14940 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:12.412037 15125 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
W20260709 13:17:12.514454 15073 consensus_meta.cc:287] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.249s	user 0.010s	sys 0.001s
I20260709 13:17:12.457971 14810 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.551627 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.459002 15109 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.532341 15121 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.514114 15131 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.545433 10660 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:12.463498 14997 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.532402 15132 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:17:12.537916 15135 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.553159 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.459707 14917 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.529527 15027 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:12.551378 15114 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.453181 15009 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:12.520402 14941 consensus_queue.cc:1175] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fac2164a6f874d7dbd29db83a7cf019b" responder_term: 11 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11. Ops: [10.6-10.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:12.556663 14997 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.554978 14810 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.560490 15090 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.518690 15050 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:12.574744 10738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2304) took 1669 ms (client timeout 1580 ms). Trace:
W20260709 13:17:12.585677 10738 rpcz_store.cc:269] 0709 13:17:10.905694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.965159 (+ 59465us) service_pool.cc:224] Handling call
0709 13:17:12.574496 (+1609337us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540036abd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:12.574666 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931199744}
I20260709 13:17:12.551716 15066 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.575673 11416 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:17:12.555121 15109 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.573619 11418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 473) took 1327 ms. Trace:
I20260709 13:17:12.574970 10739 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:12.570154 15114 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.588570 11418 rpcz_store.cc:276] 0709 13:17:11.245895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.246415 (+   520us) service_pool.cc:224] Handling call
0709 13:17:12.573379 (+1326964us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400034154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:12.573551 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005065088}
I20260709 13:17:12.554864 15073 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.594779 10665 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.542395 15134 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:12.591629 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 74099.6us
I20260709 13:17:12.600132 15043 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:12.602583 14937 consensus_meta.cc:287] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
I20260709 13:17:12.567894 15129 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:12.604761 10661 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:17:12.600659 15043 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:12.599666 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 171735us
I20260709 13:17:12.590147 15109 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.609709 14933 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:12.610905 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 67144.1us
I20260709 13:17:12.610193 14917 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.587945 15090 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.592383 15114 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.595125 14915 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.611588 14937 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.591300 14940 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.640836 14936 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.641424 14936 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.641878 14936 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.625223 15149 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.631984 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:12.634948 14954 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.002s
W20260709 13:17:12.650602 15057 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.905s	user 0.003s	sys 0.008s
I20260709 13:17:12.598019 15142 consensus_queue.cc:237] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.656808 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.678766 10666 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.681778 15152 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.682350 15152 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.684022 14915 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.685006 15152 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:12.686848 15088 consensus_meta.cc:287] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.006s
I20260709 13:17:12.699595 15088 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:12.700760 15119 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.763s	user 0.006s	sys 0.000s
I20260709 13:17:12.700850 10740 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.703681 14810 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.704732 10662 raft_consensus.cc:2368] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:17:12.706804 15043 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.708518 15073 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.713848 15088 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.715394 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.716617 11414 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:12.718251 15090 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.718482 15096 consensus_queue.cc:260] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.653334 15095 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.743278 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:12.746224 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.746934 10592 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:12.749658 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.750283 10592 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.752831 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.742045 15027 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.693027 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 268811us
I20260709 13:17:12.638031 14937 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.715695 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:12.682761 15066 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.715013 10666 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:12.716110 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.757229 11410 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.728462 14904 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:12.728981 15000 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.729956 15134 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.730463 15151 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.662375 14954 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.733290 15028 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:12.733985 15150 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:12.734802 15085 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.735379 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.734365 14997 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.664103 15049 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.737869 15114 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.738140 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.754488 15127 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.809047 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.738338 15050 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.697387 14915 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.757208 15060 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.738978 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.755460 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:12.760007 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.760257 10592 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:12.812026 10592 pending_rounds.cc:85] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 6
I20260709 13:17:12.759940 14904 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:12.761404 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.821426 10736 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 7.
I20260709 13:17:12.822045 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.822783 11412 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:12.763223 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:12.818244 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 908035us
I20260709 13:17:12.823377 10738 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:12.824075 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:12.824507 10738 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.764410 10743 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:12.725663 14616 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.656603 15149 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.840029 10738 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:12.799024 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.742592 15090 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.843250 10666 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.843498 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.847504 10736 raft_consensus.cc:2393] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:12.801219 11410 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:12.799077 10632 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:12.805756 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.806524 10667 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.800506 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.666788 15144 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.812269 10592 pending_rounds.cc:107] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:12.852530 10592 raft_consensus.cc:2889] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.852494 15144 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.759696 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.759850 15000 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.853736 10586 raft_consensus.cc:2393] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:12.854135 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.854519 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.854815 15144 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.855242 10706 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:12.855619 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.855993 15140 raft_consensus.cc:2804] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.856492 15140 raft_consensus.cc:697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:12.856657 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.815397 14997 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.857363 15140 consensus_queue.cc:237] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.858132 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.816154 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.816516 15131 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.860374 10591 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:12.861431 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.861605 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.854846 10592 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:12.862250 10591 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:12.862918 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:12.818238 14937 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:12.818903 14915 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.868849 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.870031 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:12.870175 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 71176us
I20260709 13:17:12.824767 15049 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.819789 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:12.876266 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.762316 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:12.876354 10666 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:12.876797 10741 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:12.827540 10743 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:12.877385 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.768252 14989 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.832496 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:12.798444 15088 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:12.812953 10737 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:12.864974 11409 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:12.831279 14719 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.868794 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.825338 15100 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.870772 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:12.776008 15096 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.871173 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.874401 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.759361 15027 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.764364 15121 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.896350 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.881728 10667 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:12.874400 14938 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.883903 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.874053 15000 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.913901 15045 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.894626 15100 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.842563 14616 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:12.887029 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 45686.9us
I20260709 13:17:12.860270 15059 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.893572 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:12.927615 10669 raft_consensus.cc:3060] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.894871 10592 raft_consensus.cc:2410] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:12.897733 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.930194 15059 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.824808 15060 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.931351 15100 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:12.913939 14997 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:12.932857 15060 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.934275 15149 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.890921 15088 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.935837 15027 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.936349 15027 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.936790 15027 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.937824 15088 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.938061 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.939155 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.939626 10592 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.940629 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.941782 14616 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.942076 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.941195 10661 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:12.948269 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.949522 10589 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
I20260709 13:17:12.950955 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.951589 11412 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:12.952267 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:12.952874 11418 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.953111 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.954569 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:12.888571 10586 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:12.955504 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:12.825048 15127 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.908289 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:12.908773 14847 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.908938 14937 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.890264 15049 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.892480 14719 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.912081 15165 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.912895 15156 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:12.913419 15143 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:17:12.841863 15067 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:17:12.881731 15144 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.866379 15090 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:12.915876  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.881999 15152 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.962357 15134 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.905136 15009 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.930514 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:12.994467 10667 raft_consensus.cc:2410] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:12.883093 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:12.905892 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.995523 10591 raft_consensus.cc:2393] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:12.956296 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:12.959120 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:12.958132 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:12.898466 15121 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.942001 15131 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:12.996237 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.890699 14904 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.000370 10591 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:13.001187 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:12.965381 15060 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:12.969515 14847 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:12.981648 14930 raft_consensus.cc:993] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:12.891614 14989 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:12.960294 14837 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:12.882728 14983 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.960881 14616 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.962220 14937 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.962406 14997 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:12.964320 15100 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:12.960500 15088 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:13.001818 10591 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:13.074515 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:13.002550 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.075599 10586 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
W20260709 13:17:13.075321 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 205333us
I20260709 13:17:13.076586 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.077165 10586 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:13.077557 10557 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:13.077922 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.078624 10586 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:12.969736 15128 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:13.007551 14960 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:13.079104 15128 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.079452 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:12.970943 10669 raft_consensus.cc:2468] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:13.079718 15065 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:13.080926 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.081241 15128 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.081512 10669 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 17.
I20260709 13:17:13.082401 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.082885 10669 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:13.083618 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:13.084527 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:13.008169 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2453) took 1272 ms (client timeout 1655 ms). Trace:
I20260709 13:17:13.010758 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:13.084832 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:13.085112 10664 rpcz_store.cc:269] 0709 13:17:11.735640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.759141 (+ 23501us) service_pool.cc:224] Handling call
0709 13:17:13.008017 (+1248876us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400269dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.008112 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519367424}
I20260709 13:17:13.086033 10668 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.011955 15151 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.086840 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.013696 14954 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:13.015753 14719 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.016215 14904 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.088670 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.088986 14719 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:13.016551 15060 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.091379 15060 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.021741 14847 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.092891 11379 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:13.094339 11379 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:13.095007 10667 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:13.027379 15009 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.095710 15009 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.098155 15009 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.028463 15131 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.003669 15165 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:13.099018 15165 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:13.098842 15131 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.100198 15165 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.033859 11414 raft_consensus.cc:2410] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:17:13.034459 15045 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.037343 14676 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.102196 14676 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.104760 14676 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:13.039951 15162 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
W20260709 13:17:13.045714 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2282) took 2308 ms (client timeout 1560 ms). Trace:
I20260709 13:17:13.045956 10588 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:13.048641 14936 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.052841 14774 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:13.105660 10593 rpcz_store.cc:269] 0709 13:17:10.736935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.737936 (+  1001us) service_pool.cc:224] Handling call
0709 13:17:13.045527 (+2307591us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001e32d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.045651 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329825664}
I20260709 13:17:13.106158 14774 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:13.054435 11416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 652) took 1729 ms. Trace:
I20260709 13:17:13.106828 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.106976 14960 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.106920 11416 rpcz_store.cc:276] 0709 13:17:11.325389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.325544 (+   155us) service_pool.cc:224] Handling call
0709 13:17:12.575389 (+1249845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.588050 (+ 12661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.054236 (+466186us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400034150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.054377 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800869120}
I20260709 13:17:13.055526 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1720) took 1593 ms. Trace:
I20260709 13:17:13.108516 10739 rpcz_store.cc:276] 0709 13:17:11.461775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.461880 (+   105us) service_pool.cc:224] Handling call
0709 13:17:12.574651 (+1112771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.589377 (+ 14726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.055347 (+465970us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540036abd0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.055471 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558265728}
I20260709 13:17:13.058192 14809 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.063294 14964 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.109674 14964 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.109987 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:13.111150 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.111697 14964 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.112219 14964 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:17:13.063488 15166 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:13.113276 14936 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:13.113715 14936 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.977591 15144 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.068120 10592 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:13.113976 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.114791 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.115020 10586 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:13.116070 10592 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:13.116405 10586 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:17:13.071200 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.070503 11418 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
W20260709 13:17:13.117376 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.117516 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:13.117822 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.120064 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.078533 15035 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.121817 15035 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:13.122324 14809 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.001487 14982 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.015839 15171 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.123601 14982 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.126181 14982 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.117797 15144 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.087083 15134 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.998464 15121 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.129541 15134 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.130075 15134 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.026840 15049 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.114079 14936 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:13.136246 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.094539 14987 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.138115 15151 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:13.138518 15151 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.138849 15151 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.075325 10591 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 10: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:13.142201 10664 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:13.145440 10632 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:13.121030 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:13.156811 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:13.005120 14930 raft_consensus.cc:1081] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Signalling peer fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:13.074157 14937 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.073505 14997 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.142779 15100 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.158061 15009 raft_consensus.cc:2804] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:13.155385 15131 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.158197 14964 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:13.155563 14982 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.303473 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:13.207787 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.160154 15060 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.073418 14616 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.159054 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.310590 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.074400 14983 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.312532 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.171669 14997 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.316895 10591 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:13.174820 15100 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.319193 10632 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:13.142004 14837 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.310312 14853 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.975430 15156 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.153749 15088 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.373679 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.380504 10593 raft_consensus.cc:2410] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:17:13.375875 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 216879us
W20260709 13:17:13.384420 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.384717 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.303179 14676 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:17:13.303493 15009 raft_consensus.cc:697] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:13.303439 14954 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:13.315490 15140 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.321246 14938 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:13.394758 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 436690us
I20260709 13:17:13.318619 14964 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:13.401834 14964 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.379304 14915 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:13.375874 14853 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:13.396580 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 77457.3us
I20260709 13:17:13.387669 14940 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.409597 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:13.411659 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:13.392596 15057 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:13.448603 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:13.419927 10740 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:13.449302 10737 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 10.
I20260709 13:17:13.454779 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:13.405194 15114 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:13.465341 15100 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.466754 11410 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:17:13.469805 15172 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:13.383250 15159 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.259s
I20260709 13:17:13.470777 15159 consensus_queue.cc:1243] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:13.471251 15159 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:13.471549 15159 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:13.394328 15067 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:13.406780 15089 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:13.408152 15000 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.398981 14954 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.450208 15057 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:13.456207 15027 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:13.487733 15174 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:17:13.495019 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.501175 11418 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:13.408599 15140 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.479590 15090 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:13.480194 15114 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:13.449963 14940 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:13.505864 15109 consensus_meta.cc:287] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.004s
W20260709 13:17:13.506284 15177 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:17:13.501947 15057 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:13.488176 15127 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.472280 15159 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.522141 15109 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.508334 14938 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:13.484120 15009 consensus_queue.cc:237] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.482929 15089 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.508496 14853 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.559361 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2274) took 1013 ms. Trace:
I20260709 13:17:13.590677 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.581923 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2269) took 1039 ms. Trace:
I20260709 13:17:13.609194 10664 raft_consensus.cc:2393] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:13.609125 10662 rpcz_store.cc:276] 0709 13:17:12.542900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.551377 (+  8477us) service_pool.cc:224] Handling call
0709 13:17:13.581724 (+1030347us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400182c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.581854 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350423808}
I20260709 13:17:13.610409 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:13.606814 10661 rpcz_store.cc:276] 0709 13:17:12.546051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.943401 (+397350us) service_pool.cc:224] Handling call
0709 13:17:12.943674 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.943967 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.943994 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.944392 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.982087 (+ 37695us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:12.982137 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.982219 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.559099 (+576880us) raft_consensus.cc:1685] finished
0709 13:17:13.559133 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.559296 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":979,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":37344,"threads_started":1,"wal-append.queue_time_us":119352}
I20260709 13:17:13.610735 10559 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.515690 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.611831 10590 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:13.612018 10559 leader_election.cc:400] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:17:13.612396 10559 leader_election.cc:403] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:13.612710 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:13.612914 15043 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:13.613507 15067 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 10. Current term is 11.
I20260709 13:17:13.613799 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:13.616644 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.619727 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.617190 10661 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:13.637964 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.639190 10590 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:13.642055 10559 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:13.528250 15065 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.523458 14989 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.557258 14616 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.653654 15049 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.653200 14940 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:13.669521 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 185551us
I20260709 13:17:13.593986 15156 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.587917 15114 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.677119 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:13.656340 15159 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.660279 15049 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:13.725950 15179 log.cc:927] Time spent T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:17:13.725524 15181 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:17:13.672075 15134 consensus_meta.cc:287] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.541s	user 0.002s	sys 0.008s
I20260709 13:17:13.747225 15089 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:13.758486 14936 consensus_meta.cc:287] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.002s
W20260709 13:17:13.747850 15180 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.292s	user 0.001s	sys 0.002s
I20260709 13:17:13.758876 14936 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.740792 14997 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.758514 15134 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.762152 14997 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.749583 14902 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.762954 14902 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:13.763475 15144 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.636s	user 0.002s	sys 0.008s
I20260709 13:17:13.763867 15144 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.750010 15140 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:13.752821 14937 consensus_meta.cc:287] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.002s
I20260709 13:17:13.752887 15088 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.667605 15065 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.765450 15109 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.765772 15134 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:13.755285 15121 consensus_meta.cc:287] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.000s
I20260709 13:17:13.769585 15144 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.769711 15121 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.770102 15065 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.753307 14982 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.746354 15049 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.771775 15121 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:13.756160 15151 consensus_meta.cc:287] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:17:13.757164 15057 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.726649 14954 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:13.772676 15043 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.772455 15151 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.774276 15057 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:13.775220 15151 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:13.815090 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.816223 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.685423 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.826453 10660 raft_consensus.cc:2368] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:13.720366 14837 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:13.854105 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.849850 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 172745us
I20260709 13:17:13.857909 14837 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:13.858494 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:13.858844 14837 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.865752 15178 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.866814 15178 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.838342 10669 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:13.839823 10662 raft_consensus.cc:2410] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 13:17:13.846938 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 338900us
I20260709 13:17:13.847584 10664 raft_consensus.cc:1240] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:13.765568 14937 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.838222 10743 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.849900 14936 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.876935 10666 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 11: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:13.877497 14954 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.878338 14903 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:13.878908 14903 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:13.878474 14954 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.888872 14954 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:13.875803 10708 leader_election.cc:336] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.662s (SENT)
I20260709 13:17:13.881068 14903 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:13.882316 14774 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.849071 15199 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.898824 15199 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:13.899436 15199 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.871254 14889 raft_consensus.cc:2764] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:17:13.871985 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.907096 14903 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.908841 11417 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:17:13.910403 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1880) took 1171 ms. Trace:
I20260709 13:17:13.910844 10589 rpcz_store.cc:276] 0709 13:17:12.738580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.738755 (+   175us) service_pool.cc:224] Handling call
0709 13:17:13.910029 (+1171274us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001e2dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.910197 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316885376}
I20260709 13:17:13.921644 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2275) took 1375 ms. Trace:
I20260709 13:17:13.922232 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2248) took 2496 ms. Trace:
I20260709 13:17:13.922976 10586 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.922103 10667 rpcz_store.cc:276] 0709 13:17:12.546297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.002940 (+456643us) service_pool.cc:224] Handling call
0709 13:17:13.003188 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.095372 (+ 92184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.918810 (+823438us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b540026a2d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:13.921413 (+  2603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210759424}
I20260709 13:17:13.922729 10665 rpcz_store.cc:276] 0709 13:17:11.425810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.425908 (+    98us) service_pool.cc:224] Handling call
0709 13:17:11.426159 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.595392 (+1169233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.921652 (+1326260us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540012fa54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:13.921996 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687053568}
I20260709 13:17:13.940910 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.941350 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:13.942267 11417 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:13.943816 10738 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:13.943917 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1735) took 1741 ms. Trace:
I20260709 13:17:13.945973 10740 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:17:13.944413 10742 rpcz_store.cc:276] 0709 13:17:12.202541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.202952 (+   411us) service_pool.cc:224] Handling call
0709 13:17:12.203218 (+   266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:13.022501 (+819283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.022531 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:13.023023 (+   492us) log.cc:844] Serialized 52 byte log entry
0709 13:17:13.160115 (+137092us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.392279 (+232164us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.586441 (+194162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.943014 (+356573us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54001ccd54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:13.943089 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.943167 (+    78us) raft_consensus.cc:1685] finished
0709 13:17:13.943310 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.943674 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":356260,"prepare.run_cpu_time_us":173,"prepare.run_wall_time_us":813,"raft.queue_time_us":35705,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":29262,"spinlock_wait_cycles":1859581824,"thread_start_us":549036,"threads_started":3,"wal-append.queue_time_us":288229}
W20260709 13:17:13.947276 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 86551.9us
I20260709 13:17:13.948570 11409 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:13.949849 10734 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:13.950281 14774 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.950605 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.946156 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:13.953503 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:13.946273 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:13.955065 10667 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:13.957643 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36324 (request call id 478) took 1202 ms. Trace:
I20260709 13:17:13.958063 11414 rpcz_store.cc:276] 0709 13:17:12.754944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.755174 (+   230us) service_pool.cc:224] Handling call
0709 13:17:13.957218 (+1202044us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400028fd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:13.957469 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509526912}
I20260709 13:17:13.963704 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:13.964629 10739 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:13.966172 14810 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.967602 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.967938 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:13.968923 10740 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:13.969820 10667 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:13.938866 14837 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:13.973444 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1894) took 1024 ms. Trace:
I20260709 13:17:13.973755 10667 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:13.970103 15165 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:13.969887 14810 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.974818 15062 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:13.975207 15165 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:13.975883 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:13.976045 15062 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:13.976501 15062 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:13.977236 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:13.977998 10742 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:13.966089 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:13.994020 10667 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.002168 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.002640 15062 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.004586 15062 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.004796 14721 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:14.007304 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:14.008081 11415 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:13.973906 10592 rpcz_store.cc:276] 0709 13:17:12.948362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.652186 (+703824us) service_pool.cc:224] Handling call
0709 13:17:13.654763 (+  2577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.655154 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:13.658312 (+  3158us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.755199 (+ 96887us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b180018c340. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4254146c0a 00007f425d886219 00007f425b18d58f 00007f42541cc571 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd
0709 13:17:13.854860 (+ 99661us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.855945 (+  1085us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.856170 (+   225us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.856207 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.856888 (+   681us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.972899 (+116011us) raft_consensus.cc:1685] finished
0709 13:17:13.973003 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.973186 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6957,"prepare.queue_time_us":5078,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4345,"raft.queue_time_us":2379,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":2188,"spinlock_wait_cycles":49280768,"thread_start_us":192396,"threads_started":1,"wal-append.queue_time_us":276170}
I20260709 13:17:14.009229 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.010301 10739 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:14.014691 15129 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:14.006475 14721 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:14.020532 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:14.025174 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 149551us
I20260709 13:17:14.018784 14721 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:14.032429 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:14.055590 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2277) took 1486 ms. Trace:
I20260709 13:17:14.055827 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.049469 14954 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.056036 10668 rpcz_store.cc:276] 0709 13:17:12.568344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.086732 (+518388us) service_pool.cc:224] Handling call
0709 13:17:14.050889 (+964157us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5800003098. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194e9c 00007f4254194a5b 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c292fc0 00007f425c27d929 00007f425c27d3d2 00007f42557f4bd4
0709 13:17:14.053340 (+  2451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.053712 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.053746 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.053825 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:14.053874 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.053936 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.055038 (+  1102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126983296}
I20260709 13:17:14.050359 15165 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.061738 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 556) took 1128 ms. Trace:
I20260709 13:17:14.066550 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.070034 14721 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.071981 14721 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.076198 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.078341 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.079013 10742 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.080191 15093 raft_consensus.cc:3060] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.082803 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:14.083068 10585 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:14.083442 10585 pending_rounds.cc:85] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting all ops after (but not including) 6
I20260709 13:17:14.083665 10585 pending_rounds.cc:107] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:14.083940 10585 raft_consensus.cc:2889] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.061545 14954 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:14.091663 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:14.089638 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:14.090894 10742 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:14.077142 14917 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:14.093689 14917 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:14.095077 14917 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.096324 14917 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:14.092722 11415 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:14.102872 10668 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.101079 14954 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.064138 10590 rpcz_store.cc:276] 0709 13:17:12.872036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.641203 (+769167us) service_pool.cc:224] Handling call
0709 13:17:13.641600 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.642251 (+   651us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:13.819887 (+177636us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.930584 (+110697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.938875 (+  8291us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:13.988118 (+ 49243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.995042 (+  6924us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.000084 (+  5042us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8198,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":17303,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":9296,"thread_start_us":257877,"threads_started":2,"wal-append.queue_time_us":114852}
I20260709 13:17:14.090327 14809 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.097237 15175 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.923s	user 0.001s	sys 0.000s
I20260709 13:17:14.109274 14836 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:14.116334 14836 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.113960 10667 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:14.119047 14903 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.123880 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 158184us
I20260709 13:17:14.124444 15059 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.125823 10743 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:14.127233 14836 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.119769 14809 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.128804 15178 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.123586 14903 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.131816 14903 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:14.136179 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:14.149646 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.150499 15193 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.421s	user 0.001s	sys 0.001s
I20260709 13:17:14.152392 10592 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:14.160235 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.135032 15199 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.158797 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.165397 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.167225 15035 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:17:14.169736 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.170804 15199 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.177856 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.183547 10593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2304) took 1369 ms. Trace:
I20260709 13:17:14.179926 15165 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.183950 10593 rpcz_store.cc:276] 0709 13:17:12.813697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.106608 (+292911us) service_pool.cc:224] Handling call
0709 13:17:14.183147 (+1076539us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400169754. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.183390 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627319552}
W20260709 13:17:14.189008 15205 log.cc:927] Time spent T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:17:14.197659 10585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1875) took 1739 ms. Trace:
I20260709 13:17:14.199072 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.202591 10662 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:14.202863 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1878) took 1727 ms. Trace:
I20260709 13:17:14.203271 10588 rpcz_store.cc:276] 0709 13:17:12.475047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.475206 (+   159us) service_pool.cc:224] Handling call
0709 13:17:13.045654 (+570448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.105732 (+ 60078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.197980 (+1092248us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54001e32d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.202667 (+  4687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309808384}
I20260709 13:17:14.206890 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2279) took 1584 ms. Trace:
I20260709 13:17:14.199373 10585 rpcz_store.cc:276] 0709 13:17:12.458341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.458502 (+   161us) service_pool.cc:224] Handling call
0709 13:17:12.459029 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.084567 (+1625538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.192099 (+107532us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001e3cd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:14.197579 (+  5480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3733619968}
I20260709 13:17:14.208446 10666 rpcz_store.cc:276] 0709 13:17:12.616819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.878661 (+261842us) service_pool.cc:224] Handling call
0709 13:17:14.196518 (+1317857us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54002da354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.200777 (+  4259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229748608}
I20260709 13:17:14.212714 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.215626 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2468) took 1454 ms. Trace:
I20260709 13:17:14.216815 10664 rpcz_store.cc:276] 0709 13:17:12.761209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.651248 (+890039us) service_pool.cc:224] Handling call
0709 13:17:13.651588 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.883950 (+232362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.212972 (+329022us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001de054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:14.215561 (+  2589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418892672}
I20260709 13:17:14.218650 10588 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:14.219235 10663 raft_consensus.cc:1240] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:14.218240 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.225909 15170 consensus_queue.cc:1059] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:14.227172 14937 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.227231 15170 raft_consensus.cc:3055] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.232234 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.230126 15170 raft_consensus.cc:740] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:14.239871 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:14.242630 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 87856us
I20260709 13:17:14.231014 15165 consensus_queue.cc:1059] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:14.301178 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.300050 10669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2285) took 1273 ms. Trace:
I20260709 13:17:14.240640 15135 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:14.308455 15208 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:14.304715 10669 rpcz_store.cc:276] 0709 13:17:13.026150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.084297 (+ 58147us) service_pool.cc:224] Handling call
0709 13:17:14.255529 (+1171232us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54002c01d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.299993 (+ 44464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707218304}
W20260709 13:17:14.311748 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 63183us
W20260709 13:17:14.298872 10660 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2471) took 1535 ms (client timeout 1545 ms). Trace:
W20260709 13:17:14.312454 10660 rpcz_store.cc:269] 0709 13:17:12.763436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.808873 (+ 45437us) service_pool.cc:224] Handling call
0709 13:17:14.255078 (+1446205us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003b2c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.298805 (+ 43727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336568704}
W20260709 13:17:14.301941 15206 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:17:14.310109 15207 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:17:14.317658 10588 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:14.320508 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2281) took 1289 ms. Trace:
I20260709 13:17:14.324050 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.326162 10591 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.328640 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.329039 15113 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.329929 15120 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:14.329773 15113 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.330046 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.327557 14810 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:14.331045 14810 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.334086 15159 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:14.334249 14983 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.335325 15159 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:14.337118 15159 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:14.337924 14809 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.338042 10742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:17:14.321691 10661 rpcz_store.cc:276] 0709 13:17:13.024946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.675117 (+650171us) service_pool.cc:224] Handling call
0709 13:17:13.678383 (+  3266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.678775 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:13.678816 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.699395 (+ 20579us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.878428 (+179033us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:13.878555 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.878663 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.313828 (+435165us) raft_consensus.cc:1685] finished
0709 13:17:14.313856 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.314013 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8224,"thread_start_us":50466,"threads_started":1,"wal-append.queue_time_us":255247}
I20260709 13:17:14.338827 10742 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.338435 14810 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.340034 10742 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.347724 15156 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.348367 14853 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.348500 15156 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.355830 14810 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:14.357486 15156 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.359048 14936 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:14.361635 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.356983 15170 consensus_queue.cc:260] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.330420 15120 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:14.376524 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:14.379318 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.325011 15135 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.333024 15049 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:14.387531 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.388579 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51684.7us
I20260709 13:17:14.373816 15120 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.398947 10735 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.399973 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 660) took 1448 ms. Trace:
W20260709 13:17:14.401590 11380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.403548 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.400521 11410 rpcz_store.cc:276] 0709 13:17:12.868936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.882173 (+ 13237us) service_pool.cc:224] Handling call
0709 13:17:14.255274 (+1373101us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540043f8d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.316676 (+ 61402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084001664}
I20260709 13:17:14.403770 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:14.404101 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.347119 14954 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:14.405094 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 50434.4us
I20260709 13:17:14.404419 10588 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:17:14.407262 10591 raft_consensus.cc:2468] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
W20260709 13:17:14.415668 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.397156 15113 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.418320 10739 raft_consensus.cc:2393] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:14.418800 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.417199 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.423322 11381 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:14.428005 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.425100 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.424713 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.423264 15170 raft_consensus.cc:3060] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.433154 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.429591 15178 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:14.435119 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.438587 14810 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.437992 14837 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.442020 15028 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.442685 15199 consensus_queue.cc:1059] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:14.444254 15100 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.444847 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.445792 10594 raft_consensus.cc:2468] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
W20260709 13:17:14.446326 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.446813 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:14.447125 15135 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.447274 14774 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:14.447717 14917 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.447830 10588 raft_consensus.cc:1240] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:14.470913 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.459662 10742 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.442705 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.488035 10740 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:14.490746 10664 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:14.491775 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.487280 10735 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:14.475931 15178 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.494964 15178 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.495223 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.495817 10740 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.495903 15199 raft_consensus.cc:3055] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:14.496307 15199 raft_consensus.cc:740] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:14.496702 15028 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.497684 10736 raft_consensus.cc:2410] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:14.497237 15199 consensus_queue.cc:260] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.498711 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.499020 10736 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:14.499135 15028 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.499821 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.499893 14837 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.500530 10590 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.494658 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.501798 10738 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:14.492585 10592 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
W20260709 13:17:14.508919 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 102279us
I20260709 13:17:14.509608 10742 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:14.506094 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 91339.6us
W20260709 13:17:14.504750 15209 log.cc:927] Time spent T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:17:14.502312 14837 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.514789 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.513023 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.530699 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.537781 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.540472 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.541152 10742 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:14.542027 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.542915 10589 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:14.543983 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.547137 10738 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:14.537411 10592 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.551633 10586 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:14.549446 11417 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:14.511197 14917 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.559208 10741 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:14.565961 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.570880 10743 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:14.572697 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.573642 10589 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.574734 10739 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:14.575829 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.577404 10588 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:14.578315 10594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45606 (request call id 1871) took 2159 ms (client timeout 2244 ms). Trace:
W20260709 13:17:14.578727 10594 rpcz_store.cc:269] 0709 13:17:12.419935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.420061 (+   126us) service_pool.cc:224] Handling call
0709 13:17:14.578123 (+2158062us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54001e46d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.578244 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4429956480}
I20260709 13:17:14.579959 10587 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.582093 10587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1902) took 1162 ms. Trace:
I20260709 13:17:14.582396 10587 rpcz_store.cc:276] 0709 13:17:13.419598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.917029 (+497431us) service_pool.cc:224] Handling call
0709 13:17:14.579553 (+662524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.580339 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.581901 (+  1562us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54001e46d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:14.582026 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494395776}
I20260709 13:17:14.531011 14774 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.589109 10588 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:14.596248 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.603598 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:14.606617 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.607569 10588 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:14.590781 14954 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:14.610471 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.675168 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.675701 10738 raft_consensus.cc:3060] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.615573 10589 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:14.616039 10665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2297) took 1078 ms. Trace:
I20260709 13:17:14.678074 10665 rpcz_store.cc:276] 0709 13:17:13.537615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.979599 (+441984us) service_pool.cc:224] Handling call
0709 13:17:13.980016 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.980657 (+   641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.980690 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.981149 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.065612 (+ 84463us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:14.065649 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.065709 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.610639 (+544930us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b240028af48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420afb0 00007f4256e81488 00007f4256e81be8 00007f4256e59398 00007f4256e5476a 00007f4256e53bb6
0709 13:17:14.615761 (+  5122us) raft_consensus.cc:1685] finished
0709 13:17:14.615779 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.615983 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1553,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"spinlock_wait_cycles":75115776,"thread_start_us":80687,"threads_started":1,"wal-append.queue_time_us":134414}
I20260709 13:17:14.681016 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.681813 10587 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:14.633738 10737 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:14.683581 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.684849 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.685329 10590 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:14.691481 14954 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:14.692015 15156 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:14.692651 15156 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.692039 14954 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.696275 14954 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.698215 15156 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.698679 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.699488 10740 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:14.700019 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.700376 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.701053 10740 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.650664 14917 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.594143 15049 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.658213 15165 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.735527 15165 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.659502 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:14.737460 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:14.738183 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 78752.7us
I20260709 13:17:14.738937 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.739308 15129 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.739706 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:14.660611 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.740654 10741 raft_consensus.cc:2393] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:14.662495 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.663617 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.742338 10742 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:14.664439 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:14.667413 15159 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.743273 10734 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:14.743345 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:14.744200 15049 raft_consensus.cc:2764] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:14.744320 10665 raft_consensus.cc:2368] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11.
I20260709 13:17:14.744699 15159 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:14.668674 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 68678.5us
I20260709 13:17:14.673540 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.737483 15165 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.664984 15178 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.745668 10594 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 6.
I20260709 13:17:14.707924 14937 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.635170 14774 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.704068 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:14.747589 14937 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:14.748076 10743 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.747979 15083 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:14.748481 14937 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.749768 14937 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.750411 14853 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:14.751500 15096 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:14.751814 15096 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:14.752184 14853 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:14.752717 14853 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.753957 15178 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.754305 15096 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.755836 14853 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.756600 15096 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.756722 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:14.758412 14774 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.758611 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.707600 15120 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.708736 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.670787 15152 raft_consensus.cc:3055] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:14.759521 15170 consensus_queue.cc:1175] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 13 index: 10 } }
I20260709 13:17:14.760054 15152 raft_consensus.cc:740] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:14.761049 15152 consensus_queue.cc:260] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.762028 15120 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.711453 10592 raft_consensus.cc:2468] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:14.762343 15062 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:14.762471 15152 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.762809 15062 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:14.763257 15062 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.711934 15035 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.765697 15035 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.767627 10738 raft_consensus.cc:2468] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:14.714790 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.714859 10557 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.718019 10589 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:14.718693 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.719376 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.719779 15199 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.698132 10666 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:14.722704 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.724928 15216 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:17:14.774770 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 238828us
I20260709 13:17:14.775367 10740 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:14.778913 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.782035 10591 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:14.725685 10590 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:14.726049 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.727708 15135 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:14.728299 15156 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.728969 14982 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.789973 10587 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:14.790213 14982 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.791517 10632 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.792259 14982 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.730286 14954 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.792395 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.732123 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:14.793500 15159 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:14.732200 11415 raft_consensus.cc:1240] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.793952 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.794788 15159 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.795375 14936 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.795667 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.797005 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:14.797360 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 82586.6us
I20260709 13:17:14.797694 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.798115 10557 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:14.798430 14936 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.798930 14936 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:14.799335 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.799863 14936 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.800484 15156 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.803835 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.804697 10592 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.809582 10632 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.698081 10588 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:14.733242 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.734792 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:14.818225 11410 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:14.740422 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.712332 10663 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:14.772583 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:14.786492 10743 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:14.820717 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.811223 10632 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.828339 11417 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:14.799782 14721 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:14.829437 14721 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.829615 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:14.832664 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.829854 14721 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.833276 10665 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.835909 15083 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.836428 15083 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.837476 14836 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:14.838562 15083 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.839104 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.833592 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:14.835264 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 102142us
I20260709 13:17:14.840401 15062 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.835111 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.843361 10668 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:14.844632 10668 raft_consensus.cc:1275] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:14.845561 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.846410 10663 raft_consensus.cc:1240] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:14.839063 15083 consensus_queue.cc:1059] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:17:14.846889 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.848013 15083 raft_consensus.cc:3055] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:14.848371 15083 raft_consensus.cc:740] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:14.849627 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.850772 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:14.852263 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.853389 14954 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:14.854071 14954 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.854260 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:14.826920 15049 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.855101 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:14.855765 15113 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:14.856117 15113 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.856487 15113 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.856326 15083 consensus_queue.cc:260] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.853696 14836 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.857681 14954 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:14.858083 14954 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.858405 14954 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.860070 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.802511 15156 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:14.861820 10706 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:14.863874 14982 raft_consensus.cc:2804] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.864328 14982 raft_consensus.cc:697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:14.865221 14982 consensus_queue.cc:237] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.865701 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:14.865844 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 107334us
I20260709 13:17:14.866827 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.867195 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:14.867822 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.868903 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.869484 15049 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:14.870028 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 58895.1us
I20260709 13:17:14.870256 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.854101 10665 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:14.830417 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:14.841760 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.861835 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:14.872298 10592 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:14.873064 10667 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:14.872340 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.840407 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.870759 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.870993 10662 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 6.
I20260709 13:17:14.872429 10666 raft_consensus.cc:3060] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.805440 14774 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:14.878178 10663 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:17:14.882604 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62850.4us
I20260709 13:17:14.826918 14837 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.888473 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.890377 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:14.885744 15159 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.897397 14837 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:14.897778 15159 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:14.898092 14837 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.898269 15159 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.899118 15028 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.899281 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:14.901883 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:14.902081 15217 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.903208 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.905332 10591 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:14.909682 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.910172 10665 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.869740 15035 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:14.909165 10632 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.902774 15028 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:14.881300 15129 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.886149 15120 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.806636 15216 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.885936 15170 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.925595 10586 raft_consensus.cc:2393] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 18: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:14.831080 15135 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:14.926469 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.888029 15083 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:14.927345 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 48741.6us
I20260709 13:17:14.929239 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:14.930141 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.958937 10588 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:14.931411 15218 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.932559 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:14.934478 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.935601 15096 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.936957 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:14.942999 15113 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.943581 15159 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:14.960426 10593 raft_consensus.cc:1240] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:14.966988 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 400592us
I20260709 13:17:14.967471 10559 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:14.968701 11379 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:14.972056 10665 raft_consensus.cc:2410] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:14.967181 10591 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:14.973177 10592 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:14.973206 10591 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:14.956015 15028 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:14.961869 15218 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.981473 10667 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.983968 10589 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.987253 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:14.997709 10666 raft_consensus.cc:2468] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:15.000708 10588 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:14.976382 15100 raft_consensus.cc:2804] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:14.971410 14719 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:17:14.976397 14810 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:14.977171 15178 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:15.032595 15159 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.034108 15216 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:14.985638 15218 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.036687 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.026496 10591 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.039250 15211 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.041597 14810 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:15.035717 14721 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.051193 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.052273 10588 raft_consensus.cc:2410] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:15.036819 15035 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:15.047160 15100 raft_consensus.cc:697] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:15.077124 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 175339us
I20260709 13:17:15.134231 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.135039 10588 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:15.063323 15035 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:15.137851 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 175394us
I20260709 13:17:15.139328 10591 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:15.141103 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.141605 10632 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:15.142550 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 273927us
I20260709 13:17:15.046185 15028 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:15.152274 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.182711 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.185459 10632 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:15.143190 15156 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.191255 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 220111us
I20260709 13:17:15.147914 14936 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.196013 10560 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:15.195946 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 216913us
I20260709 13:17:15.154567 15217 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:17:15.201020 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56525.6us
I20260709 13:17:15.199029 14936 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.214022 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:15.230257 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:15.206377 14719 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.233094 10632 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:15.215281 15062 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.251622 14719 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.245771 15217 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.264649 10591 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:15.206504 15199 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:17:15.254287 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56546.7us
I20260709 13:17:15.200489 15156 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.250504 15239 raft_consensus.cc:2804] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.251220 15171 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.211009 15159 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.184067 14810 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.216977 15135 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:15.215794 14936 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.267436 15233 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:15.268486 14721 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.309614 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:15.310454 11415 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:15.271301 15225 log.cc:927] Time spent T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:17:15.272609 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:15.272975 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.272835 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:15.318145 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.318679 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:17:15.272840 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 90496.9us
I20260709 13:17:15.319147 10740 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:15.274609 14719 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:15.278954 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 132426us
W20260709 13:17:15.279847 15229 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:15.238442 15216 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:15.238588 15113 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.228523 14837 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:15.288965 14937 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 13:17:15.330020 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:15.299109 15231 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:17:15.371734 10560 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.331045 10666 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
W20260709 13:17:15.331640 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.262439 15035 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.299777 15159 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.395879 10560 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.396513 14937 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:15.397379 14774 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:15.397660 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.397956 14774 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.399266 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:15.352648 15233 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:15.372478 14721 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.394425 14809 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.396116 15159 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.404793 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:15.400008 10585 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:15.213923 15100 consensus_queue.cc:237] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.299556 15083 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.414436 11413 raft_consensus.cc:2410] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:17:15.414673 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:15.412474 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:15.415506 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:15.422484 10669 raft_consensus.cc:2393] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 16: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:15.399947 14774 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:15.422602 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 189595us
I20260709 13:17:15.423856 14809 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:15.420509 15113 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:17:15.319746 15171 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.427045 15249 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:15.464843 15171 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:15.465143 14837 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:15.414736 15233 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.469697 11410 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:17:15.459646 15232 log.cc:927] Time spent T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:17:15.361213 14936 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.475775 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2305) took 1077 ms. Trace:
W20260709 13:17:15.480779 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83743.9us
I20260709 13:17:15.480831 10661 rpcz_store.cc:276] 0709 13:17:14.391786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.391913 (+   127us) service_pool.cc:224] Handling call
0709 13:17:14.408428 (+ 16515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.512573 (+104145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.512601 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.539251 (+ 26650us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.983730 (+444479us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:14.983779 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.983855 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.468695 (+484840us) raft_consensus.cc:1685] finished
0709 13:17:15.468717 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.468837 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87,"raft.queue_time_us":18007,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":483757,"threads_started":2,"wal-append.queue_time_us":499028}
I20260709 13:17:15.483423 10560 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:15.486927 15239 raft_consensus.cc:697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:17:15.473443 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51239.5us
I20260709 13:17:15.424093 14836 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.492853 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.459659 15156 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.457422 15240 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:15.480541 14837 consensus_queue.cc:1059] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:15.499167 15135 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:15.499594 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:15.499747 15241 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:17:15.500134 14936 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:15.507851 14954 consensus_meta.cc:287] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:17:15.508373 14954 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.511794 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:15.512471 11409 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:15.513751 11415 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:15.514904 14954 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:15.494510 15249 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.422896 15083 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.519310 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.494366 14836 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.521739 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.522360 10589 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:15.546981 10590 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:15.549993 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:15.550704 10585 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.494946 14774 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:15.518620 15249 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:15.517841 15135 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:15.501106 15159 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.557806 11413 raft_consensus.cc:1275] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:15.524313 14836 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.523137 15113 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.546262 14983 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:15.586192 14983 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.586612 15083 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:15.588582 14983 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:15.523952 15156 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:15.638113 10585 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:17:15.578612 15249 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.646166 15258 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.646626 15258 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.646947 15258 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.656864 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:15.657466 10590 raft_consensus.cc:2376] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11. Re-sending same reply.
I20260709 13:17:15.658036 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.660681 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:15.663089 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:15.663725 10586 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 7: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:15.667214 10590 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
W20260709 13:17:15.670403 15218 consensus_meta.cc:287] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.003s
I20260709 13:17:15.670835 15218 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.672819 15218 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:15.673700 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.674839 10591 raft_consensus.cc:2410] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:15.493773 15239 consensus_queue.cc:237] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.677138 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.678191 15096 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:15.681391 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:15.683046 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.683662 10740 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:15.685220 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.686448 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:15.698441 10560 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.701992 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:15.691674 15247 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:15.691454 14954 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:15.700214 14983 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.638267 15156 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.713343 15165 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:15.645282 15113 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.732735 15120 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:17:15.733721 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 97728.3us
W20260709 13:17:15.735597 15235 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.488s	user 0.006s	sys 0.003s
I20260709 13:17:15.720140 14809 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.744472 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:15.745465 15135 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.721801 15268 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:17:15.750185 15159 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.752951 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:15.754551 10591 raft_consensus.cc:1240] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:15.755918 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.756633 10590 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:15.770174 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.771160 10740 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:15.733202 15120 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.764098 15165 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.785408 10559 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.765918 15129 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.766180 15252 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:15.798931 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:15.800236 10734 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.799477 10740 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:15.801563 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.803300 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.803869 10743 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:15.768405 14982 consensus_queue.cc:1048] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:15.807382 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:15.808626 10740 raft_consensus.cc:2410] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:15.809743 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:15.811501 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:15.812505 10740 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:15.815261 15156 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:15.797948 10590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251650397d264ac1a42a2fde5932424f"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:15.806574 14983 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:15.835408 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 75061.8us
I20260709 13:17:15.798362 15165 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:15.803189 15129 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.837949 10706 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:15.867550 15242 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:17:15.869004 15242 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:15.869398 15242 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:15.870606 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.875389 14837 raft_consensus.cc:3055] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:15.875514 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 381162us
I20260709 13:17:15.875805 14837 raft_consensus.cc:740] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:15.876242 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.837184 15035 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.880445 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:15.882604 14837 consensus_queue.cc:260] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.882854 15249 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.883826 10589 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:15.884670 15262 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.191s	user 0.000s	sys 0.003s
I20260709 13:17:15.884960 15249 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:15.838249 15261 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:15.900561 15261 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:15.901806 15245 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:15.901494 15261 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.902199 15245 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:15.857234 15264 log.cc:927] Time spent T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:17:15.913678 14809 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:15.885396 15035 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.886262 15210 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.883786 14837 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.925483 15210 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.927474 15210 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.929896 15035 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.903059 15245 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.904597 14721 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:15.930960 15083 consensus_queue.cc:1175] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fac2164a6f874d7dbd29db83a7cf019b" responder_term: 15 status { last_received { term: 15 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 15 index: 9 } }
I20260709 13:17:15.932983 15242 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.851279 14983 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.889432 15240 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:15.966640 15240 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:15.967226 14983 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:15.881349 15156 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.890468 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.819365 15268 consensus_queue.cc:1059] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:15.845212 10734 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:15.896754 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:15.979851 10661 raft_consensus.cc:2393] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:15.897565 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:15.980692 10669 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:15.972623 15156 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:15.847038 14917 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:15.981736 15156 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.982577 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:15.983691 11381 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:15.984366 15178 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.985911 15083 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.986366 15083 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.986749 15083 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.874655 15129 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:15.905522 15266 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:15.859647 15152 raft_consensus.cc:3055] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.991904 15152 raft_consensus.cc:740] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:15.914422 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:15.992579 10591 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:15.914806 15258 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:15.915149 10557 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:15.924130 14810 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.999562 10586 raft_consensus.cc:1240] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:17:15.924904 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48773.7us
W20260709 13:17:15.999583 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 84501.8us
I20260709 13:17:16.000612 15258 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.001382 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:15.888304 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 227191us
I20260709 13:17:16.002175 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:15.960309 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 78233.1us
I20260709 13:17:15.973531 15248 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:15.889017 15113 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:15.998445 15152 consensus_queue.cc:260] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.005947 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.036316 10664 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:16.036350 10669 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.014041 10590 raft_consensus.cc:606] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.002991 11410 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 16.
I20260709 13:17:16.019704 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:16.038614 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:16.020779 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.021826 14810 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:16.019140 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.040458 10665 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 16.
I20260709 13:17:16.020155 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:16.022398 15248 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.026137 15035 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.001217 15258 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.021873 14836 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.045817 10559 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:16.044170 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.050554 10666 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:16.050928 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:16.078692 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 216365us
I20260709 13:17:16.032480 15120 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.046772 14809 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.055825 15152 raft_consensus.cc:3060] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.061728 15129 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:16.097409 11382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.097796 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.098469 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.053365 14937 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:16.101511 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.121299 10734 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.082783 15217 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.106065 15083 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.110320 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.111804 15245 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:16.114600 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53911.6us
I20260709 13:17:16.056272 15258 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:16.123304 10560 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.049546 15249 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:16.137826 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:16.138397 11417 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.101819 14954 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:16.127221 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83142.9us
I20260709 13:17:16.049121 15035 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.094580 14809 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.130893 14836 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:16.131723 10487 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 205) took 27061 ms (client timeout 15000 ms). Trace:
I20260709 13:17:16.122691 14917 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.136696 10632 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:16.198928 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62284.5us
I20260709 13:17:16.127707 14721 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:16.144960 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.203426 10708 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Timed out: RequestConsensusVote RPC to 127.9.68.66:33499 timed out after 1.655s (SENT)
I20260709 13:17:16.203940 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:16.198480 14917 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.205300 14917 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.198762 14809 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.146726 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:16.209944 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 63288.5us
I20260709 13:17:16.211040 10560 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.147260 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:16.212008 15233 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.212388 15233 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.212724 15233 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.213189 14954 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.117728 15129 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.147542 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.222121 10590 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.150280 15120 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.152961 15085 consensus_queue.cc:1059] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:16.229048 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:16.229504 15085 raft_consensus.cc:3055] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.229895 15085 raft_consensus.cc:740] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:16.230695 15085 consensus_queue.cc:260] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.231784 15085 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.153301 15236 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.203688 15258 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.156270 15217 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:16.205037 14837 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.158321 10489 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.164132 15083 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.164331 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.258944 10738 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.165823 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.260099 10665 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.165963 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.116822 15248 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:16.166779 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.167038 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:16.264726 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 97756.4us
I20260709 13:17:16.177999 15242 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.179710 15093 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:16.189003 10734 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.127733 15178 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.117913 15156 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.115871 15165 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.239730 15217 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.157058 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.249972 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:16.283109 11417 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:16.232846 14917 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.212815 14721 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:16.180761 15035 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.260763 10590 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:16.227022 15129 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.237684 14836 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.236961 14774 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:16.279551 10476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 113022us
W20260709 13:17:16.237124 15170 consensus_queue.cc:1175] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fac2164a6f874d7dbd29db83a7cf019b" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:17:16.257789 15159 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:16.269867 15248 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.289976 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:16.270090 14837 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:16.290179 10742 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.279132 15249 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.290299 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.295274 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:16.286942 10489 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 8 to 10, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 10 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.286983 11415 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
W20260709 13:17:16.297947 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 81899.4us
I20260709 13:17:16.297380 10593 raft_consensus.cc:3060] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.300071 10591 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:16.302376 10587 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.299976 10738 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:16.269605 15093 consensus_queue.cc:1243] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:16.300354 10665 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:16.301966 10489 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:16.303738 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 146750us
I20260709 13:17:16.305393 11381 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:16.306617 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.289534 15240 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.298623 15239 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.311193 15239 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.310701 10489 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.311529 15239 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.313907 10585 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.325759 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.326983 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.327656 15240 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.328425 15240 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.328999 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.296357 15248 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.321935 10489 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 10 to 11, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.321631 10560 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.318147 15178 raft_consensus.cc:2804] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:16.348023 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 168499us
I20260709 13:17:16.310696 14917 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.295266 15217 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.364120 10489 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 7 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.345456 15248 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.375765 10560 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.377487 10592 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.362100 15245 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.379523 15245 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.384137 14810 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.384583 14810 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:16.384738 10585 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:16.388850 15217 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.390789 10665 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:16.392849 15245 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:16.392560 14837 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.393576 14810 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.394886 14810 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:16.395113 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 66171.5us
I20260709 13:17:16.396890 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.418695 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.398216 15156 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:16.399101 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:16.432952 10665 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:16.433073 11417 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:16.350405 15120 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.339205 15233 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.370419 15178 raft_consensus.cc:697] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:16.339011 15249 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.413295 14936 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:16.197184 10487 rpcz_store.cc:269] 0709 13:16:49.070666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.070986 (+   320us) service_pool.cc:224] Handling call
0709 13:17:16.131501 (+27060515us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:08.698793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:08.699447 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:08.699503 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:17:08.699522 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:08.963615 (+264093us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:08.963745 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:08.963785 (+    40us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:17:08.966992 (+  3207us) tablet.cc:701] Row locks acquired
0709 13:17:08.967052 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:17:08.967263 (+   211us) write_op.cc:270] Start()
0709 13:17:08.967433 (+   170us) write_op.cc:276] Timestamp: P: 1783603028967186 usec, L: 0
0709 13:17:08.967456 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:08.968411 (+   955us) log.cc:844] Serialized 11714 byte log entry
0709 13:17:09.633086 (+664675us) op_driver.cc:464] REPLICATION: finished
0709 13:17:09.817549 (+184463us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f42541af0ac 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f425acefef0
0709 13:17:10.225805 (+408256us) write_op.cc:301] APPLY: starting
0709 13:17:10.225915 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:10.905929 (+680014us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b180046af20. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f4256ff80ec 00007f4257044c0a 00007f42570444f7 00007f4257044490 00007f4256ffbf48 00007f425ad101bb 00007f425ad10532 00007f425ad57b93 00007f425ac04de3
0709 13:17:12.181687 (+1275758us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:12.181715 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:12.822640 (+640925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:12.868205 (+ 45565us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=0,mrs_lookups=0
0709 13:17:12.868255 (+    50us) write_op.cc:312] APPLY: finished
0709 13:17:12.868834 (+   579us) log.cc:844] Serialized 260 byte log entry
0709 13:17:12.998360 (+129526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:13.009453 (+ 11093us) write_op.cc:454] Released schema lock
0709 13:17:13.009540 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:13.010130 (+   590us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:13.010163 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1319334,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":588653,"apply.run_cpu_time_us":96763,"apply.run_wall_time_us":2784243,"cfile_cache_hit":118,"cfile_cache_hit_bytes":123487,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":29782,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":30,"prepare.queue_time_us":117328,"prepare.run_cpu_time_us":34106,"prepare.run_wall_time_us":565995,"raft.queue_time_us":143795,"raft.run_cpu_time_us":48986,"raft.run_wall_time_us":619300,"replication_time_us":665479,"spinlock_wait_cycles":34831872,"thread_start_us":1128987,"threads_started":5,"wal-append.queue_time_us":858129,"wal-append.run_cpu_time_us":42179,"wal-append.run_wall_time_us":2379172}]]}
I20260709 13:17:16.409930 10594 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:16.433847 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58184.5us
I20260709 13:17:16.434243 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:16.421646 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.423354 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.450620 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.451128 10743 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.457218 15248 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.443148 10593 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:17:16.443558 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.435407 10489 catalog_manager.cc:5697] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 4 to 7, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.423910 10667 pending_rounds.cc:85] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 5
I20260709 13:17:16.458376 10586 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.458547 10667 pending_rounds.cc:107] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:17:16.458868 10667 raft_consensus.cc:2889] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.459594 10489 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.460904 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:16.461088 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.461586 10742 raft_consensus.cc:1275] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:16.461218 10734 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:16.463454 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.464022 10738 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:16.394469 15165 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.460172 15248 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.468075 11410 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:16.469293 10591 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.462998 14853 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.378611 15236 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.418967 15211 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:17:16.444286 15290 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.466696 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.475179 14853 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.463495 15216 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.419339 14810 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:17:16.415207 14809 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.484980 14721 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.493731 15272 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.491816 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.505623 15290 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:16.417444 15245 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:17:16.472303 15258 consensus_queue.cc:1048] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:16.515220 15290 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.498925 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b7b057c54346c0b47758f08031d007"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:16.516626 10594 raft_consensus.cc:606] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.517040 10594 raft_consensus.cc:614] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:16.503654 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106828us
I20260709 13:17:16.518628 15249 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.503814 10743 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:16.482888 15233 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.501914 14853 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.410007 15239 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.523854 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.507287 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.524998 10741 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.508881 14810 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.490346 11417 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
I20260709 13:17:16.514258 15272 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.519551 15178 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.529196 10588 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:16.531361 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.532073 10738 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.486685 14774 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:16.541616 10743 raft_consensus.cc:1275] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:16.504779 15248 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:16.538347 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.544755 10736 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:16.533625 10489 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 3 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.545029 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.549432 10742 raft_consensus.cc:1275] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.550380 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.528414 14810 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:16.554986 10708 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.557161 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.557857 10742 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:16.520684 14721 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.548013 10489 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.563110 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.563668 10743 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:16.544366 15248 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.541064 15113 consensus_queue.cc:1059] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:16.573031 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.581017 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.589118 15035 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:16.589576 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.590376 10737 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 10: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:16.591871 10738 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:16.590583 15216 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.599136 15216 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:16.599952 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.601084 15216 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.552767 14810 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.603770 14853 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.564218 14836 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.605800 10489 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.610934 10489 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.572819 15248 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:16.609723 15085 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.625598 15085 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.622416 15165 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:16.628121 15085 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:16.628734 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.631063 10587 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.629613 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:16.618764 14853 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:16.629218 10594 raft_consensus.cc:1275] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:16.633706 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.632640 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.634392 10664 raft_consensus.cc:3060] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.632629 10741 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.634701 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.635339 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.635598 10663 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 18.
I20260709 13:17:16.605408 15152 raft_consensus.cc:3055] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:16.605376 15236 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:16.590349 14809 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.637019 10742 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: [10.6-13.7]
I20260709 13:17:16.646849 10594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:16.638911 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.640486 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.647891 10594 raft_consensus.cc:606] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:16.638059 11381 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:16.648257 10594 raft_consensus.cc:614] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:16.640161 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.648888 10667 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 17: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:16.645520 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.606128 15035 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:16.646840 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.645486 10489 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 8 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.658864 10590 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:16.659986 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:16.660641 10590 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:16.667521 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:16.668772 10590 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 18.
I20260709 13:17:16.674446 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.628135 15120 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.685926 10663 raft_consensus.cc:2368] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:16.664052 10560 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.680106 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.684585 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.687889 10662 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:16.688666 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.685071 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.689673 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.689092 10590 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:16.653967 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.695600 10660 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:16.625536 15113 consensus_queue.cc:1048] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:16.699018 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.646361 15258 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.700228 10662 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:16.700107 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.646735 14721 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.644433 15152 raft_consensus.cc:740] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:16.714195 15152 consensus_queue.cc:260] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.715507 15152 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.702963 10741 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:16.717998 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.718860 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.720367 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.692312 10489 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 6 to 7, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:16.657382 15239 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.706843 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.708138 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:16.725574 10594 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:16.685678 15120 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:16.673696 15170 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:16.710714 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.718938 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.647097 15236 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:16.722237 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:16.687726 15083 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.743486 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.725095 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.728778 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:16.745141 11410 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.728886 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.733705 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:16.735323 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 71397.1us
I20260709 13:17:16.738586 10741 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.742440 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.748243 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:16.748859 11414 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.749064 10666 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:16.747080 10662 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:16.750238 10489 catalog_manager.cc:5697] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.753031 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.746699 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:16.759734 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:16.687325 15178 consensus_queue.cc:1048] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:17:16.771457 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.770288 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.870841 10594 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
W20260709 13:17:16.869585 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 108052us
I20260709 13:17:16.888931 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:16.752017 15292 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.735837 15170 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.912403 11417 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:16.893141 10737 raft_consensus.cc:1240] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:16.913947 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.910636 10742 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 13:17:16.914803 10666 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 7.
I20260709 13:17:16.887604 10741 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:16.743089 15239 consensus_queue.cc:1048] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 13:17:16.915967 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.743283 15236 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.908874 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:16.917878 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.925134 10741 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.920464 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.721882 15258 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.922646 15170 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:16.910683 14917 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.926944 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:16.933904 10663 raft_consensus.cc:2393] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:16.901822 14721 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.927510 10743 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.927732 10666 raft_consensus.cc:2393] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:16.927999 10742 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:16.929042 10592 raft_consensus.cc:2410] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:16.923578 15292 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:16.929842 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:16.864979 10541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 95211.2us
I20260709 13:17:16.895350 14954 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.897114 15085 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.748358 15216 consensus_queue.cc:1048] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:17:16.934556 10741 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:16.760661 15083 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.939821 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:16.943761 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.944530 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:16.953600 10663 raft_consensus.cc:1240] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:16.936653 14721 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:16.947384 15129 consensus_meta.cc:287] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.003s
I20260709 13:17:16.962133 10660 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:16.946193 14982 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.903882 15035 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.894812 15120 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.938588 14917 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:16.991050 14917 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:16.974282 15129 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.993360 15129 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.981714 10489 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 10, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 10 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.995340 10489 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:16.964154 14721 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:17.003906 15303 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:17:17.003959 15248 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.005704 10590 raft_consensus.cc:2368] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
W20260709 13:17:17.006561 15306 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:17:17.008564 15300 log.cc:927] Time spent T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 13:17:16.973770 15028 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:17.009555 15028 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.011451 15028 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.952298 15085 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.020002 15085 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.949820 15292 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:16.973834 14982 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.025669 15120 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.026060 14982 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:16.991508 11410 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:17.027989 15083 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:16.973912 14836 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.032631 14810 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.034322 10587 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 17.
W20260709 13:17:17.036599 15304 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:17:17.039798 15272 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:17.009195 15258 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.043408 15233 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.043793 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:17.043870 15233 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.044428 10592 raft_consensus.cc:606] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.045230 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.045665 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:17.045948 15233 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.046329 10588 raft_consensus.cc:2393] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:17.049757 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:17.050709 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.051275 10669 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:17.052253 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:17.053166 15028 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.053544 15028 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.053539 15251 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.054162 15028 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.054026 15216 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:17.054756 10634 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.055092 15251 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:17.055828 15216 consensus_queue.cc:1059] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:17.056643 15251 raft_consensus.cc:3055] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:17.056972 15251 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.057089 15218 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:16.983168 10708 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:17.060772 10708 leader_election.cc:403] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:17.062354 10736 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:17.062342 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.064085 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.068567 11414 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 17.
W20260709 13:17:17.071394 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.072708 10664 raft_consensus.cc:2468] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 17.
I20260709 13:17:17.074249 10740 raft_consensus.cc:2410] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:17:17.076061 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.076874 11381 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
W20260709 13:17:17.079044 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 126287us
I20260709 13:17:17.079667 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.079794 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.080338 10741 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:17.081346 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:17.082688 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:17.083231 10737 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.084039 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.083233 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.078470 15218 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:17:17.090482 15083 raft_consensus.cc:2804] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:17.102417 15083 raft_consensus.cc:697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 17 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:17.103268 15083 consensus_queue.cc:237] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:17.104568 15314 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:17.095719 15049 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:17:17.095815 15156 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 13:17:17.107532 15311 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:17:17.108822 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:17.095559 15275 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:17.114776 15093 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.115234 15093 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.124037 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.124954 10668 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:17.125684 15251 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.127121 15251 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.128614 10560 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:17.131917 15249 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.132258 15249 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.132572 15249 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.133797 15218 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.134164 15218 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.134984 15218 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.139734 10591 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:17.144086 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:17.144407 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:17.144696 11415 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:17.144951 10661 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.145763 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.146795 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.147379 10593 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:17.148221 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.148802 10588 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
W20260709 13:17:17.150034 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 70436.4us
I20260709 13:17:17.150318 14836 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:17.150967 14836 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:17.151767 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:17.152308 10592 raft_consensus.cc:606] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.152817 10592 raft_consensus.cc:614] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:17.152220 14836 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.153379 15170 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.155341 15170 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:17.156486 15305 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:17:17.159092 15236 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.161782 15156 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.151211 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.166527 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.167165 10665 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:17.167716 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.151011 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:17.167610 14721 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.169561 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.199368 10557 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.200623 10557 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.175482  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:17.117110 15093 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.086405 15248 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.185182 14809 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.173012 10735 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:17.178849 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.180534 10668 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:17.184597 11415 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:17.186221 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.186877 10590 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:17.217581 10734 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:17.187779 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:17.218315 10592 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:17.191560 10594 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:17.192914 10661 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:17.197077 10669 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:17.220405 10737 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:17.184299 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:17.209609 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 122437us
I20260709 13:17:17.210511 10741 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:17.177253 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.224771 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:17.228964 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51772.9us
W20260709 13:17:17.229650 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.229765 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.231317 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.192626 15218 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:17.239074 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.240515 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:17.244150 10585 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:17.206626 15309 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:17.206729 15049 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:17.251143 10668 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:17.252298 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 101150us
I20260709 13:17:17.253197 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.215997 15035 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.226104 14809 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.254278 14774 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:17.240746 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:17.239434 15310 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:17.288142 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47456.2us
I20260709 13:17:17.289841 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:17.290387 10669 raft_consensus.cc:3060] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:17.256532 15049 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:17.185464 15028 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.259627 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:17.288903 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:17.237789 15156 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.301311 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.234596 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.273403 15258 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.274662 14809 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.275810 15249 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.281505  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:17.284797 10590 raft_consensus.cc:1240] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:17.260847 15245 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:17.232640 15170 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.232977 15210 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.232844 14810 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.237437 15159 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:17.308822 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:17.310266 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.261788 15152 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.258060 15120 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:17.332866 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 251592us
I20260709 13:17:17.262415 15035 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.317821 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58309.7us
W20260709 13:17:17.314164 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 79688.8us
I20260709 13:17:17.338904 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:17.339594 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.343459 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.322274 10592 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 19.
I20260709 13:17:17.296036 15310 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.295195 15309 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:17.348500 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:17.333925 10706 leader_election.cc:400] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:17.349774 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.348558 11379 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:17.315732 15170 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.320727 15240 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:17.306716 15258 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.359400 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.350826 15310 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.363417 15152 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:17.363595 14937 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:17.356963 14810 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:17.365989 15152 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.367493 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.368263 15152 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.355041 15156 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.368870 15156 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:17.369232 15156 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.369465 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:17.307488 15257 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:17.332912 15272 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.342945 15035 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.374202 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.345496 14917 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:17.330497 15085 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:17.350836 15211 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.360517 15159 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.409832 10735 raft_consensus.cc:1275] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:17.356714 14982 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.412472 10669 raft_consensus.cc:2468] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 19.
I20260709 13:17:17.357075 15170 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.380671 10734 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:17.446379 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 77047.2us
I20260709 13:17:17.414400 10591 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:17.447978 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:17.412303 15311 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:17.377296 14810 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.377569 15152 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.360150 15217 consensus_queue.cc:1059] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 13:17:17.444001 15314 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:17.410063 15178 raft_consensus.cc:2804] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:17.457265 15240 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.443181 15242 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.443583 14917 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:17.467437 10708 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.451483 15241 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:17:17.496018 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:17.510378 10585 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.476825 15275 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:17.511863 15275 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.469913 15272 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.450873 15100 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:17.470295 15152 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:17.459924 14982 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.480150 15240 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.531190 10585 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:17.533119 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:17.412531 15049 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.541896 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2375) took 1091 ms. Trace:
I20260709 13:17:17.499601 15236 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.500365 15165 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.509074 15159 raft_consensus.cc:3055] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:17.507392 15243 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.522254 14721 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.565979 10741 raft_consensus.cc:1275] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:17.573030 10741 pending_rounds.cc:85] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 5
W20260709 13:17:17.567325 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 192074us
I20260709 13:17:17.573807 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:17.568148 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 100803us
I20260709 13:17:17.524358 15152 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.576546 10741 pending_rounds.cc:107] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:17.576932 10741 raft_consensus.cc:2889] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.523936 15249 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.547461 15239 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:17.499339 15242 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.552915 15320 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.593680 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:17.575687 15248 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.594460 11415 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.477357 15309 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.601513 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.602979 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:17.578958 15275 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:17.596276 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 226660us
I20260709 13:17:17.608621 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:17.564210 15159 raft_consensus.cc:740] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.571408 15113 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:17.584786 15316 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:17.626700 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 337862us
I20260709 13:17:17.628702 11415 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:17.597115 15028 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:17.548363 10739 rpcz_store.cc:276] 0709 13:17:16.450586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.450706 (+   120us) service_pool.cc:224] Handling call
0709 13:17:16.475691 (+ 24985us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:16.495206 (+ 19515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.495250 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:16.508741 (+ 13491us) log.cc:844] Serialized 52 byte log entry
0709 13:17:16.682457 (+173716us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b180045c3a0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:17:16.867893 (+185436us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.060000 (+192107us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.060490 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.494022 (+433532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.494131 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.541396 (+ 47265us) raft_consensus.cc:1685] finished
0709 13:17:17.541670 (+   274us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.541833 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103290,"prepare.queue_time_us":579779,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1706,"raft.queue_time_us":83304,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":17615,"spinlock_wait_cycles":3305728,"thread_start_us":608828,"threads_started":3,"wal-append.queue_time_us":435303}
W20260709 13:17:17.643119 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 284747us
I20260709 13:17:17.595896 15093 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.594199 15239 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:17.657557 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.661795 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:17.663137 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:17.663767 10734 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:17.674640 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 326119us
I20260709 13:17:17.681910 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:17.683486 10665 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:17.645123 14774 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:17.645025 15275 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.588199 14810 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.642845 14721 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:17.719928 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:17.696661 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:17.658697 15317 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:17:17.583490 15243 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.648478 15320 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.711609 14853 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.666299 15028 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:17:17.713734 15318 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:17:17.715332 10585 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:17.715121 15239 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.719133 15275 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:17.590711 14917 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.650262 15129 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:17.723129 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:17.727015 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.739552 10660 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.739704 10735 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:17.597918 15240 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.698482 15257 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.675307 15316 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:17.651059 15292 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:17:17.749409 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:17.750289 10735 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.745447 10738 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:17.728895 14721 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.770217 10734 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:17.744994 15275 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.728407 15159 consensus_queue.cc:260] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.763862 15240 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.738232 14853 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.799304 10734 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:17.765950 15233 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:17.788726 14982 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:17.819883 15322 log.cc:927] Time spent T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:17.823865 15334 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.824446 15334 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:17.828089 15337 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:17.829507 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2382) took 1182 ms. Trace:
W20260709 13:17:17.829941 15329 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:17.829871 10743 rpcz_store.cc:276] 0709 13:17:16.647536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.946297 (+298761us) service_pool.cc:224] Handling call
0709 13:17:16.960131 (+ 13834us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:17.306989 (+346858us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:17.307059 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:17.330180 (+ 23121us) log.cc:844] Serialized 52 byte log entry
0709 13:17:17.571472 (+241292us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:17.571522 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.571613 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.829226 (+257613us) raft_consensus.cc:1685] finished
0709 13:17:17.829247 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.829421 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3471,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4748,"thread_start_us":528047,"threads_started":2,"wal-append.queue_time_us":347101}
W20260709 13:17:17.833714 15331 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:17.835275 15062 raft_consensus.cc:993] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:17.835078 15316 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.837699 14853 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.842377 15243 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:17.843355 15156 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.846776 15275 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:17.855952 10660 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:17.751258 15257 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.859953 15258 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.861644 15062 raft_consensus.cc:1081] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:17.792049 15178 raft_consensus.cc:697] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 19 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:17.863600 15178 consensus_queue.cc:237] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.860044 15257 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.810330 15242 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:17.810725 15310 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.885753 15310 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:17.891152 15218 consensus_meta.cc:287] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.637s	user 0.005s	sys 0.003s
I20260709 13:17:17.902493 15248 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:17.902879 15251 consensus_meta.cc:287] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.000s
I20260709 13:17:17.902983 15248 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.871474 14721 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:17.845263 15156 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:17.918087 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 315195us
I20260709 13:17:17.876559 15170 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.920143 10735 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
W20260709 13:17:17.923529 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 343799us
I20260709 13:17:17.925550 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.926249 10591 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:17.927911 15339 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:17.930747 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:17.931309 10589 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 16.
I20260709 13:17:17.932158 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:17.935352 15346 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:17.936853 15156 consensus_queue.cc:1059] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:17.932922 11379 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:17.937942 15321 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:17.938269 15341 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.938319 15321 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:17.938789 15341 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.939141 15341 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.939388 15321 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.940680 15321 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:17.947151 15035 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.003s
I20260709 13:17:17.947611 15035 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:17.948715 10591 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:17.962996 15152 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:17.980616 15159 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:17.951807 10592 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:17.973148 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 53692.4us
I20260709 13:17:18.010159 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.011497 10660 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 7: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:18.014189 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.025516 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:18.027534 10706 leader_election.cc:400] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
I20260709 13:17:18.027908 10706 leader_election.cc:403] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:18.033612 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.034406 10669 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:18.080672 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.082077 10665 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 8.
W20260709 13:17:18.086024 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44383.2us
I20260709 13:17:18.088886 10663 raft_consensus.cc:1275] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:18.089641 10669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:17:18.090142 10669 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.087600 10559 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:18.090497 10669 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.950865 15334 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:18.097328 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80038us
I20260709 13:17:18.097443 11381 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:18.099139 11414 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:18.101013 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:18.101601 11410 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
I20260709 13:17:18.099159 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.101683 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.106175 10667 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:18.109160 10738 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:18.111466 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.111964 10738 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:18.122597 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:18.123155 11410 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 16.
I20260709 13:17:18.124317 11414 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.124718 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:17.987633 15210 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:17:17.987377 14836 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 13:17:18.128506 10743 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.133953 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:18.134817 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 47278us
W20260709 13:17:18.135377 10635 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.138212 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:18.135911 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:18.139155 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.143324 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.143512 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:18.144670 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:18.147686 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.028507 15156 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:18.152699 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.153590 10665 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:18.157058 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:18.157383 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62822.5us
I20260709 13:17:18.158011 10660 raft_consensus.cc:2393] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:18.159559 15236 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.160208 15236 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.162858 15236 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:18.163518 15236 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.164032 15236 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:18.168195 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:18.125159 10669 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.173161 10665 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.104341 15258 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:17:18.125968 14853 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:18.184054 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 72193.8us
I20260709 13:17:18.143128 15035 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:18.192953 10661 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:18.184039 10708 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:18.170009 14774 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.199981 10669 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:18.172741 15339 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.178527 15120 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.185550 14853 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.165126 15236 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.185248 15272 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:18.223824 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:18.225992 10707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.037s	sys 0.046s
W20260709 13:17:18.226339 10707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.037s	sys 0.047s
I20260709 13:17:18.228487 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.229215 10743 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:18.235574 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:18.237335 10586 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:18.223050 15316 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.200253 14982 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:18.240041 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.240705 10737 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 11.
I20260709 13:17:18.241513 15062 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:18.242127 15062 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.219369 15339 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:18.244653 15062 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:18.247398 15345 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
I20260709 13:17:18.247727 15351 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:18.248413 15351 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.213833 15344 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:17:18.233114 15035 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:18.249958 15035 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.252197 15035 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:18.214519 14774 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.254737 15170 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:18.255427 15324 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.466s	user 0.004s	sys 0.000s
I20260709 13:17:18.260890 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:18.261452 10589 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.263062 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:18.263545 10594 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:18.192619 15217 consensus_queue.cc:1048] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:17:18.270437 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:18.271334 10590 raft_consensus.cc:2393] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:17:18.273676 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 159652us
I20260709 13:17:18.274101 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:18.197618 14837 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:18.274736 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:18.264881 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:18.287091 10594 raft_consensus.cc:2393] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:18.223162 14853 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.225874 15336 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.290016 10586 raft_consensus.cc:1240] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:18.245122 15339 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:18.290890 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:18.293263 10593 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 16: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:18.294068 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.291882 10560 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:18.296411 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:18.296710 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:18.297432 10743 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 12.
I20260709 13:17:18.323462 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:18.298369 15336 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:18.325457 15338 log.cc:927] Time spent T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:18.326237 15308 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.328508 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:18.331331 11382 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:18.228876 15028 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:17:18.350420 11382 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:18.355475 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 138208us
I20260709 13:17:18.234408 15272 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:18.358812 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:18.361488 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:18.355078 10589 raft_consensus.cc:2468] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:18.320802 14836 raft_consensus.cc:3055] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:18.364903 11379 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:18.375885 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:18.376433 10594 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:18.376749 10594 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:18.348430 15233 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:18.380916 10737 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 7.
I20260709 13:17:18.373275 15062 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:18.385862 15062 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.377537 10594 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:18.388444 10594 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.392884 10594 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
W20260709 13:17:18.394760 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 70628.2us
I20260709 13:17:18.386204 15062 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:18.395681 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 210923us
I20260709 13:17:18.369283 15100 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.394945 10632 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:18.347810 15243 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:18.371223 14836 raft_consensus.cc:740] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:18.376962 15275 raft_consensus.cc:3055] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:18.381199 15245 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:18.519495 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 154689us
W20260709 13:17:18.594614 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 234517us
I20260709 13:17:18.418426 15233 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:19.053607 15233 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:18.711776 15362 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:17:18.725589 15330 log.cc:927] Time spent T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:18.394354 15345 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.646826 15348 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.387599 15178 raft_consensus.cc:2804] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:18.397830 15320 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.418232 14982 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.196s
I20260709 13:17:18.802465 15272 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:18.418232 15218 consensus_queue.cc:1048] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 13:17:18.646416 15353 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:18.721396 15165 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:18.918092 10663 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.011s
I20260709 13:17:19.096026 10663 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:19.067085 15083 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.825836 15341 consensus_meta.cc:287] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.886s	user 0.017s	sys 0.011s
I20260709 13:17:18.918388 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:18.973733 14853 consensus_meta.cc:287] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 13:17:18.825469 11413 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 13: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
W20260709 13:17:18.990670 10706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.029s
I20260709 13:17:18.931567 15239 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.978148 15028 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:18.918903 10557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.020s	sys 0.053s
I20260709 13:17:18.905853 15251 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.980366 15062 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.010s
I20260709 13:17:19.080852 15345 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.084007 15320 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:18.962198 15373 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.519s	user 0.004s	sys 0.006s
W20260709 13:17:19.036294 14810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.003s	sys 0.007s
I20260709 13:17:18.918507  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.084312 15388 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:19.116514 15083 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.097605 15353 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.909050 14837 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:18.812741 15275 raft_consensus.cc:740] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:18.918988 15159 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.938s	user 0.005s	sys 0.012s
I20260709 13:17:18.955942 15210 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.056831 15113 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:18.804255 14836 consensus_queue.cc:260] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.057165 15245 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.033841 15351 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:18.833613 15321 consensus_meta.cc:287] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.006s
W20260709 13:17:19.081364 15248 consensus_meta.cc:287] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 1.178s	user 0.023s	sys 0.005s
W20260709 13:17:19.103935 10706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.013s	sys 0.029s
I20260709 13:17:19.102283 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.107196 10669 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:19.108177 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.147231 10664 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 7.
W20260709 13:17:19.146782 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 750155us
I20260709 13:17:19.147831 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.148165 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.148509 10669 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:17:19.116206 10557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.028s	sys 0.064s
W20260709 13:17:19.148888 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 788781us
I20260709 13:17:18.932090 15241 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.119828 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1801) took 1011 ms. Trace:
I20260709 13:17:19.163885 15241 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.163946 10741 rpcz_store.cc:276] 0709 13:17:18.108541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.109981 (+  1440us) service_pool.cc:224] Handling call
0709 13:17:18.110238 (+   257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.167161 (+ 56923us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:18.194018 (+ 26857us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.387000 (+192982us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.398308 (+ 11308us) log.cc:844] Serialized 52 byte log entry
0709 13:17:18.398461 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:18.398496 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.398584 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.119621 (+721037us) raft_consensus.cc:1685] finished
0709 13:17:19.119645 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.119773 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108364,"prepare.queue_time_us":30879,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":115427,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":15123,"thread_start_us":86570,"threads_started":1,"wal-append.queue_time_us":144339}
I20260709 13:17:19.166749 15241 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:19.119834 14810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.007s
I20260709 13:17:19.167579 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 620) took 1088 ms. Trace:
I20260709 13:17:19.167940 10666 rpcz_store.cc:276] 0709 13:17:18.078999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.091057 (+ 12058us) service_pool.cc:224] Handling call
0709 13:17:18.091459 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.123716 (+ 32257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.123744 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.155688 (+ 31944us) log.cc:844] Serialized 52 byte log entry
0709 13:17:18.353728 (+198040us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.353770 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.353843 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.167350 (+813507us) raft_consensus.cc:1685] finished
0709 13:17:19.167376 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.167530 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14820,"raft.queue_time_us":40506,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":18381,"thread_start_us":134269,"threads_started":1,"wal-append.queue_time_us":969252}
W20260709 13:17:19.175652 15364 log.cc:927] Time spent T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:17:19.179627 10668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2526) took 1169 ms. Trace:
I20260709 13:17:19.180060 10668 rpcz_store.cc:276] 0709 13:17:18.010218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.010379 (+   161us) service_pool.cc:224] Handling call
0709 13:17:18.010725 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.011143 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.011181 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.011740 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.215689 (+203949us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.318979 (+103290us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.319484 (+   505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.319567 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.174866 (+855299us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:19.179386 (+  4520us) raft_consensus.cc:1685] finished
0709 13:17:19.179467 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.179576 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31270,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":25,"raft.queue_time_us":1657,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":205,"spinlock_wait_cycles":31148928,"thread_start_us":294994,"threads_started":2,"wal-append.queue_time_us":375303}
I20260709 13:17:19.184608 15217 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.185089 15217 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:19.186159 15217 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:19.198552 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.200083 15249 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.200555 15249 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.207093 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:19.121675 15388 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.117295 15272 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:19.126370 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 208065us
I20260709 13:17:19.123757 15083 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:17:19.119279 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.211473 10663 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:19.128487 15120 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.122025 15354 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.223s
I20260709 13:17:19.101506 15370 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.220618 10736 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:19.119588 15320 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.154314 10742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1805) took 1043 ms. Trace:
I20260709 13:17:19.221978 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.221859 10742 rpcz_store.cc:276] 0709 13:17:18.110640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.110733 (+    93us) service_pool.cc:224] Handling call
0709 13:17:18.111000 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.151652 (+ 40652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.151698 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.167030 (+ 15332us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.348602 (+181572us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:18.387762 (+ 39160us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.387970 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.388047 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.154012 (+765965us) raft_consensus.cc:1685] finished
0709 13:17:19.154039 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.154235 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46536,"prepare.queue_time_us":32689,"prepare.run_wall_time_us":39,"raft.queue_time_us":61279,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":24483,"spinlock_wait_cycles":7619456,"thread_start_us":147898,"threads_started":1,"wal-append.queue_time_us":967933}
I20260709 13:17:19.150748 15245 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.139003 15336 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.120229 14853 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.132198 15028 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.203676 15344 consensus_queue.cc:1059] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:17:19.221258 15083 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.225150 15275 consensus_queue.cc:260] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.231069 15393 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.230965 15083 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.231930 15028 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.231591 15393 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.120303 15239 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:19.233916 15376 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:17:19.234998 15239 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.118799 15251 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.237069 15251 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.237763 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2381) took 1200 ms. Trace:
I20260709 13:17:19.238216 10662 rpcz_store.cc:276] 0709 13:17:18.037773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.037954 (+   181us) service_pool.cc:224] Handling call
0709 13:17:18.038310 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.038691 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.038730 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.092836 (+ 54106us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.319297 (+226461us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:18.319355 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.319436 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.237548 (+918112us) raft_consensus.cc:1685] finished
0709 13:17:19.237570 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.237700 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43114,"raft.queue_time_us":86,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12886,"thread_start_us":172956,"threads_started":1,"wal-append.queue_time_us":256081}
I20260709 13:17:19.118256 15062 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.242223 15062 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:19.242558 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 92834.4us
W20260709 13:17:19.243461 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:19.201778 10661 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35982 (request call id 2372) took 1522 ms (client timeout 1581 ms). Trace:
W20260709 13:17:19.244536 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.246799 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:19.250164 15388 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.251462 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.122685 15353 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:19.119585 15345 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.207212 15240 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.202332 15113 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.215969 15321 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
W20260709 13:17:19.216820 15359 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:17:19.226366 11413 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:19.117748 15341 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.146163 14837 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:19.105650 15165 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:19.229105 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 181673us
I20260709 13:17:19.301745 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.159667 15375 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.269542 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:19.306951 11410 raft_consensus.cc:2368] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 12. Current term is 13.
I20260709 13:17:19.307170 10737 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:19.139838 15210 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.252254 14774 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.294518 11414 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:19.208330 15248 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.312218 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:19.335888 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:19.221269 15272 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.344131 10592 raft_consensus.cc:1240] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.274376 15028 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.244355 10661 rpcz_store.cc:269] 0709 13:17:17.679694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.681508 (+  1814us) service_pool.cc:224] Handling call
0709 13:17:19.201618 (+1520110us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000c2454. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:19.201729 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085501696}
I20260709 13:17:19.268432 15120 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.319010 15375 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.347929 15120 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.348680 14853 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.306010 14837 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.350121 15120 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.349817 15272 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.354423 15249 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.337222 14774 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.355278 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1802) took 1246 ms. Trace:
I20260709 13:17:19.252681 15320 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.356251 15320 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.278286 15378 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.357630 15378 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.358712 15113 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.359272 15239 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.359361 15393 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.359632 15378 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.360190 15378 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.310982 14721 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:19.360821 14721 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.361106 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:19.361378 14721 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.361688 10737 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.304821 14937 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.362947 14937 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.355774 10735 rpcz_store.cc:276] 0709 13:17:18.108790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.108886 (+    96us) service_pool.cc:224] Handling call
0709 13:17:18.113627 (+  4741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.151921 (+ 38294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.151970 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.177451 (+ 25481us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.832767 (+655316us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b18001ce760. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:17:19.097124 (+264357us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:19.097181 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.097263 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.354940 (+257677us) raft_consensus.cc:1685] finished
0709 13:17:19.354966 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.355210 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37812,"raft.queue_time_us":65072,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11721,"spinlock_wait_cycles":20226944,"thread_start_us":190051,"threads_started":1,"wal-append.queue_time_us":1159438}
I20260709 13:17:19.278141 15240 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.367738 15240 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.365759 15392 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.372623 15392 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.365816 14937 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.368253 15028 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.316115 15335 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.370914 15320 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.349748 15375 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.305274 15321 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.379966 10737 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:17:19.369628 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:19.383565 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:19.317129 14810 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.409080 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:19.413722 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.414462 10743 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:19.415983 10734 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:19.409730 11413 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 16.
I20260709 13:17:19.420616 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.425292 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.426060 10735 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:19.345767 15178 raft_consensus.cc:697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:19.383638 15395 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.452606 15321 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.431339 15210 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.410326 14774 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.429216 15341 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.404471 15346 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.411193 15404 consensus_queue.cc:1048] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:17:19.435122 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.437214 15245 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.420259 15375 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:17:19.442467 11382 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:19.274582 15370 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.448276 11410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44884 (request call id 545) took 1305 ms. Trace:
I20260709 13:17:19.449666 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:19.468852 11410 rpcz_store.cc:276] 0709 13:17:18.143081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.143298 (+   217us) service_pool.cc:224] Handling call
0709 13:17:19.448062 (+1304764us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540017c5d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:19.448211 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673943936}
I20260709 13:17:19.469436 10668 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.450631 10666 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:19.423645 14810 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.451215 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.409224 15335 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.359876 15239 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.360656 15378 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.452838 15395 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.455886 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:19.482124 10742 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:17:19.435151 15381 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:19.477741 15406 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:17:19.487142 15402 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.473594 10736 raft_consensus.cc:2468] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:19.473968 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.452639 15178 consensus_queue.cc:237] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.430485 10735 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:19.496333 11414 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.477185 15396 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.505126 10663 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:19.477895 15348 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.528487 15348 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.529062 15396 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:19.539062 15396 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.547051 10742 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:19.554304 11382 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:19.488294 15321 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.561380 11410 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:19.563242 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:19.569938 10708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.014s
W20260709 13:17:19.570385 10708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.003s	sys 0.014s
W20260709 13:17:19.558591 15381 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:19.571434 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2414) took 1455 ms. Trace:
I20260709 13:17:19.577833 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.468132 15346 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.545980 15313 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.566442 15341 raft_consensus.cc:2804] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:19.582849 15370 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.567636 15248 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.568038 14836 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.569360 15316 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.578203 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:19.566371 15233 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:19.595379 15233 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.569059 15321 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.598500 15321 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.591071 15313 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.600864 15313 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.602938 14810 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.600795 15028 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.487617 15402 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.604718 15346 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.601888 15239 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.605427 15341 raft_consensus.cc:697] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:19.605454 15402 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.602409 15233 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.606427 15341 consensus_queue.cc:237] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.607319 15083 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.562448 15392 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:19.595700 15170 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.610356 10557 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:19.572606 15251 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.575294 10738 rpcz_store.cc:276] 0709 13:17:18.115711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.140940 (+ 25229us) service_pool.cc:224] Handling call
0709 13:17:18.141615 (+   675us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:18.372441 (+230826us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:18.413536 (+ 41095us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.223706 (+810170us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:19.229860 (+  6154us) log.cc:844] Serialized 78 byte log entry
0709 13:17:19.230011 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:19.233856 (+  3845us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.236429 (+  2573us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.444075 (+207646us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800068680. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc522 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:19.566690 (+122615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.571157 (+  4467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.571220 (+    63us) raft_consensus.cc:1685] finished
0709 13:17:19.571238 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.571371 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97669,"prepare.queue_time_us":44600,"prepare.run_cpu_time_us":22786,"prepare.run_wall_time_us":311099,"raft.queue_time_us":112044,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":54568,"spinlock_wait_cycles":8901632,"thread_start_us":803600,"threads_started":3,"wal-append.queue_time_us":830150}
I20260709 13:17:19.618634 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.567801 15395 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.559625 14721 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.624251 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:19.624722 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.609107 15313 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:17:19.624853 10594 raft_consensus.cc:3060] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.688501 10587 raft_consensus.cc:1275] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:19.622696 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:19.708473 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 85845.8us
I20260709 13:17:19.685812 15378 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.720000 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.723919 10594 raft_consensus.cc:2468] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:19.725165 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.726030 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:19.730911 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.737579 10708 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.707890 15321 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.746201 10594 raft_consensus.cc:1275] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:19.707131 15346 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.751986 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:19.755051 10708 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.731675 10743 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:19.622191 15251 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:19.772095 10662 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:19.772552 10662 pending_rounds.cc:85] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 6
I20260709 13:17:19.772817 10662 pending_rounds.cc:107] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:19.773087 10662 raft_consensus.cc:2889] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.763880 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.717661 15395 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:19.707108 15233 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:17:19.728852 15354 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.779428 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.729298 15035 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.783320 15410 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.709448 15408 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:17:19.784650 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.842015 10662 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
W20260709 13:17:19.816859 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 53095.8us
I20260709 13:17:19.848210 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.858914 10743 raft_consensus.cc:2468] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:19.886387 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.888866 10743 raft_consensus.cc:2410] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:17:19.889953 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 133549us
I20260709 13:17:19.890913 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.892339 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:19.769057 15393 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.812141 15216 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.770242 15320 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:19.791805 10668 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 9.
I20260709 13:17:19.900513 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.770601 15165 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:19.902994 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:19.904655 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 60633.7us
I20260709 13:17:19.816686 15290 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.785271 15411 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.784767 15409 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:19.912690 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:19.903079 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.913334 10668 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:19.908440 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.930536 10743 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:19.884414 15035 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.919234 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.919595 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.919941 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.920246 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.920579 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.921073 14721 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.921257 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.946650 10662 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:19.921746 15403 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.818341 15335 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.935125 10585 raft_consensus.cc:2410] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:19.938359 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:19.947714 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 55472.6us
I20260709 13:17:19.930961 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.771636 15321 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.935012 10588 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:19.943174 11379 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.769857 15346 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.948326 10743 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:19.949831 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:19.901121 15344 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.951015 10560 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:19.904017 15243 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.900460 15249 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:19.968021 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.970304 10708 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:19.904699 15320 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:19.975524 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.994877 10668 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:19.996025 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:19.788903 15395 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.960338 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:19.959460 15427 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:19.987955 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.983839 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.948733 15165 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.891558 15354 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.915195 15290 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:19.992555 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:19.961637 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.949463 15417 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:19.901635 15370 consensus_queue.cc:1059] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:17:19.999291 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.016800 10592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1977) took 1880 ms. Trace:
I20260709 13:17:19.924598 15409 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.990581 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:19.971146 15258 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.999341 14721 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.969606 15245 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:19.932006 15035 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.891861 15410 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.016870 10668 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:17:19.999898 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56841.3us
W20260709 13:17:20.050544 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 80373.5us
I20260709 13:17:20.018055 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:19.960901 15233 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.915725 15313 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:20.017520 10592 rpcz_store.cc:276] 0709 13:17:18.136516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.138341 (+  1825us) service_pool.cc:224] Handling call
0709 13:17:18.138669 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.344559 (+1205890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.016527 (+671968us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540020fb54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:20.016731 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771842432}
I20260709 13:17:20.027496 10742 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:20.008198 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:19.924161 15216 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:19.999584 15320 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.015915 15290 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.013389 15406 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.058602 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.022796 15335 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.059412 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.026471 15409 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:20.001542 15243 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.068902 15321 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.069571 15216 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.002894 15249 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.047127 14721 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:20.070112 15405 consensus_queue.cc:1048] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:20.074013 15426 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:20.074388 15412 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:17:20.030406 15417 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.080271 15395 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.082005 15354 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.082070 15251 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.083292 15346 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.083804 15410 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.053426 15165 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:20.090665 15353 consensus_meta.cc:287] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.000s
I20260709 13:17:20.092097 15385 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.086s
W20260709 13:17:20.092705 15379 log.cc:927] Time spent T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.525s	user 0.007s	sys 0.013s
I20260709 13:17:20.094852 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:20.095805 15369 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.709s	user 0.006s	sys 0.006s
W20260709 13:17:20.096642 15333 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 1.601s	user 0.004s	sys 0.010s
W20260709 13:17:20.096939 15348 consensus_meta.cc:287] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.000s
I20260709 13:17:20.101432 15152 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.101878 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.110940 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.204226 15320 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.206930 15320 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.211338 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.211905 10585 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:20.212494 10587 raft_consensus.cc:1240] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:20.213510 10735 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:20.219748 15249 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:20.221705 15422 log.cc:927] Time spent T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:17:20.197954 15348 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.223328 15417 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.224261 15165 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.226491 15243 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.229475 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.230064 10743 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:20.230576 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.230926 15035 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.231673 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.112632 10708 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:20.119624 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 122843us
W20260709 13:17:20.232867 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 120295us
I20260709 13:17:20.233677 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.062505 15344 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:20.235422 15344 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.235791 15344 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.237474 15320 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.237872 15320 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.238233 15320 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.238363 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 1981) took 1850 ms. Trace:
I20260709 13:17:20.238739 10589 rpcz_store.cc:276] 0709 13:17:18.387660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.394398 (+  6738us) service_pool.cc:224] Handling call
0709 13:17:18.395059 (+   661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.200656 (+805597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.200686 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.201121 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.473791 (+272670us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.473826 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.711146 (+237320us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54003ff7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:19.711197 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.238097 (+526900us) raft_consensus.cc:1685] finished
0709 13:17:20.238118 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.238309 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157476,"raft.queue_time_us":133623,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":6600,"spinlock_wait_cycles":1546359040,"thread_start_us":272332,"threads_started":1,"wal-append.queue_time_us":378988}
I20260709 13:17:20.155233 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.240947 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.242157 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.242578 14774 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:20.114081 15375 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.243585 15430 log.cc:927] Time spent T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.325s	user 0.004s	sys 0.000s
I20260709 13:17:20.243734 15375 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.057482 15411 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:17:20.194679 15353 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.246011 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.247179 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.062135 15233 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.247947 15353 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.248718 11415 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 17: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:20.248991 10590 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
W20260709 13:17:20.249131 14836 consensus_meta.cc:287] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:17:20.243126 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.249617 10664 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2392) took 1134 ms. Trace:
I20260709 13:17:20.156281 14721 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.187915 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.250003 10662 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:20.148826 15335 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.195365 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:20.195811 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 127464us
I20260709 13:17:20.211140 15395 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:20.232445 10591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34318 (request call id 600) took 2096 ms. Trace:
W20260709 13:17:20.074013 15423 log.cc:927] Time spent T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:17:20.079919 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.241109 15152 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:20.230955 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.264658 10743 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:20.248214 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.250007 10664 rpcz_store.cc:276] 0709 13:17:19.115300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.150221 (+ 34921us) service_pool.cc:224] Handling call
0709 13:17:19.150480 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.283867 (+133387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.283909 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.284696 (+   787us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.569722 (+285026us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.569760 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.249217 (+679457us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54000c3d54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:20.249263 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.249307 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:20.249354 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.249556 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51723,"raft.queue_time_us":68040,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3767,"spinlock_wait_cycles":209717504,"thread_start_us":284719,"threads_started":1,"wal-append.queue_time_us":307745}
I20260709 13:17:20.254552 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.259858 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.116743 10668 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 17.
I20260709 13:17:20.261926 10591 rpcz_store.cc:276] 0709 13:17:18.136236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.137460 (+  1224us) service_pool.cc:224] Handling call
0709 13:17:18.137954 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.196249 (+ 58295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.196280 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.196786 (+   506us) log.cc:844] Serialized 52 byte log entry
0709 13:17:18.315696 (+118910us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.315741 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.315801 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.092311 (+1776510us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b2400168b48. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540529c4 00007f4254050acb 00007f425420bdc9 00007f425420ba55 00007f425420b09d 00007f4256e3d10e 00007f4256e5488c 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221
0709 13:17:20.232167 (+139856us) raft_consensus.cc:1685] finished
0709 13:17:20.232187 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.232389 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62593,"raft.queue_time_us":84202,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":6570,"spinlock_wait_cycles":287927552,"thread_start_us":42179,"threads_started":1,"wal-append.queue_time_us":147310}
I20260709 13:17:20.267318 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.266460 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.267446 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.268743 10735 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 17.
I20260709 13:17:20.269441 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.273667 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.274174 10665 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:20.274899 10664 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:20.275132 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.276283 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.274111 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1808) took 1057 ms. Trace:
I20260709 13:17:20.278995 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.279076 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.279019 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.280284 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.280730 10742 raft_consensus.cc:2410] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:20.278601 10739 rpcz_store.cc:276] 0709 13:17:19.216791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.217597 (+   806us) service_pool.cc:224] Handling call
0709 13:17:19.268461 (+ 50864us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:19.714008 (+445547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.714044 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:19.727747 (+ 13703us) log.cc:844] Serialized 52 byte log entry
0709 13:17:19.824336 (+ 96589us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.904215 (+ 79879us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.058797 (+154582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.058869 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.273905 (+215036us) raft_consensus.cc:1685] finished
0709 13:17:20.273925 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.274051 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28725,"prepare.queue_time_us":79741,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":158842,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":80498,"thread_start_us":675617,"threads_started":3,"wal-append.queue_time_us":197159}
I20260709 13:17:20.281965 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.249185 15233 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.288010 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.292800 10589 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:20.293498 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.280103 15035 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.301306 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.302709 10662 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
I20260709 13:17:20.301366 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.301985 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.286911 15290 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.307677 15290 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.309985 15211 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.310534 15211 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.311015 15211 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.313680 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.314704 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.315353 10585 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:20.316002 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:20.316574 10585 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:20.317577 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.274904 15152 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.318495 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.319454 10665 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:20.331845 15335 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.332423 15335 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:20.332845 15335 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.334932 15335 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.338114 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.341085 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.364665 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.367594 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.368511 10587 raft_consensus.cc:2393] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 16: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:17:20.352576 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.021s
W20260709 13:17:20.369696 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.025s	sys 0.024s
I20260709 13:17:20.372746 10742 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:20.373347 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.373602 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.374639 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.294773 15439 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.344015 14721 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.386050 10593 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:20.388010 14721 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.381542 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.337014 15152 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.382555 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.390939 10662 raft_consensus.cc:2410] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:20.297765 14954 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:17:20.394788 10662 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:20.395988 10662 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:20.401815 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.403066 10665 raft_consensus.cc:2410] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:20.404839 10665 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:20.406581 14954 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.414336 14954 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.415941 10706 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:20.420625 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.426819 10588 raft_consensus.cc:2410] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:20.427544 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.421022 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.362552 15375 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.357300 15346 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.375633 15272 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.435102 10706 leader_election.cc:403] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:20.425346 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.303440 14836 consensus_queue.cc:1059] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:20.377660 15410 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:20.377434 15354 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.424293 15385 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.432430 10589 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:20.434145 15442 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:20.384332 15439 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.443070 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.432576 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.470140 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.471859 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:20.472290 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 237274us
I20260709 13:17:20.491381 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:20.494869 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 51878.9us
I20260709 13:17:20.442234 15346 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:20.507926 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:20.497066 10706 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.68.68:35619 timed out after 1.952s (SENT) [suppressed 21 similar messages]
W20260709 13:17:20.538787 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 256865us
I20260709 13:17:20.550678 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.490031 15439 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.551728 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:20.601233 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 49593.4us
I20260709 13:17:20.499298 14836 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:20.599797 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 247749us
I20260709 13:17:20.479115 15385 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.612051 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:20.617116 10589 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:20.493578 15320 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.584998 15388 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.599567 15417 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.628525 10589 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:20.506713 15409 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.646812 10741 raft_consensus.cc:2393] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:20.658561 10590 raft_consensus.cc:1240] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:17:20.660199 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 57782.7us
W20260709 13:17:20.656986 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 159934us
I20260709 13:17:20.663956 10635 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.633698 15388 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.639940 15417 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.682878 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 625) took 1236 ms. Trace:
I20260709 13:17:20.683601 10661 rpcz_store.cc:276] 0709 13:17:19.446430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.447899 (+  1469us) service_pool.cc:224] Handling call
0709 13:17:19.448195 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.504724 (+ 56529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.504769 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.504821 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:19.504863 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.682654 (+1177791us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54002b0054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:20.682701 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.682814 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129493248}
I20260709 13:17:20.685345 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:20.687281 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.651661 15310 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:17:20.689069 10661 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:20.692649 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:20.691567 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 85158.5us
I20260709 13:17:20.694152 10661 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 16.
I20260709 13:17:20.696024 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.697557 10661 raft_consensus.cc:2393] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 10: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:20.699105 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:20.673669 15453 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.679556 15393 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.659683 15344 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.690583 15335 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.665259 15152 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.718117 15216 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.718664 15216 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.721762 10743 raft_consensus.cc:2393] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 16: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:20.706465 15335 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.705073 15453 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.709594 15452 consensus_queue.cc:1048] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:17:20.760035 15455 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:17:20.762825 15443 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.557s	user 0.006s	sys 0.008s
I20260709 13:17:20.763304 15388 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.764683 15417 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:20.765616 15454 log.cc:927] Time spent T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:20.766647 11414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36324 (request call id 511) took 1381 ms. Trace:
I20260709 13:17:20.767025 11414 rpcz_store.cc:276] 0709 13:17:19.385046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.385207 (+   161us) service_pool.cc:224] Handling call
0709 13:17:19.385541 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.500227 (+114686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.766428 (+1266201us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54006702d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:20.766581 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254243712}
I20260709 13:17:20.768314 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.770205 15335 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.730729 15216 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.731173 15450 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:20.774259 15450 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.776331 15450 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.776842 15403 raft_consensus.cc:3055] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:20.777235 15403 raft_consensus.cc:740] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:20.778041 15403 consensus_queue.cc:260] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.780808 10592 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:17:20.785430 11415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 690) took 1539 ms (client timeout 1959 ms). Trace:
W20260709 13:17:20.785835 11415 rpcz_store.cc:269] 0709 13:17:19.246298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.246577 (+   279us) service_pool.cc:224] Handling call
0709 13:17:20.785214 (+1538637us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400556ed4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:20.785373 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302466432}
I20260709 13:17:20.787361 15310 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:20.787918 15310 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.784166 15403 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.760106 15452 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:20.792840 15452 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.793191 15452 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:20.734041 15385 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.734784 15320 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.736238 15409 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:20.710525 15393 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.799091 15393 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.799535 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:20.803296 10663 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42652 (request call id 627) took 1356 ms (client timeout 1569 ms). Trace:
W20260709 13:17:20.803784 10663 rpcz_store.cc:269] 0709 13:17:19.446978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.450960 (+  3982us) service_pool.cc:224] Handling call
0709 13:17:20.803089 (+1352129us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400368154. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:20.803219 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70207360}
I20260709 13:17:20.806098 11381 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:20.808200 15352 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:20.744143 15344 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.746204 15346 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:20.814040 15346 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.816810 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:20.818114 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.818640 10738 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:20.819072 10738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 712) took 1205 ms. Trace:
I20260709 13:17:20.819341 10738 rpcz_store.cc:276] 0709 13:17:19.613901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.817888 (+1203987us) service_pool.cc:224] Handling call
0709 13:17:20.819025 (+  1137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:20.749045 10665 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:20.821395 15335 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.823588 15335 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.824638 15348 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.825650 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:20.752568 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.826333 10739 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.827112 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:20.827757 15437 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.570s	user 0.001s	sys 0.001s
I20260709 13:17:20.828187 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:20.828837 11411 raft_consensus.cc:2368] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:20.829597 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.752660 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.831797 11413 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:20.832794 10662 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:20.833163 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.836221 15417 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:20.836746 15417 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:20.755999 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.790598 15453 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.738569 15152 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.755277 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.841873 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.748787 15211 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:20.843240 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.825817 10665 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:20.871021 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:20.874136 10706 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:20.880752 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:20.859844 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:20.885593 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:20.890062 10734 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:20.853895 15320 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:20.943897 10587 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
W20260709 13:17:20.951393 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 91620.6us
I20260709 13:17:20.920636 15417 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:20.952606 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 288746us
I20260709 13:17:20.960906 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:20.964159 10739 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:20.968138 10737 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:20.988694 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:20.991896 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:20.992833 10737 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:20.960855 15083 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:21.005645 15083 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.006170 15083 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.993808 15354 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.994076 15310 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.987685 15386 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:21.001183 15452 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.019069 15452 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:20.962476 15450 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:21.019759 15450 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.003839 15335 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.994359 15461 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.997725 15211 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.022305 15461 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.022266 15439 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.023123 15461 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.987571 15346 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:20.954732 15320 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.026392 15450 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:21.028221 15320 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:21.032210 15461 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.034240 15461 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.037827 10662 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2405) took 1077 ms. Trace:
I20260709 13:17:21.038293 10662 rpcz_store.cc:276] 0709 13:17:19.960765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.397459 (+436694us) service_pool.cc:224] Handling call
0709 13:17:20.832429 (+434970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.833213 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.037598 (+204385us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400368150. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.037759 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999533952}
I20260709 13:17:21.048595 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:20.993186 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 119145us
I20260709 13:17:21.043744 15439 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:21.054059 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.063480 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.065399 10706 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Vote denied by peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:21.066200 10706 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.073578 15450 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.074201 15450 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.076511 15450 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.077553 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.080205 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.080838 10665 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.086160 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.086833 10663 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:21.088528 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.089959 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.090662 10663 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:21.092801 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.094959 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.095693 10662 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:21.093679 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.053586 15320 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.104424 10706 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:21.106419 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 412169us
I20260709 13:17:21.112859 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.062664 15461 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.115998 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 233718us
I20260709 13:17:21.072038 15346 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.070570 15241 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.123068 10665 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
W20260709 13:17:21.136754 10667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.032s
W20260709 13:17:21.140487 10667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.014s	sys 0.032s
W20260709 13:17:21.139053 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 256630us
I20260709 13:17:21.100703 15417 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.032755 15083 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.138407 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.105726 14954 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.157843 10667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2411) took 1108 ms. Trace:
I20260709 13:17:21.158352 10667 rpcz_store.cc:276] 0709 13:17:20.049483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.414761 (+365278us) service_pool.cc:224] Handling call
0709 13:17:20.414997 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.415183 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:20.604263 (+189080us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.157420 (+553157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.157488 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.157547 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.157635 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.157777 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15466,"prepare.queue_time_us":292074,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":719151,"threads_started":2}
I20260709 13:17:21.105901 15152 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:21.117976 15320 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.153662 15439 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.139379 15461 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.148466 15403 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.169445 10661 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35982 (request call id 2413) took 1104 ms. Trace:
I20260709 13:17:21.149911 15241 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.172009 10739 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:21.174938 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:21.178643 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 224550us
I20260709 13:17:21.177906 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.165993 15439 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.182020 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.195108 15477 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.195642 15477 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.180936 14982 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.205680 14982 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.207772 14982 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:21.211218 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.217557 14954 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.218004 15083 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:17:21.218035 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:21.225155 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.170444 15403 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:21.230268 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 52422.8us
I20260709 13:17:21.231937 15460 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.218209 14954 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.233361 15241 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.234278 15439 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:21.234314 15320 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:21.237736 10632 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.264782 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.272096 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.258605 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.211500 15477 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.254659 15461 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.293642 10739 raft_consensus.cc:1240] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:21.274487 15482 log.cc:927] Time spent T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:21.275484 15159 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.300356 10632 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.301245 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.259235 15453 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.304260 10632 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.295960 15461 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.309458 15449 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.316166 14954 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:21.317006 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.324622 10735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50140 (request call id 2432) took 1636 ms (client timeout 1959 ms). Trace:
W20260709 13:17:21.325294 10735 rpcz_store.cc:269] 0709 13:17:19.686522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.011123 (+324601us) service_pool.cc:224] Handling call
0709 13:17:21.322779 (+1311656us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001cc354. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.322906 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371224960}
I20260709 13:17:21.326537 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:21.322969 10632 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.327800 10739 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.323377 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.310343 15452 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.329478 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.323581 15335 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.336310 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.337273 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.333416 10735 raft_consensus.cc:2410] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:21.338225 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.301808 15395 consensus_queue.cc:1059] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:21.339767 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.340338 10587 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:21.341379 14954 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.341601 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.341398 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.341993 14954 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.342308 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:21.342989 15416 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 1.339s	user 0.009s	sys 0.004s
I20260709 13:17:21.344026 10589 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.344317 15397 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.332780 15489 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:21.345165 15489 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.345613 15489 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.346149 15397 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:21.346992 15211 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:21.347447 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.348723 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.351521 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.353137 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.347337 15211 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.349875 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.356499 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.330590 15449 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.323946 15467 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:21.474416 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.477021 10585 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:21.472458 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.474382 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:21.479576 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 130912us
I20260709 13:17:21.480581 10632 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.359714 15335 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:21.502180 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.503762 10738 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:21.502945 10587 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:21.483402 15418 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.517762 15449 consensus_queue.cc:1059] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:21.545926 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2380) took 1292 ms. Trace:
I20260709 13:17:21.551936 10590 rpcz_store.cc:276] 0709 13:17:20.253603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.255402 (+  1799us) service_pool.cc:224] Handling call
0709 13:17:20.264887 (+  9485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.658960 (+394073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.545685 (+886725us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540016ab54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:21.545870 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904847616}
I20260709 13:17:21.506949 15461 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.511445 15403 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:21.559486 15491 log.cc:927] Time spent T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:17:21.571830 10736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1812) took 2345 ms (client timeout 1776 ms). Trace:
W20260709 13:17:21.572366 10736 rpcz_store.cc:269] 0709 13:17:19.221641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.221764 (+   123us) service_pool.cc:224] Handling call
0709 13:17:21.566642 (+2344878us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003507d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.566757 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577190272}
I20260709 13:17:21.574508 10585 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
W20260709 13:17:21.579113 15490 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:17:21.596840 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 352797us
W20260709 13:17:21.600112 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 119318us
I20260709 13:17:21.600818 11379 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:21.511298 15211 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.603274 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:21.607517 14954 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:21.608144 15405 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:21.608530 15405 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.608880 15405 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.615605 15489 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.616780 15452 raft_consensus.cc:3055] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:21.617194 15452 raft_consensus.cc:740] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.617551 15211 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.601471 15453 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:21.622839 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 728899us
I20260709 13:17:21.624754 10560 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:21.629016 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.618096 15452 consensus_queue.cc:260] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.603016 15386 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.630455 15348 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.630942 15348 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.632982 15348 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.633489 15408 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.633986 15408 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.636000 15408 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.636456 15408 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.637511 15290 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:21.638055 15290 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:21.638906 15290 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.646036 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.646631 10736 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 8.
I20260709 13:17:21.647558 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.648252 10742 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:21.636889 15408 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.655196 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.656024 11418 raft_consensus.cc:1240] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:21.651754 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:21.657516 10632 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:21.659706 15453 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:21.660212 15453 raft_consensus.cc:697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.660274 10592 raft_consensus.cc:1275] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:21.660472 14774 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:21.661031 14774 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.661101 15453 consensus_queue.cc:237] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.662395 15275 raft_consensus.cc:3060] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:21.661427 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.673499 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.674962 10587 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.663003 14774 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:21.663844 15211 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:21.649183 15403 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:21.649333 15320 consensus_queue.cc:1059] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:21.693464 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:21.680092 15211 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.695848 15211 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.700765 15489 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:21.695197 15418 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:21.704591 15408 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.704954 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:21.706182 15448 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 1.050s	user 0.002s	sys 0.000s
I20260709 13:17:21.706910 15403 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.707252 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.708019 10738 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:21.709120 15418 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:21.709545 15418 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.710279 15418 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.710631 15489 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:21.711422 15418 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.707306 15403 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:21.706147 15320 raft_consensus.cc:3055] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:21.722751 15320 raft_consensus.cc:740] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:21.724651 15405 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.726364 15403 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.755708 10590 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.757791 15405 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.760095 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.760694 10592 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.760565 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.761406 10738 raft_consensus.cc:3060] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.766575 15403 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.768929 10735 raft_consensus.cc:1275] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:17:21.769248 10735 pending_rounds.cc:85] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 10
I20260709 13:17:21.769464 10735 pending_rounds.cc:107] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:17:21.769666 10735 raft_consensus.cc:2889] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.771147 15211 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.754184 15320 consensus_queue.cc:260] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.774176 15320 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:21.775210 11409 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 14: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:21.775686 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1816) took 2037 ms. Trace:
I20260709 13:17:21.776057 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.776031 10743 rpcz_store.cc:276] 0709 13:17:19.738152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.280073 (+541921us) service_pool.cc:224] Handling call
0709 13:17:21.775524 (+1495451us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002bdc54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.775635 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012600704}
I20260709 13:17:21.776834 10589 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.779500 10738 raft_consensus.cc:2410] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:21.777958 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.782359 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.784482 10559 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.773262 15211 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.778321 15344 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.792689 10559 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.785035 15408 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:21.790956 10592 raft_consensus.cc:2468] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:21.791390 15308 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:21.788858 15504 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.797133 15496 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.823143 15496 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.796442 15408 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.825968 15408 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:21.807870 15425 log.cc:927] Time spent T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 1.886s	user 0.000s	sys 0.017s
I20260709 13:17:21.791815 15344 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.797194 15129 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.835772 10589 raft_consensus.cc:2468] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:21.798642 10559 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.837179 10632 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:21.841061 15085 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.837990 11379 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:21.842918 15085 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.169880 10661 rpcz_store.cc:276] 0709 13:17:20.065474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.706780 (+641306us) service_pool.cc:224] Handling call
0709 13:17:20.707090 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.707572 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:20.939767 (+232195us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.168995 (+229228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.169060 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:21.169122 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.169207 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.169377 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17441,"prepare.queue_time_us":16758,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":16790,"thread_start_us":426421,"threads_started":2}
I20260709 13:17:21.845072 15085 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:21.845700 10593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2377) took 1635 ms (client timeout 1532 ms). Trace:
I20260709 13:17:21.845790 14853 raft_consensus.cc:2804] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:21.846091 15211 raft_consensus.cc:2804] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:21.849398 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.853930 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.865633 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:21.854403 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 115485us
I20260709 13:17:21.854691 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.855011 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.857558 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.858109 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:21.872357 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.872489 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.870196 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.874356 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.858436 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.860105 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.860538 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.875633 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.860685 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:21.876644 10594 raft_consensus.cc:3060] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.876715 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.861290 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:21.862897 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 64975.4us
I20260709 13:17:21.876061 10661 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 17.
I20260709 13:17:21.877590 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:21.861285 10593 rpcz_store.cc:269] 0709 13:17:20.210330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.211080 (+   750us) service_pool.cc:224] Handling call
0709 13:17:21.845553 (+1634473us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002c8dd4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.845642 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400398592}
I20260709 13:17:21.879448 10665 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:21.880208 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:21.877482 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.881218 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.881754 10593 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:21.885596 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:21.886123 10667 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:21.863765 14853 raft_consensus.cc:697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:21.887732 14853 consensus_queue.cc:237] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.864178 15445 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.862507 15496 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.865556 15211 raft_consensus.cc:697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.885597 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:21.897044 15496 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:21.897859 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.898516 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:21.900503 15487 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:21.901044 15487 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.901587 15487 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:21.905517 15211 consensus_queue.cc:237] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.893826 15408 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.909062 10589 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:21.913304 15408 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:21.916353 10739 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:21.918015 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 96788.9us
I20260709 13:17:21.919993 10594 raft_consensus.cc:2468] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
I20260709 13:17:21.922089 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.924821 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.929674 10708 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:21.932435 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:21.933287 15354 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.933544 10708 leader_election.cc:400] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:21.933969 15354 raft_consensus.cc:2804] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:21.934300 15354 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.934629 15354 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.935230 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:21.937646 10741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1815) took 2201 ms (client timeout 2241 ms). Trace:
W20260709 13:17:21.938048 10741 rpcz_store.cc:269] 0709 13:17:19.736587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.187520 (+450933us) service_pool.cc:224] Handling call
0709 13:17:21.937453 (+1749933us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54003304d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:21.937590 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889914240}
I20260709 13:17:21.939057 10708 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:21.940541 10632 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.941113 15320 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.941690 14937 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:21.941747 15450 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.942152 15275 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.942348 14937 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.942579 15450 consensus_queue.cc:1059] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:21.942672 15275 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:21.943169 10742 raft_consensus.cc:1240] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:21.943599 15450 raft_consensus.cc:3055] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:21.943955 15450 raft_consensus.cc:740] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:21.944408 14937 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:21.945453 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46651.3us
I20260709 13:17:21.946651 10736 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:17:21.948056 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.951929 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.952980 10635 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.954502 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.955469 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.956252 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.956764 10665 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:21.957734 15418 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.957891 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.958904 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:21.959575 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.945098 15275 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:21.961130 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.962589 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.970638 10667 raft_consensus.cc:2468] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:21.971064 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:21.973027 11381 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:21.975019 10668 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.975167 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:21.976284 10736 raft_consensus.cc:2393] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 15: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:21.977455 10594 raft_consensus.cc:1240] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:21.976584 10662 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:21.979313 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.982270 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.941720 15320 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.984817 10560 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.945429 15403 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:21.970633 15511 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:21.986059 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.985111 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:21.988238 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.961802 15216 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:21.944684 15450 consensus_queue.cc:260] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:21.991622 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.993104 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:21.990074 10560 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:21.961566 15389 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:21.993364 10594 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 11: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:21.990417 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.995234 10708 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:21.978678 15085 raft_consensus.cc:2804] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:21.993683 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:21.945600 15348 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:17:21.994060 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:21.998494 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:21.998593 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.978564 14917 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:17:21.989398 15445 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:21.991084 15290 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.000586 15517 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:21.999121 10736 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:22.004559 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:21.998452 15389 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:22.005609 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:21.996838 15062 raft_consensus.cc:2764] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:17:22.006685 15450 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.992583 14721 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.994295 15460 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:21.992686 15408 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.009582 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.011714 10594 raft_consensus.cc:2393] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 14: Already voted for candidate e71e2e44af1e46d8a8423ae08646bc22 in this term.
I20260709 13:17:22.012851 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.013851 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.014518 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:21.989208 15308 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:22.003320 14954 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:22.011242 15445 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.002079 15129 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.001274 14774 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:22.001885 15085 raft_consensus.cc:697] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:22.019517 15216 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:22.024159 15510 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:21.992962 15403 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.026813 15403 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.001467 15503 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.021353 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.021414 14721 consensus_queue.cc:1059] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:22.022511 15445 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.023633 15085 consensus_queue.cc:237] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.027884 15403 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.029138 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.030345 15275 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:22.030857 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.031781 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.033128 15403 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.033510 15320 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.019315 10635 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.036195 10586 raft_consensus.cc:1240] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.036592 10635 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.037601 10706 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.017814 14954 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.033499 15403 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.009070 15517 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.046175 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.015606 14937 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.047181 10635 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.052217 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.055199 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:22.050254 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.061952 10594 raft_consensus.cc:2376] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16. Re-sending same reply.
I20260709 13:17:22.063017 15211 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.052428 15445 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:22.064146 10587 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 13: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:22.037534 15503 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:22.049000 15389 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.040288 15216 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.075352 11382 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.045643 15275 raft_consensus.cc:2804] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:22.132278 14853 consensus_queue.cc:1048] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:22.132519 15487 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.050004 15403 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.049481 15517 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.043329 14954 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.049468 15375 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:22.138566 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 58939.5us
I20260709 13:17:22.070081 15453 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.142804 10560 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:22.140938 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 65693.4us
I20260709 13:17:22.132635 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.153870 10560 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.084460 14917 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:22.146186 15310 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:22.142298 15275 raft_consensus.cc:697] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:22.146400 15453 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.140537 15389 consensus_queue.cc:1059] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:22.163245 14721 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.163770 14721 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.164161 14721 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.168815 15217 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.169461 15320 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.161800 15453 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.169948 15320 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.172072 15320 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.157828 11414 raft_consensus.cc:1240] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:22.160950 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.154014 15445 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:22.191468 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 196308us
I20260709 13:17:22.192059 10708 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.193364 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.198361 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.198726 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.281885 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:22.295629 10734 raft_consensus.cc:1240] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.284157 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:22.189057 15310 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:22.324703 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 126065us
I20260709 13:17:22.199709 15320 raft_consensus.cc:3055] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.282961 15389 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:22.343734 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.346881 15085 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.194339 15445 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.335875 10635 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:22.353950 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 191527us
W20260709 13:17:22.357697 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 159984us
I20260709 13:17:22.333186 15375 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.295727 15405 consensus_queue.cc:1048] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:17:22.367199 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 173909us
I20260709 13:17:22.335179 15320 raft_consensus.cc:740] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:22.367676 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 177676us
I20260709 13:17:22.352981 15445 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.348587 14937 consensus_queue.cc:1059] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:22.368585 10560 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.383483 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.197038 15503 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:22.387674 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 51873.9us
I20260709 13:17:22.357645 15085 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.380270 10708 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.355296 15275 consensus_queue.cc:237] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.328235 15522 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.395939 10560 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.381901 15450 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.393385 15310 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.421193 15521 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.421537 15529 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:22.422048 15529 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.422541 15336 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.422919 15336 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.423179 15418 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.423285 15336 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:22.415853 15519 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:22.424710 15529 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.391567 14937 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.394923 15216 raft_consensus.cc:3055] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.416306 15522 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:22.429812 15522 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.435853 15403 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.436841 15445 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.437799 15389 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:22.438663 15389 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.439546 14954 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.441350 15389 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.441831 15389 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.442634 10734 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:22.442915 15354 consensus_meta.cc:287] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.001s
I20260709 13:17:22.443352 10664 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:22.443553 15445 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.443302 15354 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.443931 15257 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.444407 15257 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.445350 10742 raft_consensus.cc:3060] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:22.428121 15216 raft_consensus.cc:740] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:22.447016 15216 consensus_queue.cc:260] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.448181 15216 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.437974 15403 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.392185 15320 consensus_queue.cc:260] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.427330 15450 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.450651 14721 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.451931 15450 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.448802 15522 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.454255 14954 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.452059 15085 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.455588 15522 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.455861 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.460789 15526 consensus_queue.cc:1059] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.461815 15526 raft_consensus.cc:3055] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:22.462139 15526 raft_consensus.cc:740] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:22.462841 15526 consensus_queue.cc:260] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.463515 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 708) took 3240 ms. Trace:
I20260709 13:17:22.463950 15526 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.463848 10740 rpcz_store.cc:276] 0709 13:17:19.222975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.223082 (+   107us) service_pool.cc:224] Handling call
0709 13:17:21.566757 (+2343675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.566944 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.566969 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.567011 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:21.567039 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.567088 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.463341 (+896253us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54003507d0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b88ad 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:22.463441 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5389364096}
W20260709 13:17:22.465615 15520 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:17:22.412189 15290 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.413275 15487 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.467712 15460 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:22.479902 10742 raft_consensus.cc:2468] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
I20260709 13:17:22.480713 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.482061 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:22.490171 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 106771us
I20260709 13:17:22.496286 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:22.497393 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.497582 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.498286 10662 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.502743 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.505357 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:22.507325 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.468333 15460 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.509723 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.445238 15354 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.511869 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:22.511989 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.515172 10593 raft_consensus.cc:2468] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:22.512646 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:22.516196 15450 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:22.504565 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.519374 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.541579 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.543179 11382 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:22.544348 15405 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:22.550550 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.559221 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 179032us
I20260709 13:17:22.560318 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.563650 15528 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.564193 15528 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.510325 15453 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.574321 10708 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.576948 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.580996 10662 raft_consensus.cc:2468] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 18.
I20260709 13:17:22.584022 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:22.557119 15403 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.555711 15533 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.556967 14937 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:22.556401 14721 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.599599 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.599771 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.583081 15354 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.585758 15529 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.589427 15522 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.602279 15534 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.611238 15453 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.601116 15533 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:22.613781 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.614887 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.618971 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.626199 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:22.626508 15516 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.625s	user 0.002s	sys 0.007s
I20260709 13:17:22.627592 10660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2560) took 2364 ms. Trace:
I20260709 13:17:22.627961 10660 rpcz_store.cc:276] 0709 13:17:20.263013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.800657 (+537644us) service_pool.cc:224] Handling call
0709 13:17:20.801007 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.847551 (+ 46544us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:20.847594 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.848131 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.942757 (+1094626us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b18003a3ae0. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541aee07 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b 00007f4256e58d23 00007f4256e590d1 00007f4257274a0f
0709 13:17:21.992214 (+ 49457us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.992249 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.992328 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.598757 (+606429us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:22.627383 (+ 28626us) raft_consensus.cc:1685] finished
0709 13:17:22.627405 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.627536 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15367,"raft.queue_time_us":46223,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":26868,"spinlock_wait_cycles":25959936,"thread_start_us":49285,"threads_started":1,"wal-append.queue_time_us":1152491}
I20260709 13:17:22.629803 15336 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.631894 15336 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.633114 10592 raft_consensus.cc:2393] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:22.633697 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.634231 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:22.635248 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.636229 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:22.638796 15452 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.643160 15533 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.647615 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:22.648737 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:22.650456 10664 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35992 (request call id 2549) took 2533 ms (client timeout 2513 ms). Trace:
W20260709 13:17:22.650861 10664 rpcz_store.cc:269] 0709 13:17:20.116830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.278866 (+162036us) service_pool.cc:224] Handling call
0709 13:17:22.650250 (+2371384us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54002dad54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:22.650353 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4975044992}
I20260709 13:17:22.637163 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:22.654320 15517 consensus_meta.cc:287] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.004s
I20260709 13:17:22.655179 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.655740 11416 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
I20260709 13:17:22.600924 14937 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.660634 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.660948 14937 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.661221 15528 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.661754 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.615097 15534 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.615840 15531 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.664248 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.654922 15517 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.665133 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.665640 10737 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:22.656677 15529 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.672312 15534 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.733736 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.734943 10662 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.682108 15531 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.737581 10740 raft_consensus.cc:2376] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 17. Re-sending same reply.
I20260709 13:17:22.743739 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.744058 10708 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.744589 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:22.745723 10661 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:22.745853 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.746665 15156 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.747160 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:22.747316 15156 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.747997 15156 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.749053 15320 raft_consensus.cc:3060] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.751116 10708 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.754468 15545 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.754805 15217 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.754972 15545 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.755321 15217 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.756778 14937 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:22.757603 15540 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.758086 15533 consensus_queue.cc:1059] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:22.758112 15540 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.759135 15533 raft_consensus.cc:3055] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.759513 15533 raft_consensus.cc:740] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:22.760701 15540 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.760332 15533 consensus_queue.cc:260] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.762234 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:22.757259 14937 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.763067 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.766287 10738 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:22.768998 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.770352 11381 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:22.770277 10662 raft_consensus.cc:2468] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:22.770478 10708 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.757112 15545 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.772871 10708 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.773857 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.777752 10708 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:22.766086 15536 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.766590 15453 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:22.774324 15529 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.780097 15156 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.776652 15444 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:22.775033 14954 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.782347 14937 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.783418 15522 raft_consensus.cc:2804] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:22.787618 15156 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.783677 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.768338 15217 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.774430 15528 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.771828 15533 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.785917 15529 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:22.793395 15529 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.790220 15522 raft_consensus.cc:697] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:22.794538 15522 consensus_queue.cc:237] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.795046 15344 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.779410 15478 raft_consensus.cc:2804] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:22.786892 15453 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.772166 15523 consensus_queue.cc:1059] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:17:22.791636 15156 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.799715 15547 log.cc:927] Time spent T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:17:22.796164 15478 raft_consensus.cc:697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:22.800957 15478 consensus_queue.cc:237] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.785074 15460 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.808233 15453 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:22.809051 15129 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.809684 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:22.820811 10587 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:22.809154 15523 consensus_queue.cc:1243] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer e71e2e44af1e46d8a8423ae08646bc22 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:22.830976 10591 raft_consensus.cc:3055] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:22.831384 10591 raft_consensus.cc:740] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:22.832979 10591 consensus_queue.cc:260] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:22.834313 10591 raft_consensus.cc:3060] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.836158 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:22.804643 15216 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.839829 10660 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:22.850356 15515 log.cc:927] Time spent T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.838s	user 0.001s	sys 0.010s
I20260709 13:17:22.852720 15156 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.855484 15156 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.864365 15529 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.826037 15129 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:22.873227 15129 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.874388 15257 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:22.870316 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:22.876883 15529 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:22.877243 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:22.870644 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42652 (request call id 632) took 3395 ms. Trace:
W20260709 13:17:22.880556 15542 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:17:22.883904 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.016659 10735 raft_consensus.cc:2393] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 11: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
W20260709 13:17:22.888862 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.890902 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.018204 10661 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.892716 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:22.898290 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:23.020674 10741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1844) took 1088 ms. Trace:
I20260709 13:17:23.021073 10741 rpcz_store.cc:276] 0709 13:17:21.932342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.938938 (+  6596us) service_pool.cc:224] Handling call
0709 13:17:22.898166 (+959228us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:17:23.020603 (+122437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19581696}
I20260709 13:17:22.900667 10739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 721) took 1729 ms. Trace:
I20260709 13:17:23.022641 10739 rpcz_store.cc:276] 0709 13:17:21.170909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.577198 (+406289us) service_pool.cc:224] Handling call
0709 13:17:21.627505 (+ 50307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.917578 (+290073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.900474 (+982896us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54001cd254. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:22.900616 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663479680}
I20260709 13:17:22.901441 14774 raft_consensus.cc:3055] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:22.903155 10586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2399) took 1046 ms. Trace:
I20260709 13:17:22.903661 10591 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:22.903786 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.026659 10743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1834) took 1096 ms. Trace:
I20260709 13:17:23.027050 10743 rpcz_store.cc:276] 0709 13:17:21.929918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.931003 (+  1085us) service_pool.cc:224] Handling call
0709 13:17:22.903666 (+972663us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:17:23.026592 (+122926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5369088}
W20260709 13:17:22.905500 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 913869us
I20260709 13:17:22.845458 15216 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:22.913364 15156 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.917986 10589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45620 (request call id 2397) took 1061 ms. Trace:
I20260709 13:17:22.874548 15129 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.944422 10592 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:23.004010 10666 rpcz_store.cc:276] 0709 13:17:19.475697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.475866 (+   169us) service_pool.cc:224] Handling call
0709 13:17:19.562810 (+ 86944us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:19.580967 (+ 18157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.580999 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.748012 (+1167013us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b2c0006e658. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4255bb2a11 00007f4255bc2372 00007f42572f4a01 00007f42572b943a 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2
0709 13:17:20.748515 (+   503us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.123672 (+375157us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:21.143659 (+ 19987us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.160512 (+ 16853us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.160685 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.160764 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.654408 (+1493644us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800484780. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:22.864256 (+209848us) spinlock_profiling.cc:243] Waited 992 us on lock 0x7b1800484780. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f425d094de1 00007f425d0a15b1 00007f42541cc3f3 00007f42541ce7c1 00007f42541ce779 00007f42541ce709 00007f42541ce6d1 00007f42541cd9cd 000000000038f354 000000000038f199 00007f42541af83a
0709 13:17:22.870151 (+  5895us) raft_consensus.cc:1685] finished
0709 13:17:22.870175 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.870516 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38508,"prepare.queue_time_us":30528,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":24231,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":13980,"spinlock_wait_cycles":13517184,"thread_start_us":374791,"threads_started":1,"wal-append.queue_time_us":418436}
I20260709 13:17:23.050621 10592 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:23.029042 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.031502 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:23.034720 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 157535us
I20260709 13:17:23.024317 10586 rpcz_store.cc:276] 0709 13:17:21.856990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.857095 (+   105us) service_pool.cc:224] Handling call
0709 13:17:21.869789 (+ 12694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.036530 (+166741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.902954 (+866424us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540030f7d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:22.903105 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382324480}
I20260709 13:17:23.038380 10735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50154 (request call id 1835) took 1108 ms. Trace:
I20260709 13:17:23.055866 10735 rpcz_store.cc:276] 0709 13:17:21.930181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.932944 (+  2763us) service_pool.cc:224] Handling call
0709 13:17:22.883774 (+950830us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5800117f98. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f4254194a22 00007f425d0adc09 00007f425c207ee0 00007f425c2d10ab 00007f425c2d1131 00007f425c27f0a0 00007f425c27e984 00007f42557f96d4 00007f42557f9662
0709 13:17:23.038301 (+154527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33255168}
I20260709 13:17:23.038997 10589 rpcz_store.cc:276] 0709 13:17:21.856427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.856555 (+   128us) service_pool.cc:224] Handling call
0709 13:17:21.856817 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.909495 (+ 52678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.917773 (+1008278us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400169c54. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:22.917934 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119614848}
W20260709 13:17:23.040983 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.043320 11416 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:23.057888 10591 raft_consensus.cc:1240] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.066213 10669 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:23.035604 14774 raft_consensus.cc:740] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.016381 15411 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:23.082607 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.044090 15348 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:23.094223 15348 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.095149 15348 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.101089 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:23.103322 15536 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.104290 15531 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.081374 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.105630 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.092190 15336 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:23.106369 15452 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.106534 15336 consensus_queue.cc:1243] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:23.106765 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.107107 15336 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:23.107450 15336 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.107486 15452 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.107854 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.108287 15336 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.109710 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:23.110538 15517 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:23.090509 14774 consensus_queue.cc:260] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.111200 15257 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:23.111670 14774 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.113626 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.110487 10662 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:23.115474 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:23.092521 10559 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.074394 10661 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:23.052150 15156 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.067255 15387 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.127099 10708 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:23.128391 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.129946 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.134713 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.136971 10662 raft_consensus.cc:1240] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:17:23.137862 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.139415 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:23.140933 10661 raft_consensus.cc:1240] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:23.144536 10664 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:23.145083 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:23.181947 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.162726 15528 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:23.184542 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.185065 10667 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.185937 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.145890 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.189654 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:23.189823 10743 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
I20260709 13:17:23.191038 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.192317 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.193002 10743 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:23.193176 10665 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:23.148180 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.194774 10741 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:17:23.195787 10668 raft_consensus.cc:1240] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:23.118250 15336 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:23.156189 10560 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.163494 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1848) took 1203 ms. Trace:
I20260709 13:17:23.168960 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.199651 10591 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:23.126210 15452 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.172307 10737 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:23.172796 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.130609 14721 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.131947 15531 raft_consensus.cc:2804] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.132027 14917 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.215061 10559 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.150573 15525 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.201153 10668 raft_consensus.cc:1240] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:17:23.121337 15411 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.213340 10667 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 12.
I20260709 13:17:23.198635 10736 rpcz_store.cc:276] 0709 13:17:21.960226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.349980 (+389754us) service_pool.cc:224] Handling call
0709 13:17:22.350232 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.415525 (+ 65293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.415555 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.415973 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.612816 (+196843us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:22.612854 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.612914 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.880062 (+267148us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:23.143885 (+263823us) raft_consensus.cc:1685] finished
0709 13:17:23.143907 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.163405 (+ 19498us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74705,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"spinlock_wait_cycles":3696000,"thread_start_us":180171,"threads_started":2,"wal-append.queue_time_us":177364}
I20260709 13:17:23.178982 15522 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.228413 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.230150 15387 consensus_queue.cc:1059] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:23.231173 10559 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.231216 15387 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.233572 15387 raft_consensus.cc:3055] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:23.233878 15387 raft_consensus.cc:740] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.234575 15387 consensus_queue.cc:260] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.235658 15387 raft_consensus.cc:3060] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:23.238000 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:23.243364 15387 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.243985 15387 consensus_queue.cc:1059] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.246619 10590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45606 (request call id 2024) took 1593 ms. Trace:
I20260709 13:17:23.247017 10590 rpcz_store.cc:276] 0709 13:17:21.652782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.653199 (+   417us) service_pool.cc:224] Handling call
0709 13:17:21.653463 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.756013 (+102550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.246356 (+1490343us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002ca1d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:23.246553 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234723200}
I20260709 13:17:23.260689 10735 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:23.223850 15460 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.203614 15528 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.264403 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.223242 15531 raft_consensus.cc:697] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:23.221993 10666 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:23.265537 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:23.269510 11410 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:23.282320 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.283142 10706 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:23.285941 15531 consensus_queue.cc:237] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.250697 15522 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.292331 15344 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:23.298913 15344 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.299331 15344 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:23.316488 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.317512 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.318449 10592 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:23.317638 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.319469 10590 raft_consensus.cc:2393] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:23.319258 10632 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.336329 10632 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.321619 15525 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.341946 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:23.323027 15375 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.347244 15450 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.330555 15523 raft_consensus.cc:3055] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:23.356745 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:23.352702 15523 raft_consensus.cc:740] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.359581 15536 consensus_queue.cc:1059] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.359336 15523 consensus_queue.cc:260] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:23.361362 15539 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:23.362342 15522 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.363018 15411 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.363413 14954 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.367820 10588 raft_consensus.cc:2368] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:23.369278 10669 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:23.348495 15083 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:17:23.359403 15533 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.353466 15388 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:17:23.385246 15386 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:23.388540 10661 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:17:23.433701 10661 pending_rounds.cc:85] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 9
I20260709 13:17:23.433959 10661 pending_rounds.cc:107] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:17:23.434199 10661 raft_consensus.cc:2889] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.389297 10743 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.354751 15517 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.329815 15453 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:23.372094 15156 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.350232 15525 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.401768 10736 raft_consensus.cc:1275] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:17:23.466677 10736 pending_rounds.cc:85] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 10
I20260709 13:17:23.466931 10736 pending_rounds.cc:107] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:23.467175 10736 raft_consensus.cc:2889] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.418831 10739 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:23.417481 15320 consensus_meta.cc:287] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.002s
I20260709 13:17:23.478103 10734 raft_consensus.cc:1275] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:17:23.491640 10734 pending_rounds.cc:85] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 7
I20260709 13:17:23.492107 10734 pending_rounds.cc:107] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:17:23.492421 10734 raft_consensus.cc:2889] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.431941 14954 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.489290 15533 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:23.471024 15517 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:23.462778 15386 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:23.551460 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.569980 15517 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:23.574467 15534 consensus_meta.cc:287] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.000s
W20260709 13:17:23.601397 15354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.009s	sys 0.003s
W20260709 13:17:23.601835 15354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.009s	sys 0.003s
I20260709 13:17:23.604558 15354 raft_consensus.cc:3055] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:23.605042 15354 raft_consensus.cc:740] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:23.606009 15354 consensus_queue.cc:260] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.607203 15354 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:23.611320 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 378928us
W20260709 13:17:23.593783 15561 log.cc:927] Time spent T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:17:23.528534 15533 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.528448 15344 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:23.620466 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.621964 10665 raft_consensus.cc:1240] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.625980 10667 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:23.609021 15336 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.627866 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 291599us
I20260709 13:17:23.589991 15534 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.637014 10593 raft_consensus.cc:1275] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:17:23.628858 14774 consensus_meta.cc:287] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.002s
I20260709 13:17:23.617440 14917 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.617516 15129 consensus_queue.cc:1059] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:23.638960 15567 consensus_queue.cc:1059] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:17:23.653987 10740 raft_consensus.cc:1240] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:23.658286 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.658763 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.659390 10591 raft_consensus.cc:3060] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.658864 10589 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:23.659819 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.660549 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:23.657696 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.661283 10667 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:23.661489 15083 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:23.662115 15532 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.662577 15532 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.663522 15129 raft_consensus.cc:3055] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:23.663890 15129 raft_consensus.cc:740] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.664490 15532 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.665485 15567 consensus_queue.cc:1243] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer fac2164a6f874d7dbd29db83a7cf019b log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:23.665984 15567 raft_consensus.cc:3055] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:23.666275 15567 raft_consensus.cc:740] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.666955 15567 consensus_queue.cc:260] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.668076 15567 raft_consensus.cc:3060] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.664695 15129 consensus_queue.cc:260] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.669456 10591 raft_consensus.cc:2468] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:23.657974 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.671639 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.673763 10666 raft_consensus.cc:1275] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:23.674185 10585 raft_consensus.cc:2368] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:23.674986 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.675781 15211 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.670413 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.680339 10635 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:23.680881 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.681529 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.682706 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.690990 15339 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:23.691975 15531 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:23.635761 15336 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.666961 15344 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.693042 15216 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.716018 15216 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.716456 15216 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.718528 15216 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.719779 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.720896 10559 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.678488 15532 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.721662 15563 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.723321 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:23.724062 10664 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:23.701961 10736 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:23.697012 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:23.699491 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.708894 15375 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.709599 15534 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:23.710515 14954 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:23.711287 15578 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:23.779047 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 58223.3us
I20260709 13:17:23.711740 15533 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.712356 15386 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.681015 15525 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.713855 10735 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:23.715504 15336 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:23.683320 15211 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:23.725006 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:23.726017 10558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.688526 15411 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.693962 15460 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.731375 10588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45620 (request call id 2425) took 1235 ms. Trace:
I20260709 13:17:23.733505 10586 raft_consensus.cc:1275] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 13:17:23.744362 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.744980 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 48072.3us
I20260709 13:17:23.792881 10588 rpcz_store.cc:276] 0709 13:17:22.495469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.496085 (+   616us) service_pool.cc:224] Handling call
0709 13:17:23.731155 (+1235070us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54002a8854. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572bd2fa 00007f425c27eb17 00007f42557f96d4 00007f42557f9662 00007f42557f9591 00007f42557f950c 00007f42557f87c2 00007f42555f448c 00007f42555f38c6 00007f42555f326f
0709 13:17:23.731314 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002723072}
I20260709 13:17:23.746572 10736 raft_consensus.cc:1240] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:23.688874 15453 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:23.777763 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.786680 10559 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:23.791692 10590 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:23.797667 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:23.795377 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 110050us
I20260709 13:17:23.798305 10585 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:23.788344 15129 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.793889 10706 leader_election.cc:400] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12.
I20260709 13:17:23.807231 10706 leader_election.cc:400] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:23.807482 10706 leader_election.cc:403] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.800194 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.808048 10585 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:23.801870 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:23.805141 10669 raft_consensus.cc:1275] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:23.810127 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:23.814311 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.792109 15574 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:23.815080 10588 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:23.777292 15375 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:23.819721 10632 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:23.799175 15536 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.800591 15453 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.834638 15453 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:23.744303 14917 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.824702 15375 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:23.813596 15344 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 16. Current term is 17.
I20260709 13:17:23.832172 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.834013 15433 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:23.830395 10734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50154 (request call id 1865) took 1257 ms. Trace:
I20260709 13:17:23.850791 15574 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.816043 15460 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.850885 15100 consensus_queue.cc:1048] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:23.820080 15503 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:23.819523 15211 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:23.841423 15573 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.857573 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:23.875764 10741 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 17.
I20260709 13:17:23.852806 10734 rpcz_store.cc:276] 0709 13:17:22.572940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.733888 (+160948us) service_pool.cc:224] Handling call
0709 13:17:22.734134 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.492953 (+758819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.830111 (+337158us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540014d054. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:23.830323 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699044736}
I20260709 13:17:23.852807 10588 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:23.877218 11382 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:23.819928 15526 consensus_queue.cc:1059] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:23.854326 15460 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:23.898252 15460 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.875245 15211 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.899720 15211 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.885649 15586 consensus_queue.cc:1048] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:23.886750 15477 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:23.907058 15477 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:23.907446 15477 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:23.889680 15574 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.822490 15478 consensus_queue.cc:1059] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:23.843181 15539 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:23.892657 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:23.912287 15489 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:23.912770 15489 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:23.893679 15035 consensus_queue.cc:1059] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:23.914897 15586 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:23.915293 15586 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.915597 15586 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:23.917155 15523 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.881747 15573 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.922857 15573 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:23.940214 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 258721us
I20260709 13:17:23.941075 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:23.944697 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:23.948858 10635 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:23.963307 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 43835.9us
I20260709 13:17:23.965456 10592 raft_consensus.cc:1240] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:23.966389 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.966859 15387 raft_consensus.cc:3055] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:23.967235 15387 raft_consensus.cc:740] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:23.967453 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:23.967937 15387 consensus_queue.cc:260] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:23.968839 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.969040 15387 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.972610 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.988504 10594 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:23.969599 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:23.946197 15375 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.947796 15450 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.993957 15450 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.994314 15450 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.996331 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:23.956151 15578 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:23.969461 15452 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.987004 15503 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:24.015457 15477 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.016211 15528 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.017611 10740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50140 (request call id 2484) took 1190 ms. Trace:
I20260709 13:17:24.018000 10740 rpcz_store.cc:276] 0709 13:17:22.826683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.862986 (+ 36303us) service_pool.cc:224] Handling call
0709 13:17:22.863270 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.654367 (+791097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.017371 (+363004us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54003309d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b9e01 00007f42572b883e 00007f425c27d419 00007f42557f4bd4 00007f42557f4b62 00007f42557f4a91 00007f42557f4a0c 00007f42557f3cc2 00007f42555f448c 00007f42555f38c6
0709 13:17:24.017549 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818073472}
I20260709 13:17:24.005187 15517 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:24.020053 15517 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.020412 15517 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.022442 15453 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.002023 15375 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.024675 15375 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.024961 15453 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.029031 15257 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:24.033226 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:23.971560 15211 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.041576 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.006567 15578 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:24.042331 11414 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:24.029134 15450 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.029506 15257 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:24.039785 15528 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:24.045953 15578 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.043828 15525 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.009503 15489 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.057366 15586 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.074753 15586 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.076128 15578 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.104314 10590 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:24.232874 15578 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:24.108071 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 105980us
W20260709 13:17:24.109773 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 294080us
W20260709 13:17:24.110781 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 296440us
I20260709 13:17:24.113379 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.116235 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:24.124081 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:24.132467 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.136198 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:24.155658 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 333211us
I20260709 13:17:24.155820 15211 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.157019 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:24.238261 10476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 114361us
I20260709 13:17:24.157864 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.158171 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.159101 15257 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.161058 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.162741 15450 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.059887 15477 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.241091 15452 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.241529 10589 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:24.241976 15452 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.241572 11410 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:24.245667 15594 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.158056 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.164849 15489 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.246563 15594 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.165692 15503 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.251118 15386 consensus_queue.cc:1048] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:24.251780 15339 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:24.167390 15344 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.061750 15528 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.174151 15536 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.193905 14721 raft_consensus.cc:3055] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:24.189180 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.195559 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:24.157056 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:24.253103 11409 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:24.245697 11416 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.258925 10594 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.259558 15477 consensus_queue.cc:1048] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:24.240839  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:24.262091 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.262346 15354 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.062600 15525 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.263197 15354 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.265636 15344 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.266875 15411 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.266995 10490 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:24.267649 15411 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.268358 15344 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.269958 15536 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.272425 15536 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.269088 15344 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:17:24.284315 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 44372.7us
I20260709 13:17:24.284678 15336 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:24.262378 15553 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:17:24.286767 15336 consensus_queue.cc:1059] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:24.287247 15445 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:24.256172 14721 raft_consensus.cc:740] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:24.307305 14721 consensus_queue.cc:260] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.308287 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.309396 10590 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:24.076329 15573 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.317924 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:24.318315 15525 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.289780 15354 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.321544 15532 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.321797 14721 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.324163 15450 consensus_queue.cc:1048] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.325527 10588 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:24.326342 15411 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:24.326638 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.273517 10490 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:24.331378 10587 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:24.333375 15528 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.333961 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.334442 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.334899 10736 raft_consensus.cc:2393] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 12: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:24.335480 10742 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:24.336357 15517 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.329771 11416 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 18.
I20260709 13:17:24.336596 10490 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 11, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:17:24.349195 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 97953.1us
I20260709 13:17:24.351603 10559 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:24.353583 10589 raft_consensus.cc:2468] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 17.
I20260709 13:17:24.355376 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:24.357079 10739 raft_consensus.cc:2368] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 17. Current term is 18.
I20260709 13:17:24.364544 10594 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:24.373468 15602 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.374194 15602 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.382184 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.383316 10735 raft_consensus.cc:2410] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:24.383486 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.384037 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.390177 15257 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:24.394601 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 52400.5us
I20260709 13:17:24.395697 15594 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.285231 15563 consensus_queue.cc:1059] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:17:24.396384 15216 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:24.397212 15563 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:24.397734 15563 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.397207 15216 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.398247 15564 raft_consensus.cc:3055] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:24.398712 15564 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:24.399950 15216 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.399784 15564 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.401661 15517 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.401729 15035 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:24.402383 10585 raft_consensus.cc:2393] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:24.402630 15035 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.403219 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.404439 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.404999 10585 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:24.384183 10590 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:24.406471 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.407128 10589 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:24.408490 10708 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:24.398142 10669 raft_consensus.cc:1240] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:24.413373 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.414106 10741 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:24.414682 15573 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.415974 15517 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:24.416349 15517 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:24.416707 15517 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.416885 15567 raft_consensus.cc:3055] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.417287 15567 raft_consensus.cc:740] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:24.417639 15564 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:24.418501 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 51396.6us
W20260709 13:17:24.429888 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 48406.7us
I20260709 13:17:24.436982 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.439277 15411 consensus_queue.cc:1048] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:24.440181 10586 raft_consensus.cc:2393] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 8: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:24.442257 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.446254 15587 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.446950 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.446810 15587 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.398164 15563 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.455013 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.458626 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.418493 15035 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.464125 15587 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.464938 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:24.465715 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 86133us
I20260709 13:17:24.448828 15450 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.466637 15450 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.471678 10490 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 11 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.472868 10669 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:24.422570 15602 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.473503 10490 catalog_manager.cc:5697] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:17:24.482009 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.481660 10490 catalog_manager.cc:5697] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.483299 10490 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 6 to 9, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
W20260709 13:17:24.486104 10557 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.487752 15450 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.418347 15567 consensus_queue.cc:260] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.490176 15567 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.478377 15216 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:24.495500 10660 raft_consensus.cc:1275] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:24.500555 10661 raft_consensus.cc:1275] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:24.500799 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:24.501555 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 101082us
I20260709 13:17:24.501686 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.500732 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.502573 10663 raft_consensus.cc:2393] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:24.503362 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.504825 10663 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.502084 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.484774 10490 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.501693 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:24.501585 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.513201 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:24.527448 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 163014us
I20260709 13:17:24.526927 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:24.531221 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.531876 10660 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 18: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:24.510656 15517 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:24.537055 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 63152.1us
I20260709 13:17:24.536404 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.540439 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.541497 10664 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:17:24.542790 15460 consensus_meta.cc:287] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Time spent flushing consensus metadata: real 0.635s	user 0.017s	sys 0.000s
I20260709 13:17:24.543272 15460 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.545792 15573 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:24.546212 15573 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.546546 15573 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.549006 10668 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:24.550927 10667 raft_consensus.cc:2368] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
I20260709 13:17:24.551033 15563 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.538262 10632 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:24.553097 10632 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:24.554538 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.554915 15576 raft_consensus.cc:2804] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:24.555101 10741 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.555548 15576 raft_consensus.cc:697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:24.557533 15602 raft_consensus.cc:2804] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:24.558024 15602 raft_consensus.cc:697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:24.558982 15602 consensus_queue.cc:237] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.563064 15452 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.556694 15576 consensus_queue.cc:237] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.566046 10490 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 12, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 12 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.568167 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 12, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 12 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:24.585209 10741 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:24.586803 10735 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.586898 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.587944 10594 raft_consensus.cc:2393] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 in current term 17: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:24.591327 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.592430 15411 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.592545 15517 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.593021 15411 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.595167 15411 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.596024 10560 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:24.597394 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.599261 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.599954 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:24.600473 11417 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.579362 15563 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.609598 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.610988 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.611613 10589 raft_consensus.cc:3060] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.613157 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:24.616303 10661 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:24.615298 15517 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:24.614305 10663 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:24.617806 15517 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.599289 10587 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:24.575500 15460 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:24.628058 15539 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:24.628962 15539 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:24.630182 15539 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.639425 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:24.641779 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56980.9us
W20260709 13:17:24.656762 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 44112.7us
I20260709 13:17:24.663272 11417 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 18.
I20260709 13:17:24.662774 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:24.645433 15517 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.667531 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:24.667529 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:24.665735 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.647078 15411 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:24.670279 10589 raft_consensus.cc:2468] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 18.
I20260709 13:17:24.671283 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.672308 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:24.678543 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.680675 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:24.683504 15529 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:24.684151 15529 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.679337 15344 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.686280 15529 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.686513 15344 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.686918 15344 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.673485 15567 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:24.680160 10592 raft_consensus.cc:1240] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.690891 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.673422 15411 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.682688 10708 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:24.676327 15517 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.685065 15579 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:17:24.693553 15411 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.709823 15503 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:24.713861 10741 raft_consensus.cc:2393] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 18: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:24.714547 15444 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:24.715587 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.718564 10660 raft_consensus.cc:1240] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:24.722278 15579 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.723114 10586 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:24.722921 15579 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.701362 10632 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:24.697618 15517 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:24.753763 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
W20260709 13:17:24.758203 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56955.3us
I20260709 13:17:24.762792 10736 raft_consensus.cc:3060] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.754249 15517 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.781211 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:24.788829 15619 raft_consensus.cc:3060] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:24.790463 15433 consensus_queue.cc:1059] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:24.791626 15388 raft_consensus.cc:3055] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.792174 15388 raft_consensus.cc:740] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:24.793358 15388 consensus_queue.cc:260] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.794797 15388 raft_consensus.cc:3060] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.795578 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.749828 15579 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.805639 10490 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 6 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:24.808280 15624 log.cc:927] Time spent T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:24.808537 11443 heartbeater.cc:646] Failed to heartbeat to 127.9.68.126:35023 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.68.126:35023 timed out after 15.000s (SENT)
I20260709 13:17:24.811446 15619 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:24.811218 10490 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 5, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 5 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:24.793875 15620 log.cc:927] Time spent T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:24.783860 11382 leader_election.cc:400] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 17. Current term is 18.
I20260709 13:17:24.832860 11382 leader_election.cc:403] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:17:24.828402 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 136551us
W20260709 13:17:24.831656 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 155426us
I20260709 13:17:24.763772 15578 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.761124 15528 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.846006 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:24.853737 10490 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:24.875614 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.846560 15578 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.891534 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:24.877270 15211 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.906002 15211 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.908033 15211 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:24.910650 10489 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 198) took 26026 ms (client timeout 15000 ms). Trace:
W20260709 13:17:24.910840 15615 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.365s	user 0.003s	sys 0.000s
I20260709 13:17:24.911450 15586 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.912038 15586 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.912398 15586 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.919281 15603 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:24.920034 15603 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:24.921875 10739 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:24.922902 15603 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:24.927888 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:24.927999 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.928728 10734 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:24.890326 15578 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.930691 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.931651 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.932713 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.933455 15611 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e71e2e44af1e46d8a8423ae08646bc22 for earlier term 17. Current term is 18.
I20260709 13:17:24.933665 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:24.934360 10737 raft_consensus.cc:2393] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 14: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:24.935086 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.935585 10737 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:24.937098 11417 raft_consensus.cc:2468] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:24.890889 15529 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:24.938690 15529 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:24.941529 15629 log.cc:927] Time spent T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:24.847323 15573 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.874969 10490 catalog_manager.cc:5697] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:24.948474 10490 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:24.958062 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.958622 10588 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:24.960130 10593 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:24.964011 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:24.964743 11417 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:24.941068 15529 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:24.959374 15525 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.950124 10490 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 11, leader changed from <none> to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:24.972124 11381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.976648 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.977783 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:24.947707 15573 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.006398 10490 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 10, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 10 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.978996 15344 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.979898 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:24.986307 15411 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:24.986912 10741 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:24.988009 15628 log.cc:927] Time spent T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:17:24.992738 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 131474us
W20260709 13:17:24.911118 10489 rpcz_store.cc:269] 0709 13:16:58.883889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.884262 (+   373us) service_pool.cc:224] Handling call
0709 13:16:59.402679 (+518417us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b540006ff90. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254194b71 00007f42541950b2 00007f425d10ea89 00007f425d0a6da6 00007f425d078088 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc
0709 13:17:24.910385 (+25507706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:17.730278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:17.848501 (+118223us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:17.848573 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:17:17.848593 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:17.850200 (+  1607us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:17.850303 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:17.850331 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:17:17.851753 (+  1422us) tablet.cc:701] Row locks acquired
0709 13:17:17.851810 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:17:17.852003 (+   193us) write_op.cc:270] Start()
0709 13:17:17.852173 (+   170us) write_op.cc:276] Timestamp: P: 1783603037851929 usec, L: 0
0709 13:17:17.852214 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:17:18.084357 (+232143us) log.cc:844] Serialized 6664 byte log entry
0709 13:17:19.251831 (+1167474us) op_driver.cc:464] REPLICATION: finished
0709 13:17:19.769591 (+517760us) write_op.cc:301] APPLY: starting
0709 13:17:19.785409 (+ 15818us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:20.306533 (+521124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:20.306646 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:20.749900 (+443254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:20.756527 (+  6627us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:17:20.756601 (+    74us) write_op.cc:312] APPLY: finished
0709 13:17:20.757074 (+   473us) log.cc:844] Serialized 156 byte log entry
0709 13:17:21.176774 (+419700us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:21.179450 (+  2676us) write_op.cc:454] Released schema lock
0709 13:17:21.220181 (+ 40731us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:21.290500 (+ 70319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:21.293514 (+  3014us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3443,"reported_tablets":52,"spinlock_wait_cycles":18707328,"child_traces":[["op",{"apply.queue_time_us":455023,"apply.run_cpu_time_us":36200,"apply.run_wall_time_us":1535537,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":557377,"prepare.run_cpu_time_us":15775,"prepare.run_wall_time_us":634510,"raft.queue_time_us":415957,"raft.run_cpu_time_us":28926,"raft.run_wall_time_us":340857,"replication_time_us":1399453,"thread_start_us":1522697,"threads_started":5,"wal-append.queue_time_us":1146286,"wal-append.run_cpu_time_us":30112,"wal-append.run_wall_time_us":2378541}]]}
I20260709 13:17:24.996209 15444 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.997764 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.999976 15578 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.001225 10665 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:25.035871 10708 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:25.002610 10586 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
W20260709 13:17:25.005952 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 252380us
I20260709 13:17:25.015985 10734 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:25.026566 10741 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:25.023572 10735 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:17:25.036906 10743 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:25.040335 10706 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:25.051000 10738 raft_consensus.cc:2368] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:17:25.053808 10706 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:25.091166 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 257263us
I20260709 13:17:25.101934 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.097471 10741 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.053802 15525 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:25.094264 15528 raft_consensus.cc:2804] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:25.040307 15563 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:25.112795 10741 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.121138 15292 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:25.114346 15525 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.123386 15517 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.124818 15586 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.125627 15517 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:25.127080 15586 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.128808 10741 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:17:25.129335 10741 pending_rounds.cc:85] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 7
I20260709 13:17:25.129714 10741 pending_rounds.cc:107] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:17:25.130072 10741 raft_consensus.cc:2889] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.137385 15586 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:25.137490 15579 raft_consensus.cc:2804] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.138342 15579 raft_consensus.cc:697] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:25.039577 15444 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.139492 15579 consensus_queue.cc:237] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:25.140476 15444 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.112753 15602 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.099990 15354 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.142498 10739 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:25.143775 15586 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.146409 15586 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:25.148401 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 112602us
I20260709 13:17:25.150482 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:25.151433 15517 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.149627 15579 consensus_queue.cc:1048] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:25.152482 10708 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:25.153286 15517 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.187808 15344 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:25.169773 15528 raft_consensus.cc:697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:25.181429 15444 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.212813 10736 raft_consensus.cc:2468] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:25.215215 10708 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:25.216424 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 118786us
I20260709 13:17:25.196462 15579 consensus_queue.cc:1048] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:17:25.260285 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 169701us
W20260709 13:17:25.258798 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 384877us
I20260709 13:17:25.269847 10635 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.259619 15529 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.273345 15573 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.273600 15578 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.276273 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:25.279091 10660 raft_consensus.cc:2393] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 14: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:25.276263 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.281692 10662 raft_consensus.cc:2368] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
W20260709 13:17:25.282964 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 187192us
I20260709 13:17:25.293865 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:25.295346 10707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.248653 15444 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.294497 10667 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:25.299701 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.297402 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:25.308324 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 254577us
I20260709 13:17:25.321002 10668 raft_consensus.cc:2410] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:25.322549 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:25.325732 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 115520us
I20260709 13:17:25.297238 15528 consensus_queue.cc:237] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:25.353683 15635 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:25.354228 15635 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:25.355089 15635 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.356662 15444 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:25.358039 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62167.2us
I20260709 13:17:25.359380 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:25.360107 10594 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:17:25.364864 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:25.366114 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.366637 10588 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.368386 10708 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:25.373728 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 281988us
I20260709 13:17:25.375626 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:25.375036 15602 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:25.395865 15411 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:25.409257 15602 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:25.436403 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 113925us
I20260709 13:17:25.436791 10588 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:25.439813 15579 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.440294 15579 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.440639 15579 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.445669 15643 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:25.445820 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 77514.9us
I20260709 13:17:25.446622 10708 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:25.446764 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.447319 15354 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.447896 10667 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:25.473443 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:25.448364 10708 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:25.485406 15445 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.485956 15445 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.488055 15445 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.492468 15525 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:25.480774 15649 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.493710 15649 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:25.494071 15649 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.505856 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.506539 10588 raft_consensus.cc:2368] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 15. Current term is 16.
I20260709 13:17:25.511283 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.508826 10635 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.513583 10742 raft_consensus.cc:2410] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:25.515301 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:25.519461 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.520215 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.521003 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.521814 10738 raft_consensus.cc:2410] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:25.523701 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.524467 10660 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:25.524931 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:25.526435 15602 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:25.528439 15450 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.539000 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.539662 10589 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.540457 15444 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.541586 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:25.533524 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.542371 10585 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.542282 10592 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:25.518993 15517 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:25.541180 15444 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:25.550222 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:25.550779 10591 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.551975 15444 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:25.552520 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.553623 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:25.554690 10632 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:25.557969 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:25.558353 15573 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:25.558504 11417 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:25.559150 15573 raft_consensus.cc:2804] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:25.559711 15573 raft_consensus.cc:697] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:25.563772 14774 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:25.567451 10742 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:25.568811 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:25.569574 15445 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.560956 15573 consensus_queue.cc:237] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.571480 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.572196 10589 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:25.572247 10736 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:25.574468 15578 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:25.575155 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 55734.8us
I20260709 13:17:25.618347 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.575639 15602 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.575871 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.633496 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:25.580591 10591 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
W20260709 13:17:25.585753 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 137598us
I20260709 13:17:25.587869 10632 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:25.588889 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:25.638075 11417 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 18.
I20260709 13:17:25.552565 15444 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:25.641397 10708 leader_election.cc:400] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
I20260709 13:17:25.641819 10708 leader_election.cc:403] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:25.642144 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 54377.6us
I20260709 13:17:25.633109 10742 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 18.
I20260709 13:17:25.643621 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.644698 10739 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:17:25.599278 10590 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:25.599759 10560 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:25.605283 10585 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
W20260709 13:17:25.612322 10633 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.661332 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:25.677184 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:25.677724 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:25.678542 10735 raft_consensus.cc:3060] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.680540 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.683666 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:25.686668 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:25.687175 10739 raft_consensus.cc:3060] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.681299 10668 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 18.
W20260709 13:17:25.689280 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 89592.5us
I20260709 13:17:25.689694 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:25.617741 15578 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:25.641450 15292 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.694550 10736 raft_consensus.cc:2393] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 9: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:25.649657 15450 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.675309 15257 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:25.711508 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 60371.4us
I20260709 13:17:25.681504 15576 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.676507 15577 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:25.722004 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 79152.6us
I20260709 13:17:25.686441 15411 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.704006 15578 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.702147 15503 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.712783 15525 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14.
W20260709 13:17:25.737054 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 98634us
I20260709 13:17:25.742272 10708 leader_election.cc:400] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
I20260709 13:17:25.743005 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:25.718382 15563 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.708582 15450 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:25.715665 15257 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:25.726461 15577 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.733340 15517 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.712306 15445 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:25.757210 15411 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.759464 15257 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.715875 15292 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.757407 15450 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.761917 15577 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.787302 15344 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.737643 15586 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:25.802263 10739 raft_consensus.cc:2468] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:25.763646 15563 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.814201 15517 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.824515 10735 raft_consensus.cc:2468] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:25.758442 15649 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:25.831550 15344 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:25.869262 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 164107us
I20260709 13:17:25.880998 10741 raft_consensus.cc:3060] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.877347 15586 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:25.873577 15344 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:25.885861 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 142242us
W20260709 13:17:25.879953 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 178302us
I20260709 13:17:25.899344 10635 leader_election.cc:400] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:17:25.903815 10560 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:25.934067 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.934546 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.939821 15578 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:25.941481 10666 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:25.919205 15445 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.943064 15445 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.943395 15445 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:25.944913 15657 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:25.945466 15578 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:25.950405 15292 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:25.964529 10741 raft_consensus.cc:2468] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
I20260709 13:17:25.968811 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.969491 10708 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:25.882376 15579 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:25.973260 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:25.973579 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:25.974014 10666 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 15: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:25.973133 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:25.996423 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 275093us
I20260709 13:17:26.002255 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:26.003968 10706 leader_election.cc:400] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 15. Current term is 16.
I20260709 13:17:26.004487 10706 leader_election.cc:403] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.047017 10735 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 14.
I20260709 13:17:25.960877 15450 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:26.050285 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 52952.6us
I20260709 13:17:26.051568 10706 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:26.053283 10706 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:26.060804 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:26.091605 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.092444 10663 raft_consensus.cc:2368] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
I20260709 13:17:25.983088 15586 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.059820 15528 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 15. Current term is 16.
I20260709 13:17:26.061787 15649 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.078498 15671 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.066931 15675 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:26.111681 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 350433us
I20260709 13:17:26.117194 10632 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:26.120218 10632 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:26.121286 10665 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:26.135504 10708 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:26.112071 15517 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:26.140689 15662 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:26.145167 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:26.183923 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 44587.6us
I20260709 13:17:26.141116 15672 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.136392 15665 raft_consensus.cc:2804] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:26.176251 15671 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:26.176659 15678 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:26.177558 10708 leader_election.cc:400] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
I20260709 13:17:26.193367 10708 leader_election.cc:403] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.199462 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.200054 10669 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 9.
I20260709 13:17:26.177843 10590 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.115321 14774 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:26.146060 15563 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.134205 15643 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:26.227785 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 165326us
I20260709 13:17:26.121699 15585 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:17:26.191493 15639 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:26.134523 15578 raft_consensus.cc:2804] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:26.228953 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.235157 10660 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 13.
I20260709 13:17:26.234998 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:26.272862 11414 raft_consensus.cc:1275] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:26.276909 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.277531 10589 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:26.279064 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.279875 10588 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:26.216003 15649 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499) with higher term. Message: Invalid argument: T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
W20260709 13:17:26.289572 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 54703.6us
I20260709 13:17:26.216609 15665 raft_consensus.cc:697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:26.284991 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:26.297637 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:26.225343 15517 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:26.297789 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:26.298167 15257 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.300940 10590 raft_consensus.cc:2368] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
I20260709 13:17:26.300940 10735 raft_consensus.cc:2368] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:17:26.302438 11417 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:26.302695 10666 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.302482 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:26.305430 10586 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:26.305547 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:26.275703 15643 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:26.311129 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:26.311580 11414 raft_consensus.cc:1275] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:26.311924 11409 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.289866 15579 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:26.263625 14774 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.269559 15445 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:26.279753 15585 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:26.314224 15649 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:26.345252 15686 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:26.345116 15344 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.347163 15344 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.330627 15671 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.350946 11409 raft_consensus.cc:2468] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:26.316030 15672 consensus_queue.cc:1048] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
W20260709 13:17:26.422595 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 196527us
I20260709 13:17:26.329391 15578 raft_consensus.cc:697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:26.478647 15257 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.478801 15578 consensus_queue.cc:237] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:26.475226 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 211298us
W20260709 13:17:26.355654 15685 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:17:26.337924 15678 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.339645 15649 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.477208 10706 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:26.398532 15579 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:17:26.477710 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
W20260709 13:17:26.441645 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 115771us
I20260709 13:17:26.503464 10585 raft_consensus.cc:2393] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 9: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:26.325225 15680 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:26.482451 15659 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:17:26.512156 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 184377us
W20260709 13:17:26.496475 15658 log.cc:927] Time spent T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:26.491930 15678 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.351444 14774 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.474363 15344 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:26.497150 15649 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.517498 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:26.502288 15525 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:26.546865 15682 log.cc:927] Time spent T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
W20260709 13:17:26.549263 15692 log.cc:927] Time spent T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:26.518028 15678 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:26.545158 15577 consensus_meta.cc:287] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
I20260709 13:17:26.437177 15665 consensus_queue.cc:237] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.550477 15525 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:26.490214 15643 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.524112 15344 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.579489 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.570030 15354 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.606914 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 131679us
I20260709 13:17:26.618140 15699 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:26.619874 15700 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:26.620266 15700 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:26.621025 15700 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.566629 15577 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.633471 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.645638 10632 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:26.657953 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:26.659552 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.642899 15344 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.622478 15700 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.639411 15690 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:26.643577 15411 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.676024 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:26.602388 15354 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.677377 10585 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:26.667310 15445 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:26.633716 15525 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:26.709508 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 111462us
I20260709 13:17:26.684729 15705 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:26.733294 10589 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:26.683851 15690 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:26.736778 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 123118us
I20260709 13:17:26.742543 10635 leader_election.cc:400] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13.
I20260709 13:17:26.749666 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.751489 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.753211 15695 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.755405 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.759356 10736 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.760468 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.761543 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.719375 15705 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.717660 15704 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:26.764771 11415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40"
dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:17:26.768066 11415 raft_consensus.cc:606] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:26.768383 11415 raft_consensus.cc:614] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:26.746161 15664 raft_consensus.cc:2804] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.762276 10664 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:26.772521 10666 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:26.753784 15695 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.775784 15577 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.782517 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:26.783306 11415 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.781749 15664 raft_consensus.cc:697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:26.786226 15678 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.786306 15664 consensus_queue.cc:237] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:26.788470 15678 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.789628 10742 raft_consensus.cc:2368] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:26.792900 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:26.794584 15705 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.795858 10668 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:26.808143 10559 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:26.806990 15336 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.811674 15567 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:26.830621 10706 leader_election.cc:400] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Vote denied by peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) with higher term. Message: Invalid argument: T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b for earlier term 14. Current term is 15.
I20260709 13:17:26.832811 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.834988 10662 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.833904 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.837777 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:26.838379 10594 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.840106 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.840361 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.840960 10669 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:26.840816 10591 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 8.
I20260709 13:17:26.806540 15649 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.843657 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:26.821925 15336 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.821990 15586 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:26.829963 15354 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.844388 15577 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:26.858096 15586 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:26.858619 15577 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:26.818728 15292 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:26.873486 10669 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 19.
I20260709 13:17:26.874609 10662 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:26.834626 15567 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.867887 10594 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:26.861245 15336 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.849287 15678 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:26.877430 10559 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:26.855508 15695 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.878453 15567 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.865446 15691 consensus_queue.cc:1048] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:17:26.891484 15679 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:26.889771 15586 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:26.911139 10708 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:26.886040 15678 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.897820 15690 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:26.920449 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.921751 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.926175 15649 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.928027 15577 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:26.929440 15679 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:26.930653 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.931277 10665 raft_consensus.cc:3060] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.930383 15679 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:26.932475 15678 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:26.932566 15710 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:26.936261 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:26.938712 11415 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 19.
I20260709 13:17:26.953424 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:26.954877 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:26.958076 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:26.958693 10594 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:27.000046 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.002795 10592 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:27.010793 10665 raft_consensus.cc:2468] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:26.958886 15528 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:27.023752 15528 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:27.024721 15528 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.034938 10635 leader_election.cc:400] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:27.035317 10635 leader_election.cc:403] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.047475 15585 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.051860 15701 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 9. Current term is 10.
I20260709 13:17:27.055919 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:27.051388 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 157741us
I20260709 13:17:27.063380 15726 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:27.064216 15726 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:27.065163 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:27.066623 15726 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:27.068791 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.069900 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.063515 10557 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:27.071477 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:27.073282 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.074729 10706 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:27.076249 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:27.076812 10592 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.048242 15450 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.078519 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.080106 15292 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:27.086956 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.087507 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:27.088153 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:27.091044 10592 raft_consensus.cc:2468] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:27.098605 10559 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:27.103333 10663 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:17:27.106933 10663 pending_rounds.cc:85] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 7
I20260709 13:17:27.107177 10663 pending_rounds.cc:107] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:27.107404 10663 raft_consensus.cc:2889] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.111220 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251650397d264ac1a42a2fde5932424f"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:27.111732 10589 raft_consensus.cc:606] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.112044 10589 raft_consensus.cc:614] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.070564 15710 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.118507 15643 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.117748 15691 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.120468 15354 raft_consensus.cc:2804] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:27.129676 15525 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.136600 15643 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.150358 15354 raft_consensus.cc:697] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:27.153116 15292 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:27.156167 15671 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.126750 15710 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.166795 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:27.167392 10740 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.168291 11382 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.171201 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.172557 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.173416 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:27.174080 10735 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:27.174813 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.162297 15643 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.161285 14774 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:27.184623 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 86112.7us
I20260709 13:17:27.193460 15698 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.140286 15691 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.149207 15525 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.195645 15292 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:27.167718 15684 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:27.222087 10735 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 19.
I20260709 13:17:27.177156 15712 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.169366 15671 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.235860 10589 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:27.238307 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.244606 15567 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.245630 15354 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.250177 10666 raft_consensus.cc:1240] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Rejecting Update request from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.262712 10740 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 11.
I20260709 13:17:27.268093 14774 consensus_queue.cc:1059] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:27.269997 15688 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:27.270696 15688 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:27.272643 15738 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:27.291517 15445 raft_consensus.cc:3055] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:27.319401 15445 raft_consensus.cc:740] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:27.273222 15688 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.282820 15525 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.320343 15445 consensus_queue.cc:260] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.274945 15691 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:27.299490 15734 log.cc:927] Time spent T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:17:27.262257 15741 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:27.322105 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:27.318845 15336 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.324520 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.328333 15445 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:27.289232 15736 log.cc:927] Time spent T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:17:27.331138 15710 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.331943 15726 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.306216 10632 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.322118 15741 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.335649 10632 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:27.336503 15680 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.336794 15671 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.338212 15680 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.338650 15680 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.339051 15680 raft_consensus.cc:3060] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.344097 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.345096 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.345218 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:27.313143 15735 log.cc:927] Time spent T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.181s	user 0.000s	sys 0.002s
I20260709 13:17:27.346640 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.347579 10664 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
I20260709 13:17:27.348484 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.349561 10706 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.350616 10706 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.351197 15671 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.362648 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.365511 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.277725 15567 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.368603 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:27.369251 10591 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:27.370697 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:27.371789 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 67944.5us
I20260709 13:17:27.324981 15336 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.384063 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:27.393941 10663 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.386071 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:27.394747 10661 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.400040 10594 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:27.417011 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.401103 15525 raft_consensus.cc:2804] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:27.403184 15730 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.425139 15705 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:17:27.419286 15741 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.422667 15579 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:27.444195 10490 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54942 (request call id 221) took 16838 ms (client timeout 15000 ms). Trace:
I20260709 13:17:27.417150 15578 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:27.432912 15699 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:27.446430 15354 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.451114 15354 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.451702 10488 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.453372 15354 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:27.444600 10490 rpcz_store.cc:269] 0709 13:17:10.605331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.606277 (+   946us) service_pool.cc:224] Handling call
0709 13:17:27.444130 (+16837853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:25.417365 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:25.426217 (+  8852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:25.426268 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:17:25.426286 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:25.507631 (+ 81345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:25.507740 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:25.507766 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:17:25.559259 (+ 51493us) tablet.cc:701] Row locks acquired
0709 13:17:25.559317 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:17:25.559480 (+   163us) write_op.cc:270] Start()
0709 13:17:25.559641 (+   161us) write_op.cc:276] Timestamp: P: 1783603045559418 usec, L: 0
0709 13:17:25.559700 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:17:25.560911 (+  1211us) log.cc:844] Serialized 6740 byte log entry
0709 13:17:25.937229 (+376318us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f42541af0ac 00007f425d009ab9 00007f42541cb69b 00007f42541c993f 00007f42541cbc02 00007f4256e5320b
0709 13:17:26.796894 (+859665us) op_driver.cc:464] REPLICATION: finished
0709 13:17:26.921344 (+124450us) write_op.cc:301] APPLY: starting
0709 13:17:26.927851 (+  6507us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:27.053970 (+126119us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:27.054015 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:27.090317 (+ 36302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:27.090663 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:17:27.090727 (+    64us) write_op.cc:312] APPLY: finished
0709 13:17:27.091181 (+   454us) log.cc:844] Serialized 156 byte log entry
0709 13:17:27.094549 (+  3368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.094767 (+   218us) write_op.cc:454] Released schema lock
0709 13:17:27.094857 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:27.104545 (+  9688us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.112589 (+  8044us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":500083,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":90502,"apply.run_cpu_time_us":21544,"apply.run_wall_time_us":203241,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75289,"num_ops":17,"prepare.queue_time_us":180533,"prepare.run_cpu_time_us":34472,"prepare.run_wall_time_us":802041,"raft.queue_time_us":203977,"raft.run_cpu_time_us":16136,"raft.run_wall_time_us":72287,"replication_time_us":1214532,"spinlock_wait_cycles":28961536,"thread_start_us":886248,"threads_started":4,"wal-append.queue_time_us":728639}]]}
I20260709 13:17:27.453308 10488 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.436936 15525 raft_consensus.cc:697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:27.450618 15683 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.436826 15730 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.485927 10488 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 2 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.448905 15579 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.489585 10666 raft_consensus.cc:3055] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.489886 10666 raft_consensus.cc:740] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:17:27.490082 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 322592us
I20260709 13:17:27.490388 10666 consensus_queue.cc:260] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:27.503996 10666 raft_consensus.cc:3060] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.477762 15684 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.511639 10488 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 4 to 14, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 14 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.515990 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.517701 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.517889 10667 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:27.514635 10560 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.521087 10666 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:17:27.521685 10666 pending_rounds.cc:85] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 10
I20260709 13:17:27.521934 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:27.522478 10736 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.522430 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.521975 10666 pending_rounds.cc:107] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:27.522451 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:27.524348 10666 raft_consensus.cc:2889] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.527381 10488 catalog_manager.cc:5697] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.504469 15688 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:27.535987 15745 log.cc:927] Time spent T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:17:27.547379 10488 catalog_manager.cc:5697] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:27.552763 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 132125us
I20260709 13:17:27.553432 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.554509 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.555924 10736 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:27.557375 10588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27b7b057c54346c0b47758f08031d007"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:27.557934 10588 raft_consensus.cc:606] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.558269 10588 raft_consensus.cc:614] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.548283 15688 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.569068 10592 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:27.559883 15354 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.488225 15525 consensus_queue.cc:237] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:27.596591 15746 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:27.600925 15579 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.526407 15675 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:27.523227 15684 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:27.608376 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 53935us
I20260709 13:17:27.536481 15747 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.612671 15517 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.632462 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.615005 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.616813 15730 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.624742 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:27.626828 10559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.631978 15748 log.cc:927] Time spent T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:27.551805 15643 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:27.662696 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47760.1us
I20260709 13:17:27.620924 15675 consensus_queue.cc:1243] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer 18f1a9f5e66846dba474825fb5b2b784 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:27.663652 10560 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:27.664252 15733 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:27.673444 15733 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:27.673904 15733 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:27.674691 15733 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.676288 14774 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.676796 14774 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.679749 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.680300 10666 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:27.681526 14774 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.682741 10559 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
W20260709 13:17:27.684005 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 56320.3us
I20260709 13:17:27.689560 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:27.690222 10587 raft_consensus.cc:606] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:27.690609 10587 raft_consensus.cc:614] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.741513 10663 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 15.
I20260709 13:17:27.748601 10661 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:27.683598 15292 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:27.751904 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 131347us
I20260709 13:17:27.753139 10706 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.647971 15680 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:27.762976 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.778002 10706 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.784152 15528 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.786533 15688 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.788552 15643 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.820261 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:27.821038 10592 raft_consensus.cc:606] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.821422 10592 raft_consensus.cc:614] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.822559 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:27.758378 15292 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:27.834074 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 56185.7us
I20260709 13:17:27.839766 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.847375 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.856850 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.759951 15517 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:17:27.861249 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:27.750306 15754 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:17:27.845610 15752 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.849756 15292 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.869161 11416 raft_consensus.cc:1275] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:27.875077 10587 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:27.888734 10587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:27.891412 10587 raft_consensus.cc:606] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:27.891757 10587 raft_consensus.cc:614] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.863871 15691 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.907809 15691 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:27.866357 15579 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:27.870113 15752 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:27.921908 15752 raft_consensus.cc:3060] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.905077 15680 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:27.914191 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.915112 10734 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:27.950197 10593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:27.950964 10593 raft_consensus.cc:2393] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 15: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:27.959074 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:27.966909 10666 pending_rounds.cc:85] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Aborting all ops after (but not including) 9
I20260709 13:17:27.967293 10666 pending_rounds.cc:107] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:27.967563 10666 raft_consensus.cc:2889] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.978055 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:27.913268 15579 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:27.985390 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:27.993945 15765 log.cc:927] Time spent T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:27.996701 15579 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.982424 15768 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.997597 15768 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:27.999931 15768 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:28.015837 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:28.016259 15761 log.cc:927] Time spent T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 13:17:28.018538 15684 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:27.992929 15292 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.022116 15752 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.024051 15752 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:28.032609 15691 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:28.037912 10660 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:27.988339 10559 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:28.059109 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 200539us
I20260709 13:17:28.072093 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:28.073029 10665 raft_consensus.cc:2393] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fac2164a6f874d7dbd29db83a7cf019b in current term 12: Already voted for candidate 18f1a9f5e66846dba474825fb5b2b784 in this term.
W20260709 13:17:28.074182 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 85923.6us
I20260709 13:17:28.072193 10560 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.077790 10663 raft_consensus.cc:1240] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.095701 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:28.096522 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:28.111981 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:28.116258 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 53135.7us
I20260709 13:17:28.119359 15710 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:28.130926 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:28.135164 10736 raft_consensus.cc:1275] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:28.136181 10742 raft_consensus.cc:1240] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.138092 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:28.139475 10738 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.140134 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:28.145218 10668 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:28.097461 15742 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:28.133214 10737 raft_consensus.cc:1275] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:28.137202 10736 raft_consensus.cc:1275] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:28.100209 15336 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.096604 15726 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:17:28.140779 15770 consensus_queue.cc:1059] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:28.200521 15770 raft_consensus.cc:3055] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.200949 15770 raft_consensus.cc:740] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:28.201922 15770 consensus_queue.cc:260] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.203358 15770 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:28.213969 15760 log.cc:927] Time spent T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:17:28.215360 15292 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:28.217576 11382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.048s
W20260709 13:17:28.217880 11382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.002s	sys 0.048s
W20260709 13:17:28.218194 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 328936us
I20260709 13:17:28.183602 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.225983 11415 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:17:28.227475 10632 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.227195 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.229602 15675 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.231885 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:28.232522 10706 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.244244 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:28.243746 15691 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.246039 15525 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.246474 15691 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.248522 15691 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:28.249747 10663 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:28.248615 15763 log.cc:927] Time spent T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 13:17:28.285544 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 187550us
I20260709 13:17:28.294040 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.256150 15579 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.298538 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.312343 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:28.314514 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:28.316555 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 200777us
I20260709 13:17:28.260493 15699 consensus_queue.cc:1048] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:28.319319 10737 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 19 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:28.298982 15683 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.339531 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:28.336984 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.306030 15701 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.341490  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:28.349144  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:28.353802 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.302691 15664 consensus_queue.cc:1059] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:28.449433 10661 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:28.450568 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 104933us
W20260709 13:17:28.451243 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 83652.4us
W20260709 13:17:28.453107 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 114443us
I20260709 13:17:28.319010 15710 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:17:28.455193 10660 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:17:28.437299 15738 log.cc:927] Time spent T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:28.351549 15742 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
W20260709 13:17:28.462997 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 116778us
I20260709 13:17:28.358433 15752 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:28.464824 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 97972.8us
I20260709 13:17:28.435025 15678 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:28.469583 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 92249.7us
I20260709 13:17:28.354480 15733 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:17:28.473424 14721 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:28.477445 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.496104 10594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:28.496446 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:28.496165 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:28.498221 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.499663 10588 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:28.501750 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:28.505399 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:28.509557 10590 raft_consensus.cc:1240] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.492871 15700 raft_consensus.cc:3055] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:28.504945 15590 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:28.526295 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 47447us
I20260709 13:17:28.527362 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:28.541460 15675 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.485918 15742 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.532435 15754 consensus_queue.cc:1048] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:17:28.545025 15675 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:28.546566 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:28.549393 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45105.7us
I20260709 13:17:28.526111 15752 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.524348 15700 raft_consensus.cc:740] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
W20260709 13:17:28.548810 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50715.7us
I20260709 13:17:28.555109 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.557566 10706 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:28.549790 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 09799b1ddd3f45f1a08fcd6e271cdcf7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:28.518697 15699 consensus_queue.cc:1048] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:28.570621 10590 raft_consensus.cc:1275] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:28.578042 10594 raft_consensus.cc:2468] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:28.563267 15779 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.561472 15752 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:28.591660 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 138652us
I20260709 13:17:28.559087 15525 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:28.558706 15671 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.615447 15684 consensus_queue.cc:1048] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:28.595871 15701 consensus_queue.cc:1048] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:28.639443 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:28.560173 15643 consensus_queue.cc:1059] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:17:28.643354 15643 raft_consensus.cc:3055] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:28.643687 15643 raft_consensus.cc:740] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:28.644457 15643 consensus_queue.cc:260] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:28.618707 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 64963.9us
I20260709 13:17:28.620397 15679 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:28.624868 15781 log.cc:927] Time spent T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:17:28.626368 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 104539us
I20260709 13:17:28.569617 15649 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.630218 15752 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:28.692756 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:28.699167 10741 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:28.688825 15643 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.686077 15336 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:28.655800 15700 consensus_queue.cc:260] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.731007 15336 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:28.748854 15336 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:28.750157 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:28.722031 15741 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:17:28.757923 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62366.5us
I20260709 13:17:28.794111 10706 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.819232 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:28.817236 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:28.828944 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:28.834206 15784 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.825985 15798 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.823259 15684 raft_consensus.cc:2804] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:28.863202 15684 raft_consensus.cc:697] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:28.864383 15684 consensus_queue.cc:237] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:28.885754 10739 raft_consensus.cc:1240] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Rejecting Update request from peer 18f1a9f5e66846dba474825fb5b2b784 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:17:29.044260 15800 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:29.035545 15705 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:29.061760 15705 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:29.063850 15705 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:29.068292 10742 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:29.068663 10742 pending_rounds.cc:85] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Aborting all ops after (but not including) 6
I20260709 13:17:29.068859 10742 pending_rounds.cc:107] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:29.069083 10742 raft_consensus.cc:2889] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.071048 14774 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:29.072139 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:29.079324 15805 log.cc:927] Time spent T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:17:29.080080 15669 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:29.080611 15669 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:29.082594 15669 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:29.090780 15812 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:29.091320 15812 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:29.100587 15777 log.cc:927] Time spent T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.636s	user 0.004s	sys 0.000s
W20260709 13:17:29.101092 15800 log.cc:927] Time spent T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:29.102602 15700 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.103906 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:29.107029 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:29.110579 10708 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.117152 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:29.133067 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
W20260709 13:17:29.259166 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118270us
W20260709 13:17:29.261693 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 106899us
I20260709 13:17:29.271071 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 2669) took 1315 ms. Trace:
I20260709 13:17:29.271525 10666 rpcz_store.cc:276] 0709 13:17:27.955685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.958560 (+  2875us) service_pool.cc:224] Handling call
0709 13:17:27.966686 (+  8126us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.017614 (+ 50928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.017642 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:28.018139 (+   497us) log.cc:844] Serialized 52 byte log entry
0709 13:17:28.313978 (+295839us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.314016 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.314089 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.100008 (+785919us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f42540f2c85 00007f42540f36a2 00007f4256e651db 00007f4256e60aaf 00007f4256e5486e 00007f4256e53bb6 00007f4256e537d8 00007f4256e5d221 00007f4256e5d1d9 00007f4256e5d169
0709 13:17:29.270763 (+170755us) raft_consensus.cc:1685] finished
0709 13:17:29.270794 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.270994 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28315,"raft.queue_time_us":29352,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":6495104,"thread_start_us":295516,"threads_started":1,"wal-append.queue_time_us":445814}
I20260709 13:17:29.144176 15445 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:17:29.143569 15726 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
W20260709 13:17:29.280498 15787 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:29.152410 15812 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:29.293176 15811 log.cc:927] Time spent T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.140s	user 0.002s	sys 0.008s
W20260709 13:17:29.397058 15807 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.368s	user 0.000s	sys 0.002s
I20260709 13:17:29.407759 10666 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:29.422564 15785 raft_consensus.cc:493] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:29.423242 15785 raft_consensus.cc:515] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:29.426403 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:29.457011 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 195096us
W20260709 13:17:29.460322 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 195110us
I20260709 13:17:29.460502 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:29.461225 10632 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:29.463963 15664 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.467324 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:29.476961 10585 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:29.488767 15691 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:29.506831 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:29.535768 10666 raft_consensus.cc:1275] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:29.492390 15789 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.539405 15699 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.547464 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00e9824bb588413ab262854eb713a965" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:29.510691 15785 leader_election.cc:290] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:29.560902 10557 leader_election.cc:304] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:29.561426 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 45776.7us
W20260709 13:17:29.580184 15818 log.cc:927] Time spent T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 13:17:29.550733 15579 consensus_queue.cc:1048] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:29.452680  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:29.576422 15292 raft_consensus.cc:2749] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:29.620635 10488 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 117) took 19845 ms (client timeout 15000 ms). Trace:
I20260709 13:17:29.637599 15567 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:17:29.621031 10488 rpcz_store.cc:269] 0709 13:17:09.775023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.777432 (+  2409us) service_pool.cc:224] Handling call
0709 13:17:10.558802 (+781370us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257223090 00007f42572c1f3a 00007f425d0781cc 00007f425d17637e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:17:29.620564 (+19061762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:27.781038 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:27.781763 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:27.781791 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:17:27.781808 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:27.942057 (+160249us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:27.962621 (+ 20564us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:27.972366 (+  9745us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:17:28.016852 (+ 44486us) tablet.cc:701] Row locks acquired
0709 13:17:28.016872 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:17:28.017016 (+   144us) write_op.cc:270] Start()
0709 13:17:28.017134 (+   118us) write_op.cc:276] Timestamp: P: 1783603048016971 usec, L: 0
0709 13:17:28.017160 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:17:28.017770 (+   610us) log.cc:844] Serialized 2416 byte log entry
0709 13:17:28.351267 (+333497us) op_driver.cc:464] REPLICATION: finished
0709 13:17:28.638472 (+287205us) write_op.cc:301] APPLY: starting
0709 13:17:28.638557 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:28.730175 (+ 91618us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:28.735127 (+  4952us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:28.775341 (+ 40214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:28.775644 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:17:28.775687 (+    43us) write_op.cc:312] APPLY: finished
0709 13:17:28.775910 (+   223us) log.cc:844] Serialized 65 byte log entry
0709 13:17:28.776067 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:28.776179 (+   112us) write_op.cc:454] Released schema lock
0709 13:17:28.776224 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:28.776616 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:28.776647 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":240,"reported_tablets":24,"spinlock_wait_cycles":168210688,"child_traces":[["op",{"apply.queue_time_us":279583,"apply.run_cpu_time_us":8954,"apply.run_wall_time_us":138133,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":206481,"prepare.run_cpu_time_us":3637,"prepare.run_wall_time_us":237039,"replication_time_us":297632,"thread_start_us":249665,"threads_started":2}]]}
I20260709 13:17:29.725639 15450 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.750013 15450 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:29.753746 15450 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:29.755532 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:29.757405 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:29.774482 10738 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:29.776392 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:29.816526 10490 catalog_manager.cc:5697] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 15 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.818816 10490 catalog_manager.cc:5697] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 16, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 16 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.826607 10490 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.789379 15450 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.827872 10490 catalog_manager.cc:5697] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.831528 10490 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.833163 10490 catalog_manager.cc:5697] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 13, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.836665 10490 catalog_manager.cc:5697] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 16, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 16 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.845525 10490 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.847523 10490 catalog_manager.cc:5697] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.849516 10490 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 12, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 12 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.852872 10490 catalog_manager.cc:5697] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 14, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 14 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.854861 10490 catalog_manager.cc:5697] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.857784 10490 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.859675 10490 catalog_manager.cc:5697] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 15, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 15 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.861545 10490 catalog_manager.cc:5697] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 8, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 8 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.863533 10490 catalog_manager.cc:5697] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 17, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 17 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.865621 10490 catalog_manager.cc:5697] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.868217 10490 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.870296 10490 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 15 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.831043 15450 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.883503 15450 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.925844 10490 catalog_manager.cc:5697] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 12 to 16, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 16 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.927610 10490 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 12, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 12 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.929052 10490 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.940313 10490 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 12, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 12 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.942764 10490 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.946771 10490 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.948410 10490 catalog_manager.cc:5697] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 12, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 12 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.950357 10490 catalog_manager.cc:5697] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 11 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.952064 10490 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.953503 10490 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 10, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 10 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.954733 10490 catalog_manager.cc:5697] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 7 to 9, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 9 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.956035 10490 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.957412 10490 catalog_manager.cc:5697] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:29.960450 10491 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 115) took 64663 ms (client timeout 15000 ms). Trace:
W20260709 13:17:29.960947 10491 rpcz_store.cc:269] 0709 13:16:25.280583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.339160 (+ 58577us) service_pool.cc:224] Handling call
0709 13:16:26.587730 (+1248570us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b540006ff90. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4254054db1 00007f4254195640 00007f425d06cb76 00007f425d176c3e 00007f425b6372a4 00007f425b637232 00007f425b637161 00007f425b6370dc 00007f425b636392 00007f42555f448c 00007f42555f38c6
0709 13:17:29.933309 (+63345579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133939,"reported_tablets":24,"spinlock_wait_cycles":7521024}
I20260709 13:17:29.965695 10490 catalog_manager.cc:5697] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 11 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:29.945314 15450 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:29.969724 10490 catalog_manager.cc:5697] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 11, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 11 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.979480 10490 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.982697 10490 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.984274 10490 catalog_manager.cc:5697] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 11 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.985946 10490 catalog_manager.cc:5697] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:29.987197 10490 catalog_manager.cc:5697] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 15 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.989046 10490 catalog_manager.cc:5697] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.046677 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:30.092998 15567 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.093505 15567 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.095526 15567 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:30.099553 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:30.100664 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:30.102041 10736 raft_consensus.cc:2410] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:30.107955 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:30.112962 14774 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:30.154042 15450 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:30.159463 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:30.160030 10736 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.188035 10736 raft_consensus.cc:2468] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 10.
I20260709 13:17:30.189605 11417 consensus_queue.cc:237] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:30.194460 10476 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e71e2e44af1e46d8a8423ae08646bc22 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.197908 10635 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:30.198650 15789 raft_consensus.cc:2804] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:30.199123 15789 raft_consensus.cc:697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:30.199903 15789 consensus_queue.cc:237] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:30.224100 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 62437.3us
I20260709 13:17:30.239598 10738 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:30.244797 15712 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:30.245159 10585 raft_consensus.cc:1275] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:30.254096 15712 consensus_queue.cc:1048] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:30.266461 15567 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:30.270062 15567 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.273231 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:30.273972 10738 raft_consensus.cc:2368] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10.
I20260709 13:17:30.275128 10560 leader_election.cc:400] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10.
I20260709 13:17:30.275429 10560 leader_election.cc:403] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.275249 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:30.276407 14774 raft_consensus.cc:3060] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.275777 15567 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:30.283541 14774 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 for earlier term 9. Current term is 10.
I20260709 13:17:30.300963 15433 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 6 to 9, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.303758 15838 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.304237 15838 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.306306 15838 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:30.308279 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:30.313648 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:30.314720 10585 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 16.
I20260709 13:17:30.315627 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:30.321401 15450 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:30.327214 15450 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.330621 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:30.331317 10589 raft_consensus.cc:2393] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 16: Already voted for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in this term.
I20260709 13:17:30.331331 10588 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 6 to 9, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.329241 15450 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:30.320875 15838 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.335182 15838 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.341418 15838 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.336364 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:30.326314 10736 raft_consensus.cc:2955] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 6 to 9, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.357636 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46f08f529e274f3799aa41f54ca844f9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:30.374431 15838 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.375609 10739 raft_consensus.cc:2368] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 16. Current term is 17.
I20260709 13:17:30.377056 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:30.377372 15838 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:30.377646 10588 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.378539 10635 leader_election.cc:400] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 16. Current term is 17.
I20260709 13:17:30.378837 10635 leader_election.cc:403] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.379930 15699 raft_consensus.cc:3060] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.380012 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:30.385411 15699 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 16. Current term is 17.
I20260709 13:17:30.390853 10588 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:30.391386 10666 raft_consensus.cc:2468] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 17.
I20260709 13:17:30.392256 10706 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:30.393963 15838 raft_consensus.cc:2804] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:30.394646 15838 raft_consensus.cc:697] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:30.395465 15838 consensus_queue.cc:237] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:30.488313 10492 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 6 to 7, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 7 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.600628 10487 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 5 to 9, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 9 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.602206 10487 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.603754 10487 catalog_manager.cc:5697] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:30.605822 10492 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 116) took 44418 ms (client timeout 15000 ms). Trace:
I20260709 13:17:30.608358 10736 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:30.610105 15450 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:30.613143 10487 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 9 to 16, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 16 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:30.607201 10492 rpcz_store.cc:269] 0709 13:16:46.187164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.187426 (+   262us) service_pool.cc:224] Handling call
0709 13:17:30.605741 (+44418315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.533462 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.534029 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.534062 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:17:30.534077 (+    15us) tablet.cc:662] Decoding operations
0709 13:17:30.534434 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:30.534485 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:30.534510 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:30.534685 (+   175us) tablet.cc:701] Row locks acquired
0709 13:17:30.534701 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:17:30.534825 (+   124us) write_op.cc:270] Start()
0709 13:17:30.534926 (+   101us) write_op.cc:276] Timestamp: P: 1783603050534789 usec, L: 0
0709 13:17:30.534944 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:17:30.535462 (+   518us) log.cc:844] Serialized 530 byte log entry
0709 13:17:30.537171 (+  1709us) op_driver.cc:464] REPLICATION: finished
0709 13:17:30.537522 (+   351us) write_op.cc:301] APPLY: starting
0709 13:17:30.537604 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:30.538369 (+   765us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:30.538458 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:30.539130 (+   672us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:30.539291 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:17:30.539342 (+    51us) write_op.cc:312] APPLY: finished
0709 13:17:30.539511 (+   169us) log.cc:844] Serialized 25 byte log entry
0709 13:17:30.539665 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:30.539742 (+    77us) write_op.cc:454] Released schema lock
0709 13:17:30.539779 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":11902,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":162,"apply.run_cpu_time_us":2526,"apply.run_wall_time_us":2527,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":2245,"prepare.run_wall_time_us":2246,"replication_time_us":2101}]]}
I20260709 13:17:30.691154 10588 raft_consensus.cc:1275] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:30.701862 10487 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 7 to 12, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.694640 15450 consensus_queue.cc:1048] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:17:30.709452 10487 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 13 to 14, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 14 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.714836 10487 catalog_manager.cc:5697] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 8 to 9, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 9 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.716329 10487 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.832284  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.868927 10491 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.871217 10491 catalog_manager.cc:5697] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 14 to 15, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 15 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.883637 10491 catalog_manager.cc:5697] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.885602 10487 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 199) took 9888 ms. Trace:
I20260709 13:17:30.905555 10487 rpcz_store.cc:276] 0709 13:17:20.997706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.998101 (+   395us) service_pool.cc:224] Handling call
0709 13:17:30.885510 (+9887409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.724320 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.724852 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.724885 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:17:30.724902 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:30.725723 (+   821us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:30.725772 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:30.725798 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:30.726403 (+   605us) tablet.cc:701] Row locks acquired
0709 13:17:30.726419 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:17:30.726533 (+   114us) write_op.cc:270] Start()
0709 13:17:30.726655 (+   122us) write_op.cc:276] Timestamp: P: 1783603050726492 usec, L: 0
0709 13:17:30.726677 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:30.733271 (+  6594us) log.cc:844] Serialized 3181 byte log entry
0709 13:17:30.736582 (+  3311us) op_driver.cc:464] REPLICATION: finished
0709 13:17:30.737084 (+   502us) write_op.cc:301] APPLY: starting
0709 13:17:30.737159 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:30.759097 (+ 21938us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:30.759193 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:30.775758 (+ 16565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:30.775956 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:17:30.776011 (+    55us) write_op.cc:312] APPLY: finished
0709 13:17:30.776231 (+   220us) log.cc:844] Serialized 81 byte log entry
0709 13:17:30.776414 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:30.776555 (+   141us) write_op.cc:454] Released schema lock
0709 13:17:30.776596 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:30.776923 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:30.776959 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14476,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":10297,"apply.run_wall_time_us":39810,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33488,"num_ops":8,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":3315,"prepare.run_wall_time_us":9227,"replication_time_us":9768}]]}
I20260709 13:17:30.915325 10491 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.916966 10491 catalog_manager.cc:5697] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 7 to 12, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.920751 10491 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 8 to 10, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.937705 10491 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 15 to 19, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 19 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.940021 10491 catalog_manager.cc:5697] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 12 to 14, leader changed from fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 14 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.941367 10491 catalog_manager.cc:5697] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:30.943188 10491 catalog_manager.cc:5697] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:30.944341 10491 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.983820 10669 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:31.005494 15579 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:31.039965 10589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:31.040670 10589 raft_consensus.cc:606] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:31.054900 10588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:31.055483 10588 raft_consensus.cc:606] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Received request to transfer leadership to TS fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:31.088531 10588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
mode: GRACEFUL
new_leader_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:58582
I20260709 13:17:31.089167 10588 raft_consensus.cc:606] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Received request to transfer leadership to TS 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:31.091641  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:31.094251  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:31.099336 10589 raft_consensus.cc:1275] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:31.110383 15849 raft_consensus.cc:993] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:31.110855 15849 raft_consensus.cc:1081] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Signalling peer fac2164a6f874d7dbd29db83a7cf019b to start an election
I20260709 13:17:31.112758 10742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd"
dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
 from {username='slave'} at 127.0.0.1:50140
I20260709 13:17:31.113353 10742 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.113655 10742 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.133891 10488 catalog_manager.cc:5697] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.137092 15838 consensus_queue.cc:1048] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:31.183898 10742 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.206714 10588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:31.207255 10588 raft_consensus.cc:3055] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:31.207541 10588 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:31.211602 10588 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.214526 10588 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.218461 10742 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:31.220629 10491 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 207) took 1099 ms. Trace:
I20260709 13:17:31.221004 10491 rpcz_store.cc:276] 0709 13:17:30.114861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.115068 (+   207us) service_pool.cc:224] Handling call
0709 13:17:31.214314 (+1099246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.977921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.978427 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.978456 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:17:30.978468 (+    12us) tablet.cc:662] Decoding operations
0709 13:17:30.979409 (+   941us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:30.979456 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:30.979491 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:17:30.980424 (+   933us) tablet.cc:701] Row locks acquired
0709 13:17:30.980443 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:17:30.980560 (+   117us) write_op.cc:270] Start()
0709 13:17:30.980669 (+   109us) write_op.cc:276] Timestamp: P: 1783603050980520 usec, L: 0
0709 13:17:30.980688 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:17:30.987165 (+  6477us) log.cc:844] Serialized 4388 byte log entry
0709 13:17:30.990437 (+  3272us) op_driver.cc:464] REPLICATION: finished
0709 13:17:30.990753 (+   316us) write_op.cc:301] APPLY: starting
0709 13:17:30.990835 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:30.994291 (+  3456us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b540041b9d4. stack: 00007f425419a343 00007f425419a240 00007f4253b291d4 00007f425d867304 00007f425d867299 00007f4257222571 00007f42572b4e28 00007f425acef581 00007f425aceed58 00007f425acf39f1 00007f425acf39a9 00007f425acf3939 00007f425acf3901 00007f425acf2b2d 000000000038f354 000000000038f199
0709 13:17:30.996516 (+  2225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:30.996546 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:31.006658 (+ 10112us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:31.006892 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:17:31.006948 (+    56us) write_op.cc:312] APPLY: finished
0709 13:17:31.007281 (+   333us) log.cc:844] Serialized 105 byte log entry
0709 13:17:31.028137 (+ 20856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.028273 (+   136us) write_op.cc:454] Released schema lock
0709 13:17:31.028327 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:31.028926 (+   599us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.028986 (+    60us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9333,"reported_tablets":52,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":13456,"apply.run_wall_time_us":38065,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46046,"num_ops":11,"prepare.queue_time_us":28492,"prepare.run_cpu_time_us":5587,"prepare.run_wall_time_us":16536,"replication_time_us":9643,"spinlock_wait_cycles":13610368}]]}
I20260709 13:17:31.229058 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:31.229595 10666 raft_consensus.cc:3060] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.251185 10588 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:31.252146 10706 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:31.253156 15710 raft_consensus.cc:2804] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:31.253619 10666 raft_consensus.cc:2468] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:31.253727 15710 raft_consensus.cc:697] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:31.254886 15710 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.275774 10485 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35658 (request call id 118) took 6269 ms. Trace:
I20260709 13:17:31.276328 10485 rpcz_store.cc:276] 0709 13:17:25.006352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.031798 (+ 25446us) service_pool.cc:224] Handling call
0709 13:17:31.275685 (+6243887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47236,"reported_tablets":24}
W20260709 13:17:31.277107 10476 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 46f08f529e274f3799aa41f54ca844f9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 9
I20260709 13:17:31.298081 10488 catalog_manager.cc:5697] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:31.334348 10491 catalog_manager.cc:5697] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 6 to 9, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 11 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:31.357296 15850 raft_consensus.cc:993] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:31.357802 15850 raft_consensus.cc:1081] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:31.360507 10666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:17:31.361006 10666 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.361346 10666 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.367061 10589 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:31.381093 15450 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:31.381629 15450 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:31.385059 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" is_pre_election: true
I20260709 13:17:31.389067 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:31.390381 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:31.390578 10632 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:31.391444 15789 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.387840 15450 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:31.405161 10666 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.409922 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:31.410403 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7485460ddbcb4574882c669f7bdbbf47" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:31.410758 10742 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.410959 10591 raft_consensus.cc:3055] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.411365 10591 raft_consensus.cc:740] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:31.414117 10591 consensus_queue.cc:260] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.417856 10591 raft_consensus.cc:3060] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.424647 11417 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:31.418283 10742 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:31.426316 15849 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:31.429934 10666 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:31.430763 10591 raft_consensus.cc:2468] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:31.431773 10632 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:31.441591 10669 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:17:31.443734 14774 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:31.447153 15789 raft_consensus.cc:2804] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:31.447631 15789 raft_consensus.cc:697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:31.448429 15789 consensus_queue.cc:237] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.500350 14774 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 5 to 12, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:31.509069 11417 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 5 to 12, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:31.516129 10486 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54938 (request call id 206) took 16842 ms (client timeout 15000 ms). Trace:
W20260709 13:17:31.545768 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 59676.4us
W20260709 13:17:31.550205 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 60937.9us
I20260709 13:17:31.557552 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
W20260709 13:17:31.516634 10486 rpcz_store.cc:269] 0709 13:17:14.673916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.674240 (+   324us) service_pool.cc:224] Handling call
0709 13:17:31.516033 (+16841793us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281814,"reported_tablets":52}
W20260709 13:17:31.565438 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77297.7us
I20260709 13:17:31.581976 14774 raft_consensus.cc:993] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: : Instructing follower 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:31.582438 14774 raft_consensus.cc:1081] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Signalling peer 18f1a9f5e66846dba474825fb5b2b784 to start an election
I20260709 13:17:31.588542 10666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
 from {username='slave'} at 127.0.0.1:35982
I20260709 13:17:31.589031 10666 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.589375 10666 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.597362 10488 catalog_manager.cc:5697] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 12 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 13 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.604175 10491 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index 5 to 12, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New cstate: current_term: 19 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.630163 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 46f08f529e274f3799aa41f54ca844f9 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:42060
I20260709 13:17:31.640154 10666 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.644719 10666 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:31.645918 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:31.646457 10742 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.650789 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
I20260709 13:17:31.651338 10591 raft_consensus.cc:3055] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.651614 10591 raft_consensus.cc:740] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:31.652323 10591 consensus_queue.cc:260] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.653715 10742 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:31.655014 10635 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:31.656968 15450 raft_consensus.cc:2804] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.657471 15450 raft_consensus.cc:697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:31.658280 15450 consensus_queue.cc:237] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:31.661731 10591 raft_consensus.cc:3060] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.670590 10589 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:31.674965 15710 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:31.684293 10668 raft_consensus.cc:2955] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 5 to 12, VOTER fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:31.690207 10591 raft_consensus.cc:2468] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:31.692026 15869 tablet_replica.cc:333] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:31.695731 15869 raft_consensus.cc:2243] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.696928 15869 raft_consensus.cc:2272] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.725823 10491 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 11 to 12, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } }
I20260709 13:17:31.775414 10668 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:31.776763 15869 ts_tablet_manager.cc:1916] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.777565 15838 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:31.786492 10487 catalog_manager.cc:5697] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 10 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 11 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.805025 10732 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 with delete_type TABLET_DATA_TOMBSTONED (TS fac2164a6f874d7dbd29db83a7cf019b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54112
I20260709 13:17:31.856858 15877 tablet_replica.cc:333] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:17:31.857971 15877 raft_consensus.cc:2243] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:31.858851 15877 raft_consensus.cc:2272] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:31.862015 15877 ts_tablet_manager.cc:1916] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:31.873276 15869 ts_tablet_manager.cc:1929] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:17:31.873898 15869 log.cc:1199] T 46f08f529e274f3799aa41f54ca844f9 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/46f08f529e274f3799aa41f54ca844f9
I20260709 13:17:31.879809 10742 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:31.881379 15450 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:31.885535 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 46f08f529e274f3799aa41f54ca844f9 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:17:31.902417 15877 ts_tablet_manager.cc:1929] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.11
I20260709 13:17:31.902846 15877 log.cc:1199] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P fac2164a6f874d7dbd29db83a7cf019b: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/wals/3ae2b9cd744b4a2bba38c92a5f4b94f3
I20260709 13:17:31.907231 10479 catalog_manager.cc:5028] TS fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): tablet 3ae2b9cd744b4a2bba38c92a5f4b94f3 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:17:31.916747 10589 raft_consensus.cc:1275] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:31.920619 15865 consensus_queue.cc:1048] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:32.095115  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.095404 10589 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:32.097520 15862 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:32.144685 10742 raft_consensus.cc:1275] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:32.146019 15450 consensus_queue.cc:1048] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:32.914275 10742 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:32.943017 10668 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:32.944829 15838 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:32.946959 10706 consensus_peers.cc:597] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bd88b6bef8141f2a7c75714e0233dfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.961434 10591 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:32.967423 15838 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:32.998328 15886 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.003122 10589 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.007627 10667 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.040818 10742 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:33.052917 10485 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.099859 10666 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:33.102875 15579 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:33.108304 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a78c470d1bf042369166e3a795c3e963. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.109974 10589 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:33.125504 15579 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.171890 15579 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.173066 10585 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.184319 10668 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.206910 10742 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:17:33.232589 10706 consensus_peers.cc:597] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 099b1366ff5e4753be5bd192a535a9fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.232951 10585 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:33.235441 10668 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:33.236861 15579 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.238571 15579 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.274768  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:33.297070 15838 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.301060 10666 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.301623 10589 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.325217 10589 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:33.367286 15901 ts_tablet_manager.cc:933] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:33.372951 15897 log.cc:927] Time spent T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 13:17:33.380131 15901 tablet_copy_client.cc:323] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:17:33.394833 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 7bd88b6bef8141f2a7c75714e0233dfd from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:17:33.395417 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 7bd88b6bef8141f2a7c75714e0233dfd from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-7bd88b6bef8141f2a7c75714e0233dfd
I20260709 13:17:33.421854 10491 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index -1 to 7, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.428566 10491 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: config changed from index -1 to 9, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.477679 10753 tablet_copy_source_session.cc:215] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.495976 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd88b6bef8141f2a7c75714e0233dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.508744 10742 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:33.512455 15567 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.516198 10668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb"
dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
mode: GRACEFUL
new_leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:17:33.516758 10668 raft_consensus.cc:606] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Received request to transfer leadership to TS 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:33.520565  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:33.527191  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:17:33.540342 10557 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 -> Peer e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619): Couldn't send request to peer e71e2e44af1e46d8a8423ae08646bc22. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e922c08ea15b4851815093b0021df81c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.542914 15901 tablet_copy_client.cc:806] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.543512 15901 tablet_copy_client.cc:670] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.547765 15901 tablet_copy_client.cc:538] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.558121 10666 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:33.562603 15901 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:17:33.563767 15567 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.613924 15567 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.624501 10669 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.649351 10488 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index -1 to 10, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.663003 15901 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.666555 15901 tablet_bootstrap.cc:492] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:17:33.667518 15901 ts_tablet_manager.cc:1403] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.025s
I20260709 13:17:33.700767 10741 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } }
I20260709 13:17:33.711330 15789 raft_consensus.cc:993] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: : Instructing follower 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:17:33.711022 15901 raft_consensus.cc:359] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:33.711813 15450 raft_consensus.cc:1081] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Signalling peer 09799b1ddd3f45f1a08fcd6e271cdcf7 to start an election
I20260709 13:17:33.711998 15901 raft_consensus.cc:740] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:17:33.713213 15907 ts_tablet_manager.cc:933] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:33.713790 10589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb"
dest_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7"
 from {username='slave'} at 127.0.0.1:45606
I20260709 13:17:33.714344 10589 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.714733 10589 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.725521 15901 consensus_queue.cc:260] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:33.728384 15901 ts_tablet_manager.cc:1434] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.000s
I20260709 13:17:33.730157 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-7bd88b6bef8141f2a7c75714e0233dfd received from {username='slave'} at 127.0.0.1:35822
I20260709 13:17:33.730592 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-7bd88b6bef8141f2a7c75714e0233dfd on tablet 7bd88b6bef8141f2a7c75714e0233dfd with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:33.756201 10589 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:33.765681 15901 ts_tablet_manager.cc:933] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:33.767134 10589 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:33.768452 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:33.768983 10668 raft_consensus.cc:3055] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:33.769263 10668 raft_consensus.cc:740] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:33.769973 10668 consensus_queue.cc:260] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:33.770977 10668 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.789431 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:33.790167 10741 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.792362 10668 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:33.793676 10559 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784; no voters: 
I20260709 13:17:33.801473 14774 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:33.801934 14774 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Becoming Leader. State: Replica: 09799b1ddd3f45f1a08fcd6e271cdcf7, State: Running, Role: LEADER
I20260709 13:17:33.802538 14774 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:33.808751 10741 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09799b1ddd3f45f1a08fcd6e271cdcf7 in term 10.
I20260709 13:17:33.839506 15907 tablet_copy_client.cc:323] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:17:33.841404 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet a78c470d1bf042369166e3a795c3e963 from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:17:33.841964 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet a78c470d1bf042369166e3a795c3e963 from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-a78c470d1bf042369166e3a795c3e963
I20260709 13:17:33.849889 10753 tablet_copy_source_session.cc:215] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.852797 15901 tablet_copy_client.cc:323] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.67:32771
I20260709 13:17:33.855259 15907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c470d1bf042369166e3a795c3e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.858243 10753 tablet_copy_service.cc:140] P fac2164a6f874d7dbd29db83a7cf019b: Received BeginTabletCopySession request for tablet 099b1366ff5e4753be5bd192a535a9fe from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:35822)
I20260709 13:17:33.858812 10753 tablet_copy_service.cc:161] P fac2164a6f874d7dbd29db83a7cf019b: Beginning new tablet copy session on tablet 099b1366ff5e4753be5bd192a535a9fe from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:35822: session id = e71e2e44af1e46d8a8423ae08646bc22-099b1366ff5e4753be5bd192a535a9fe
I20260709 13:17:33.870687 10753 tablet_copy_source_session.cc:215] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:33.877871 11417 raft_consensus.cc:1217] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:17:33.880735 15907 tablet_copy_client.cc:806] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.881261 15907 tablet_copy_client.cc:670] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.888126 10488 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 reported cstate change: term changed from 9 to 10, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65). New cstate: current_term: 10 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.889218 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099b1366ff5e4753be5bd192a535a9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:33.890894 15907 tablet_copy_client.cc:538] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.911440 15907 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:17:33.960354 15901 tablet_copy_client.cc:806] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:33.963466 15911 ts_tablet_manager.cc:933] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Initiating tablet copy from peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805)
I20260709 13:17:33.961083 15901 tablet_copy_client.cc:670] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:33.982379 15901 tablet_copy_client.cc:538] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:33.993217 15911 tablet_copy_client.cc:323] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Beginning tablet copy session from remote peer at address 127.9.68.65:41805
I20260709 13:17:33.995479 10604 tablet_copy_service.cc:140] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Received BeginTabletCopySession request for tablet e922c08ea15b4851815093b0021df81c from peer e71e2e44af1e46d8a8423ae08646bc22 ({username='slave'} at 127.0.0.1:34318)
I20260709 13:17:33.996099 10604 tablet_copy_service.cc:161] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Beginning new tablet copy session on tablet e922c08ea15b4851815093b0021df81c from peer e71e2e44af1e46d8a8423ae08646bc22 at {username='slave'} at 127.0.0.1:34318: session id = e71e2e44af1e46d8a8423ae08646bc22-e922c08ea15b4851815093b0021df81c
I20260709 13:17:34.016536 10604 tablet_copy_source_session.cc:215] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:34.017618 15907 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.023319 15911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e922c08ea15b4851815093b0021df81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.040443 15901 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:17:34.041819 15907 tablet_bootstrap.cc:492] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:17:34.042601 15907 ts_tablet_manager.cc:1403] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.010s
I20260709 13:17:34.105203 15907 raft_consensus.cc:359] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:34.113448 15907 raft_consensus.cc:740] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:17:34.115311 15907 consensus_queue.cc:260] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
W20260709 13:17:34.130234 10559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 99527.8us
W20260709 13:17:34.132831 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 101099us
I20260709 13:17:34.149986 15907 ts_tablet_manager.cc:1434] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 13:17:34.152454 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-a78c470d1bf042369166e3a795c3e963 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:17:34.152858 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-a78c470d1bf042369166e3a795c3e963 on tablet a78c470d1bf042369166e3a795c3e963 with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:34.160229 15911 tablet_copy_client.cc:806] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:34.169651 15911 tablet_copy_client.cc:670] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:34.197057 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 61056.2us
I20260709 13:17:34.209424 15911 tablet_copy_client.cc:538] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:34.238950 15901 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.239930 15901 tablet_bootstrap.cc:492] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:17:34.240617 15901 ts_tablet_manager.cc:1403] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.200s	user 0.030s	sys 0.007s
I20260709 13:17:34.246922 11417 raft_consensus.cc:1217] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:17:34.258517 15911 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap starting.
I20260709 13:17:34.296837 15901 raft_consensus.cc:359] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:34.297638 15901 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:17:34.298172 15901 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:34.313900 15901 ts_tablet_manager.cc:1434] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 13:17:34.317029 10753 tablet_copy_service.cc:342] P fac2164a6f874d7dbd29db83a7cf019b: Request end of tablet copy session e71e2e44af1e46d8a8423ae08646bc22-099b1366ff5e4753be5bd192a535a9fe received from {username='slave'} at 127.0.0.1:35822
I20260709 13:17:34.317478 10753 tablet_copy_service.cc:434] P fac2164a6f874d7dbd29db83a7cf019b: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-099b1366ff5e4753be5bd192a535a9fe on tablet 099b1366ff5e4753be5bd192a535a9fe with peer e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:34.328958 15888 raft_consensus.cc:1064] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:17:34.335242 15888 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:34.398586 10589 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:34.430119 10669 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:34.439683 10669 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:34.450440 15923 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:34.460296 15926 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:34.463562 11409 raft_consensus.cc:1217] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:17:34.465752 11414 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:17:34.509892 15911 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:17:34.508594 15926 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:34.540175 10736 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:34.543696  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.587802 15924 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:34.595777 15929 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:34.797326 15911 log.cc:927] Time spent T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:34.840655 15927 raft_consensus.cc:1064] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:17:34.859939 15927 consensus_queue.cc:237] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:34.866135 15924 raft_consensus.cc:1064] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
W20260709 13:17:34.870008 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 77585.7us
W20260709 13:17:34.885138 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 93027.5us
I20260709 13:17:34.883127 15911 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:17:34.889707 15936 log.cc:927] Time spent T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:34.898670 11409 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:34.896212 15926 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:34.890959 15911 tablet_bootstrap.cc:492] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Bootstrap complete.
I20260709 13:17:34.873711 15924 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:34.931094  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:17:34.939772 10667 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:34.944106 11379 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:17:34.938825 10488 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.958039 10668 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:34.969390 15886 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:35.005120 10667 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:35.006925 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 62943.8us
I20260709 13:17:35.014760 15922 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:35.033015 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 57607.2us
I20260709 13:17:35.048498 15911 ts_tablet_manager.cc:1403] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Time spent bootstrapping tablet: real 0.790s	user 0.040s	sys 0.008s
I20260709 13:17:35.055392 11409 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:35.066756 11417 raft_consensus.cc:1275] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 LEARNER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:35.129361 15946 log.cc:927] Time spent T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:35.214052 15930 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:35.216017 15930 consensus_queue.cc:1048] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:35.201766 15911 raft_consensus.cc:359] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:35.219591 15911 raft_consensus.cc:740] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Initialized, Role: LEARNER
I20260709 13:17:35.220278 15911 consensus_queue.cc:260] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:35.223343 15911 ts_tablet_manager.cc:1434] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: Time spent starting tablet: real 0.151s	user 0.006s	sys 0.000s
W20260709 13:17:35.373342 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.381026 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 115049us
W20260709 13:17:35.381676 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.395372 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.414323  9489 tablet_copy_service.cc:362] P 09799b1ddd3f45f1a08fcd6e271cdcf7: Destroying tablet copy session e71e2e44af1e46d8a8423ae08646bc22-e922c08ea15b4851815093b0021df81c due to service shutdown
I20260709 13:17:35.414959  9489 tablet_copy_service.cc:434] P 09799b1ddd3f45f1a08fcd6e271cdcf7: ending tablet copy session e71e2e44af1e46d8a8423ae08646bc22-e922c08ea15b4851815093b0021df81c on tablet e922c08ea15b4851815093b0021df81c with peer e71e2e44af1e46d8a8423ae08646bc22
W20260709 13:17:35.454107 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.456580 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.457132 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.466032 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.489763 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.495385 10706 consensus_peers.cc:597] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.495915 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.496361 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.509023 10706 consensus_peers.cc:597] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.534780 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.535466 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.536118 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.536688 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.564365 15886 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:35.565294 15922 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:35.566298 11409 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:35.569943 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.570401 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 103715us
W20260709 13:17:35.571039 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.572774 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.590065 10669 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:35.591478 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 462469us
I20260709 13:17:35.600864 11414 raft_consensus.cc:1217] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:17:35.604764 10661 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:35.559682 10560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 73789.7us
W20260709 13:17:35.619982 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.628605 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.658278 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.678853 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.702495 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.712796 11409 raft_consensus.cc:2955] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:35.725996 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.729561 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.727222 15925 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:35.731388 15925 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:35.731804 15959 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:35.732398 15959 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:35.734493 15959 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:35.742161 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:35.752956 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:35.759954 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:35.766273 10559 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:35.767198 14774 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:35.767375 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.768033 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.768608 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.769223 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.769800 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.770346 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.770875 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.771399 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.773898 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.776388 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.739097 15925 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:35.781373 15925 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:35.781955 15925 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } }
I20260709 13:17:35.784749 15925 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:35.786870 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:35.789532 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:35.790810 10559 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:35.791986 15925 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.796459 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:35.776961 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.806221 10560 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:35.807389 15925 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:35.815218 15925 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:35.815750 15925 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:35.817700 15925 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:35.819003 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:35.819639 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:35.824030 10560 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:35.827068 14774 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.893574  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:35.897977 15925 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:35.898787 15925 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:35.902420 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:35.903326 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:35.904989  9489 tablet_replica.cc:333] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.904815 15925 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:35.907853  9489 raft_consensus.cc:2243] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.908066 10560 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:35.908641  9489 raft_consensus.cc:2272] T a78c470d1bf042369166e3a795c3e963 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.909269 15925 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.911677  9489 tablet_replica.cc:333] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.912739  9489 raft_consensus.cc:2243] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:35.913955  9489 raft_consensus.cc:2272] T 5351bf3c5fe147f7b60882433345dd0b P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.916862  9489 tablet_replica.cc:333] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.917738  9489 raft_consensus.cc:2243] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.922503  9489 raft_consensus.cc:2272] T ee360fe4b438464d8580245f06181d8f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.948194  9489 tablet_replica.cc:333] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.949046  9489 raft_consensus.cc:2243] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.949802  9489 raft_consensus.cc:2272] T 00e9824bb588413ab262854eb713a965 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.952749  9489 tablet_replica.cc:333] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.959055  9489 raft_consensus.cc:2243] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:35.959846  9489 raft_consensus.cc:2272] T 55846c170448461696e53d2649ed09d8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.962668  9489 tablet_replica.cc:333] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.963469  9489 raft_consensus.cc:2243] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:35.964354  9489 raft_consensus.cc:2272] T fa932526573f47178aa5a402a17388ad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:35.967180  9489 tablet_replica.cc:333] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:35.985180 14774 raft_consensus.cc:1064] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: attempting to promote NON_VOTER e71e2e44af1e46d8a8423ae08646bc22 to VOTER
I20260709 13:17:35.992378 10741 consensus_queue.cc:237] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:35.990842 10488 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54944 (request call id 216) took 1055 ms. Trace:
I20260709 13:17:35.993414 10488 rpcz_store.cc:276] 0709 13:17:34.935583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.935900 (+   317us) service_pool.cc:224] Handling call
0709 13:17:35.990771 (+1054871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:35.413698 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:35.509717 (+ 96019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:35.519729 (+ 10012us) write_op.cc:435] Acquired schema lock
0709 13:17:35.519775 (+    46us) tablet.cc:662] Decoding operations
0709 13:17:35.520324 (+   549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:35.520399 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:35.520427 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:35.520670 (+   243us) tablet.cc:701] Row locks acquired
0709 13:17:35.520713 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:17:35.520854 (+   141us) write_op.cc:270] Start()
0709 13:17:35.520984 (+   130us) write_op.cc:276] Timestamp: P: 1783603055520795 usec, L: 0
0709 13:17:35.521004 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:35.586974 (+ 65970us) log.cc:844] Serialized 591 byte log entry
0709 13:17:35.869017 (+282043us) op_driver.cc:464] REPLICATION: finished
0709 13:17:35.903761 (+ 34744us) write_op.cc:301] APPLY: starting
0709 13:17:35.903859 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:35.910436 (+  6577us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:35.910552 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:35.911228 (+   676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:35.911462 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:17:35.911513 (+    51us) write_op.cc:312] APPLY: finished
0709 13:17:35.911761 (+   248us) log.cc:844] Serialized 25 byte log entry
0709 13:17:35.920482 (+  8721us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.920551 (+    69us) write_op.cc:454] Released schema lock
0709 13:17:35.920609 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:35.950286 (+ 29677us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.950320 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14284,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":34459,"apply.run_cpu_time_us":3848,"apply.run_wall_time_us":46497,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":452204,"prepare.run_cpu_time_us":88625,"prepare.run_wall_time_us":363816,"raft.queue_time_us":98472,"raft.run_cpu_time_us":10087,"raft.run_wall_time_us":19684,"replication_time_us":347824,"spinlock_wait_cycles":12032,"thread_start_us":500204,"threads_started":4,"wal-append.queue_time_us":181108}]]}
I20260709 13:17:36.007648  9489 raft_consensus.cc:2243] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.008682 10487 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 9 to 10, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.013415  9489 raft_consensus.cc:2272] T 8e245cc261b6415fac3d372489a49ceb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.014111 10487 catalog_manager.cc:5697] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 7 to 8, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.015879 15929 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.033619 15929 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.033663 14774 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.035895 15929 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.037537  9489 tablet_replica.cc:333] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.037257 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.040781 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.046234  9489 raft_consensus.cc:2243] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.046947  9489 raft_consensus.cc:2272] T 456c58bcf67c4357b892184c57ce7e09 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.049405 10559 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.051836 15929 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.059211 15929 raft_consensus.cc:493] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.059684 15929 raft_consensus.cc:515] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.056268  9489 tablet_replica.cc:333] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.062124  9489 raft_consensus.cc:2243] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.063365  9489 raft_consensus.cc:2272] T 602f135686c6438ea75a7b4f28a2625d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.061623 15929 leader_election.cc:290] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.065686 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.066318 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27b7b057c54346c0b47758f08031d007" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.078893 10560 leader_election.cc:304] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.079903 15959 raft_consensus.cc:2749] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:36.089138  9489 tablet_replica.cc:333] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.094594  9489 raft_consensus.cc:2243] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.097227 10736 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:36.107299  9489 raft_consensus.cc:2272] T edb4252c2cb946b2833f090b57f26ad4 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.110283 10661 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:36.112174 14774 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.112641 14774 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.113011 11409 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:36.113751 15958 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.114449 14774 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.115986 15958 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.116041 15959 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.116847 15959 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.119176 15888 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:36.121372 15959 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.122067 15958 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.122822 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.123325 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.124806 15959 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.122290 14774 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.126276 14774 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.127385 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.125144 10661 raft_consensus.cc:1275] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:36.129344 15926 consensus_queue.cc:1048] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.129763 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.130229  9489 tablet_replica.cc:333] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.130494 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.131274  9489 raft_consensus.cc:2243] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.131897  9489 raft_consensus.cc:2272] T 939b0eadbf7c4b4e842fc542cbaae675 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.132040 14774 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.134829  9489 tablet_replica.cc:333] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.135644  9489 raft_consensus.cc:2243] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.136215  9489 raft_consensus.cc:2272] T 7485460ddbcb4574882c669f7bdbbf47 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.151744 11409 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEARNER]: Refusing update from remote peer 09799b1ddd3f45f1a08fcd6e271cdcf7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:36.154886 10557 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.155014 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.156402 15958 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.156857 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.158113 10560 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.159893 15929 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:36.165398  9489 tablet_replica.cc:333] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.170172  9489 raft_consensus.cc:2243] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.158123 10557 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.157001 15958 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.178364 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.183626  9489 raft_consensus.cc:2272] T b8e29890b8e04ddca3426014b2514656 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.195232 14774 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.198477  9489 tablet_replica.cc:333] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.199330  9489 raft_consensus.cc:2243] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.200048  9489 raft_consensus.cc:2272] T f325308e46064da6807ac7edc8a20717 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.195814 15929 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.205914 15929 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.208711 15929 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.209183 15925 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:36.209565 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.209690 15925 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.211853 15925 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.214107 14774 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.215909 14774 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.216914 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.217626 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.217728 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.184576 15959 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.222370 10560 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.225701 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.226300 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.227690 10557 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.228637 15925 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.229506  9489 tablet_replica.cc:333] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.230366  9489 raft_consensus.cc:2243] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.231272  9489 raft_consensus.cc:2272] T b691cd466c7645fbba119f2344854ddb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.233924 15958 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.234018  9489 tablet_replica.cc:333] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.235100  9489 raft_consensus.cc:2243] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.235802  9489 raft_consensus.cc:2272] T 2c98bbebd7a849a6b0596781b7853ce3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.237475 15567 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.244027 15922 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.245584 10661 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.248198 10560 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.249192 15567 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.250461 15567 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.250901 15567 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.253199 15567 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.254913 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.263186 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bd88b6bef8141f2a7c75714e0233dfd with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.267550  9489 tablet_replica.cc:333] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.270323 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.274047 10741 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.278759 14774 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.279580 15567 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.280966 14774 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.282897 14774 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.283746 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.287200 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.287115 11409 raft_consensus.cc:2955] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.277045 15959 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.293442 15567 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.293893  9489 raft_consensus.cc:2243] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.297245 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.297425 10557 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.298116 14774 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.294801 15959 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:36.316349 15929 raft_consensus.cc:670] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping [suppressed 2 similar messages]
I20260709 13:17:36.316881  9489 raft_consensus.cc:2272] T d9ac19ea4edd4e26890c806619f5b551 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.316967 15929 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.317685 15929 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.319660  9489 tablet_replica.cc:333] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.320549  9489 raft_consensus.cc:2243] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.323711 15958 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.324237 15958 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.321188  9489 raft_consensus.cc:2272] T 6aab7d76cb3149698a925aad05e45589 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.346216 15567 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.347148 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.350523 10488 catalog_manager.cc:5697] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 12 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.361544 15929 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.362984 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.367519 15954 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.370298 15959 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.371657 15958 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.372120 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.374506 10560 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.375900 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.377593 10557 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:36.380278 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.381412 15958 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.381671 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.381904 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.382118 15958 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.385103 10559 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.386550 10559 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:36.387287 14774 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.387827 14774 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.389765 14774 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.390234 14774 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:36.390585 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.390951 14774 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:36.392015 10559 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:36.402310 11414 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:36.406538 14774 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:36.407856 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.406168 15567 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.416275 15567 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.418644 10666 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:36.422119 15567 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.426599 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.428171 15959 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.428526 10559 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.429428 15958 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.429734 15925 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.430235 15925 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.396371 10669 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.430649 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.432145 15925 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.428694 15959 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.434082 10559 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.434880 15567 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.435141 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.434154 15959 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.437022 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.438174 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251650397d264ac1a42a2fde5932424f" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.439512 10559 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.439571 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.440261 15959 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.442696  9489 tablet_replica.cc:333] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.441121 10559 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.443408 15959 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.443547  9489 raft_consensus.cc:2243] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.444329  9489 raft_consensus.cc:2272] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.450675 15567 raft_consensus.cc:493] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:36.450713 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.451211 15567 raft_consensus.cc:515] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.452947 15567 leader_election.cc:290] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:36.453378 15567 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.453789 15567 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.454494 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:36.455478 15567 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:36.455987 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bd88b6bef8141f2a7c75714e0233dfd: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:17:36.457434 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a8b7e07671442dafc4c3dcb271d352" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.457809 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.460198 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.456938 10557 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:36.461735 10560 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.462280 15958 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:36.462731 15925 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:36.463168 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 45256.8us
I20260709 13:17:36.464625 15888 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:17:36.490368 10557 leader_election.cc:304] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:36.494812  9489 tablet_replica.cc:333] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.505587 15958 raft_consensus.cc:2749] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.509397  9489 raft_consensus.cc:2243] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.510708 10487 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 10 to 11, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.511090 15968 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.496430 10742 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.520512 11409 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.530925  9489 raft_consensus.cc:2272] T 27b7b057c54346c0b47758f08031d007 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.527388 15954 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:36.541805 15954 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:36.545028 15954 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:36.545647 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:36.546738  9489 tablet_replica.cc:333] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.546592 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:36.547696  9489 raft_consensus.cc:2243] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.548715  9489 raft_consensus.cc:2272] T 6f1a927fea2843f890fde9160ee8b796 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.548892 10560 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09799b1ddd3f45f1a08fcd6e271cdcf7; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:36.549964 15567 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:36.551424 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 63544.8us
I20260709 13:17:36.552255 15930 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.552119 11417 raft_consensus.cc:2955] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.563596 10666 raft_consensus.cc:2955] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.564741 10487 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 10 to 11, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.572741  9489 tablet_replica.cc:333] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.579530  9489 raft_consensus.cc:2243] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.594084  9489 raft_consensus.cc:2272] T 5b107ac4e22944b388450acfe815a08e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.596508  9489 tablet_replica.cc:333] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.597210  9489 raft_consensus.cc:2243] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.597879  9489 raft_consensus.cc:2272] T 75bb31da8c4c4ef8a1530905a2369172 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.618273  9489 tablet_replica.cc:333] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.619192  9489 raft_consensus.cc:2243] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.620478  9489 raft_consensus.cc:2272] T 0958810fe1d74c67af02bd74dc0488bb P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.623586 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 099b1366ff5e4753be5bd192a535a9fe with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:36.624688  9489 tablet_replica.cc:333] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.625831  9489 raft_consensus.cc:2243] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.626618  9489 raft_consensus.cc:2272] T 20723d90fba84eedaeb069a608e6a40f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.629460  9489 tablet_replica.cc:333] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.630383  9489 raft_consensus.cc:2243] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.630981  9489 raft_consensus.cc:2272] T 0db5b0c3da3b45289300a692b98fa1c1 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.633379  9489 tablet_replica.cc:333] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.634123  9489 raft_consensus.cc:2243] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.634660  9489 raft_consensus.cc:2272] T 68a5bdce0f0846e2a7f8c9c6f36d560e P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.637310  9489 tablet_replica.cc:333] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.638033  9489 raft_consensus.cc:2243] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.688851  9489 raft_consensus.cc:2272] T e922c08ea15b4851815093b0021df81c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.708570  9489 tablet_replica.cc:333] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.710788  9489 raft_consensus.cc:2243] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.712662  9489 raft_consensus.cc:2272] T d6db1ee475344550afb0eaebc5046df6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.730120  9489 tablet_replica.cc:333] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.739972  9489 raft_consensus.cc:2243] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.742460  9489 raft_consensus.cc:2272] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.812227 11417 consensus_queue.cc:237] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:36.830639  9489 tablet_replica.cc:333] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.833706  9489 raft_consensus.cc:2243] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.836108  9489 raft_consensus.cc:2272] T 2d16782ce53741e19df4f216701c641a P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.840458 10736 raft_consensus.cc:1275] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:36.841926 15917 consensus_queue.cc:1048] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:36.853341  9489 tablet_replica.cc:333] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.854185  9489 raft_consensus.cc:2243] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.855237  9489 raft_consensus.cc:2272] T 2904e05a1d154393bc63b07589fd6537 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:36.871044 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:36.897764  9489 tablet_replica.cc:333] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.898881  9489 raft_consensus.cc:2243] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.902364  9489 raft_consensus.cc:2272] T 81565cb1f2054410aae97284b914f79c P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.911094  9489 tablet_replica.cc:333] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.913909  9489 raft_consensus.cc:2243] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.914963  9489 raft_consensus.cc:2272] T 5c293ace9b264b57b21dd6b308e25a1f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.927454  9489 tablet_replica.cc:333] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.928223  9489 raft_consensus.cc:2243] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.928895  9489 raft_consensus.cc:2272] T 3d63a40a747147e987c1c81889fd1a0d P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.931435  9489 tablet_replica.cc:333] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.932305  9489 raft_consensus.cc:2243] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:36.938253  9489 raft_consensus.cc:2272] T 62cf3c0497064f47ad08a6d5a7a28853 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.946357 15957 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.950784 10741 raft_consensus.cc:2955] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 4 to 10, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:36.953820  9489 tablet_replica.cc:333] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.955068  9489 raft_consensus.cc:2243] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.963855 10476 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 456c58bcf67c4357b892184c57ce7e09 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:17:36.965940 10487 catalog_manager.cc:5697] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: config changed from index 4 to 10, VOTER 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) evicted. New cstate: current_term: 13 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.967670  9489 raft_consensus.cc:2272] T 63a3acb5ddc84e7e91b896e4a278cec7 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.972137  9489 tablet_replica.cc:333] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.972860  9489 raft_consensus.cc:2243] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.973392  9489 pending_rounds.cc:70] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Trying to abort 1 pending ops.
I20260709 13:17:36.973624  9489 pending_rounds.cc:77] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7305638110535733248 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" old_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: NON_VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: true } } } new_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } } }
I20260709 13:17:36.974749  9489 raft_consensus.cc:2917] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Aborting config change with OpId 12.10: Aborted: Op aborted
I20260709 13:17:36.975126  9489 raft_consensus.cc:2889] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:17:36.975451  9489 raft_consensus.cc:2272] T 7bd88b6bef8141f2a7c75714e0233dfd P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.978112  9489 tablet_replica.cc:333] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:36.978791  9489 raft_consensus.cc:2243] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:36.979415  9489 raft_consensus.cc:2272] T d13f2688a0464257b5162c27e06aeaad P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:36.995095 10651 tablet_service.cc:1558] Processing DeleteTablet for tablet 456c58bcf67c4357b892184c57ce7e09 with delete_type TABLET_DATA_TOMBSTONED (TS 18f1a9f5e66846dba474825fb5b2b784 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:42060
I20260709 13:17:37.007193 15941 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.007859 15941 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.009435  9489 tablet_replica.cc:333] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.010320  9489 raft_consensus.cc:2243] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.010911  9489 raft_consensus.cc:2272] T 2298132784d24fb2b78c3a21c68a9d40 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.011852 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:37.017725 10632 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.018180 10632 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:37.019551 15963 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.020784 15941 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:37.022204 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:37.025014 15984 tablet_replica.cc:333] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:37.026225 15984 raft_consensus.cc:2243] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.028332 15984 raft_consensus.cc:2272] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.031888 15984 ts_tablet_manager.cc:1916] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:37.056773 15984 ts_tablet_manager.cc:1929] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:17:37.057608 15984 log.cc:1199] T 456c58bcf67c4357b892184c57ce7e09 P 18f1a9f5e66846dba474825fb5b2b784: Deleting WAL directory at /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/wals/456c58bcf67c4357b892184c57ce7e09
I20260709 13:17:37.057792  9489 tablet_replica.cc:333] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.058874  9489 raft_consensus.cc:2243] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.059816  9489 raft_consensus.cc:2272] T eaf67a9a92d14fbeaf459c21b6c42278 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.059684 10478 catalog_manager.cc:5028] TS 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): tablet 456c58bcf67c4357b892184c57ce7e09 (table test-workload [id=cc5ed15cb48f4c1a9a5921e26ef21965]) successfully deleted
I20260709 13:17:37.062780  9489 tablet_replica.cc:333] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.063632  9489 raft_consensus.cc:2243] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.064314  9489 raft_consensus.cc:2272] T 72b98b9d27524f83a9b567dee7f0718f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.067098  9489 tablet_replica.cc:333] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.069706  9489 raft_consensus.cc:2243] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.072225  9489 raft_consensus.cc:2272] T b40fb00bae3d4baa92d6e9276011a816 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.082096  9489 tablet_replica.cc:333] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.082955  9489 raft_consensus.cc:2243] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.083683  9489 raft_consensus.cc:2272] T 9d22506ba0474e93940b67cdd5d59af6 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.089579  9489 tablet_replica.cc:333] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.090543  9489 raft_consensus.cc:2243] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.091202  9489 raft_consensus.cc:2272] T 7247478c2fbc418f85cf61569e673a75 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.094023  9489 tablet_replica.cc:333] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.094717  9489 raft_consensus.cc:2243] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.095654  9489 raft_consensus.cc:2272] T 099b1366ff5e4753be5bd192a535a9fe P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.102849  9489 tablet_replica.cc:333] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.103598  9489 raft_consensus.cc:2243] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.104286  9489 raft_consensus.cc:2272] T 46f08f529e274f3799aa41f54ca844f9 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.120064  9489 tablet_replica.cc:333] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.120795  9489 raft_consensus.cc:2243] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.124141 15981 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.124711 15981 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.126863 15981 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.132361 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:37.134853 10706 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.135573 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:37.137809 15888 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.149474  9489 raft_consensus.cc:2272] T 251650397d264ac1a42a2fde5932424f P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.156002  9489 tablet_replica.cc:333] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.156852  9489 raft_consensus.cc:2243] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.168872 15981 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.169647 15981 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.173890 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.172073 15981 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:37.180735 10706 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.185138 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:37.201587  9489 raft_consensus.cc:2272] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.202484 15888 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:37.205889  9489 tablet_replica.cc:333] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.206820  9489 raft_consensus.cc:2243] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:37.207856  9489 raft_consensus.cc:2272] T 3ed347880eeb491baa0d6d22c5964d18 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.217568 15963 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.218046 15963 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.220083 15963 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:37.222584 10632 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.224130 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.225096 10736 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 11.
I20260709 13:17:37.228675 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:37.229983 15963 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.230404 15963 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.232430 15963 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.233596  9489 tablet_replica.cc:333] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.234373  9489 raft_consensus.cc:2243] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.235072  9489 raft_consensus.cc:2272] T e6d3a109d6054b8ba7b3b1ff65909ade P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.251284  9489 tablet_replica.cc:333] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7: stopping tablet replica
I20260709 13:17:37.252014  9489 raft_consensus.cc:2243] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:37.252707  9489 raft_consensus.cc:2272] T 94a8b7e07671442dafc4c3dcb271d352 P 09799b1ddd3f45f1a08fcd6e271cdcf7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:37.269137 15963 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.275758 10632 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.276365 15963 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.277194 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:37.277824 10741 raft_consensus.cc:3060] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.290261 10741 raft_consensus.cc:2468] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 12.
I20260709 13:17:37.291594 10635 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:37.292361 15963 raft_consensus.cc:2804] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:37.292919 15963 raft_consensus.cc:697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:37.293897 15963 consensus_queue.cc:237] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.327072 10491 catalog_manager.cc:5697] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 11 to 12, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 12 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.330933 15957 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.331516 15957 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.334843 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.335399 10667 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
W20260709 13:17:37.341753 11379 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.343830 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.345605 11382 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:37.346758 15917 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.347580 15957 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:37.354679 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.365103 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.393510 15963 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.407512 15963 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.415059 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.416934 15981 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.417455 15981 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.419930 15981 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.421581 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.422219 10667 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:37.423514 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.432708 15930 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.433110 15930 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.433487 15930 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.445752 10706 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:37.457746 10632 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.457919 15963 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.458205 10632 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:37.459537 15963 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.477645 15963 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.478125 15963 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.481493 15963 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.482740 15963 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.483165 15963 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.483547 10632 leader_election.cc:336] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.485896 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.487152 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:37.487920 15941 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.489941 15941 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.490147 15963 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.490494 15941 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.492614 15941 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:37.495283 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:37.489619 15930 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.500240 15930 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.500675 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:37.507970 15981 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.513170 15888 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.531198 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.544526 10667 raft_consensus.cc:3060] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.544860 10736 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
W20260709 13:17:37.545305 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.546860 15981 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.549794 15888 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.564296 10667 raft_consensus.cc:2468] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
W20260709 13:17:37.568444 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.538946 10706 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:37.578243 10706 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:37.578929 10706 leader_election.cc:336] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.570722 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:37.588922 10632 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:37.593276 10632 leader_election.cc:336] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:37.593664 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:37.588088 15941 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:37.599721 15941 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.608476 10708 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:37.614622 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 48890.7us
I20260709 13:17:37.604271 15963 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.613075 15888 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.611572 15981 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:37.618589 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.619704 10667 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:37.621282 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.621809 10667 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:37.614310 15941 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:37.632547 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.632156 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:37.633627 11417 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:37.617487 15930 raft_consensus.cc:2804] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.634768 15930 raft_consensus.cc:697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:37.632225 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:37.639436 15986 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:37.642261 15986 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:37.643074 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 49809.8us
I20260709 13:17:37.643958 15930 consensus_queue.cc:237] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.642627 15986 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.663358 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:37.665216 15987 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.665762 15987 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.666208 15987 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.676617 15987 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.690208 15960 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.690896 15960 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.700652 15960 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.729758 15987 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:37.734709 15987 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.735234 15987 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.737601 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:37.737946 15987 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.738160 10666 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.741035 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.741837 10667 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:17:37.743320 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.744819 15992 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.747967 10491 catalog_manager.cc:5697] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 12 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.776269 15992 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:37.766403 10632 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:37.775792 10666 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:37.781293 15992 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.744890 15986 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.788923 15992 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.801934 15941 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.803613 15992 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.804653 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:37.804563 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:37.805470 10667 raft_consensus.cc:3060] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.805958 10666 raft_consensus.cc:3060] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.804270 15986 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.819231 10667 raft_consensus.cc:2468] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:37.820258 10708 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.822575 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.823277 10741 raft_consensus.cc:2393] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 in current term 13: Already voted for candidate fac2164a6f874d7dbd29db83a7cf019b in this term.
I20260709 13:17:37.833405 15941 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:37.835913 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.835992 10666 raft_consensus.cc:2468] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:37.825472 15992 raft_consensus.cc:2804] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.837035 15992 raft_consensus.cc:697] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:37.837986 15992 consensus_queue.cc:237] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.838709 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:37.843338 10708 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.844480 15981 raft_consensus.cc:2804] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:37.844962 15981 raft_consensus.cc:697] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:37.845074 15911 tablet_copy_client.cc:1131] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:37.845822 15981 consensus_queue.cc:237] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.850445 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.850890 10632 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.857758 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.858412 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.858911 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.859295 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.872529 10736 raft_consensus.cc:1275] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:37.879194 10476 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 44020us
I20260709 13:17:37.881268 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:37.881814 10736 raft_consensus.cc:3060] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.883873 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:37.884403 11409 raft_consensus.cc:3060] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:37.897595 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.899264 11409 raft_consensus.cc:2468] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:37.899901 15991 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.900408 15991 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.901430 10736 raft_consensus.cc:2468] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 16.
I20260709 13:17:37.903390 15991 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:37.910609 15991 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.911052 15991 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.913252 15991 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:37.915625 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:37.922117 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:37.921519 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 099b1366ff5e4753be5bd192a535a9fe: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.921558 10632 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.924561 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.925396 15988 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.928437 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:37.926755 15960 consensus_queue.cc:1048] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:17:37.935390 15989 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:37.936571 10632 leader_election.cc:336] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.937036 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.938364 10706 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.939144 15987 raft_consensus.cc:2804] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:37.939580 15987 raft_consensus.cc:697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:37.940451 15987 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:37.951946 10491 catalog_manager.cc:5697] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 12 to 13, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.960978 15987 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.961602 15987 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.964740 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.965303 10667 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:37.965662 15992 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.966260 15992 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.969262 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.969756 10706 leader_election.cc:336] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.970870 10706 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.971879 10706 leader_election.cc:336] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:37.972916 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:37.973526 10706 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:37.976603 10635 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
W20260709 13:17:37.977564 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.978116 15960 raft_consensus.cc:2804] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:37.978628 15960 raft_consensus.cc:697] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:37.979408 15960 consensus_queue.cc:237] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:37.979803 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.982179 15992 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.982383 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:37.983342 15930 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.983925 15930 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:37.984483 15930 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.985740 15987 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:37.986208 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:37.987675 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:37.991859 15930 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:37.996780 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.997602 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:37.998405 15930 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:37.999014 10736 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:37.999643 15981 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.000238 15981 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:38.010183 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.010711 15986 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.011240 15986 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.013127 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:38.013120 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:38.014354 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.005267 15981 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:38.014359 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:38.015479 10669 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:38.013710 10666 raft_consensus.cc:3060] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.018519 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:38.019294 15991 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.021632 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:38.024397 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:38.027251 10666 raft_consensus.cc:2468] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:38.014755 15986 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.029901 10708 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:38.030774 15992 raft_consensus.cc:2804] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.031236 15992 raft_consensus.cc:697] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:38.032069 15992 consensus_queue.cc:237] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:38.037416 10706 leader_election.cc:336] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:38.038123 10706 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.038504 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:38.036854 15987 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.041437 15987 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.043290 15987 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:38.046170 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.049917 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:38.050518 10666 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
I20260709 13:17:38.051996 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:38.052742 15986 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.053130 15986 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.053510 15986 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.057178 15957 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.058354 15991 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.058717 15987 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.058871 15991 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.063503 15991 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:38.066111 10632 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.057857 15957 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.070190 15957 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.071326 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:38.071931 10739 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:38.073602 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:38.074633 10666 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 13.
I20260709 13:17:38.085952 11381 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:38.086951 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.087224 15917 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:38.087422 10706 leader_election.cc:336] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.087621 15917 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.087987 15917 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:38.088143 10706 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.088551 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:38.089234 15981 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.089567 15932 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.090204 15932 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.092677 15932 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.099440 15981 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.099905 15981 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.101843 15981 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.103184 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:38.108245 10706 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.113090 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:38.112547 10488 catalog_manager.cc:5697] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 15 to 16, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 16 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.121522 15981 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:38.139508 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:38.140254 10741 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 8.
I20260709 13:17:38.144824 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.149326 15941 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:38.149691 15941 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.150283 15941 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:38.152318 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.153044 15960 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.153594 15960 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:38.160948 10632 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:38.161497 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:38.077672 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:38.162194 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 84550.8us
I20260709 13:17:38.172578 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:38.173370 10666 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:38.173482 15941 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.175869 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:38.177650 15932 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.178206 15932 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.178704 15932 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:38.182439 10632 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.185182 15941 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.078256 10491 catalog_manager.cc:5697] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 10 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 11 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:38.144827 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:38.186297 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:38.186769 10706 leader_election.cc:336] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:38.187830 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.186668 10491 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 13 to 14, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 14 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.193192 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:38.193838 10739 raft_consensus.cc:3060] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:38.205240 10706 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.205768 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:38.208062 15930 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.213719 15960 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.110859 15917 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.217242 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:38.217790 10667 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.222378 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:38.223019 10737 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
W20260709 13:17:38.225221 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.226473 10667 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:38.228967 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.229000 15986 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.230342 15991 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.230705 15991 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.231045 15991 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:38.235149 11379 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.238531 16005 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.239213 16005 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.240708 15987 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.241250 15987 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.238554 15991 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.243324 15987 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.243907 15991 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.246611 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:38.248083 10632 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.249114 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:38.249691 10737 raft_consensus.cc:3060] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.251246 10739 raft_consensus.cc:2468] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 9.
I20260709 13:17:38.253192 16005 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.255429 10635 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.263372 10737 raft_consensus.cc:2468] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
W20260709 13:17:38.267663 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.265384 15960 raft_consensus.cc:2804] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:38.273583 10661 raft_consensus.cc:1275] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:38.274222 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:38.273098 10706 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.275300 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:38.279433 15987 consensus_queue.cc:1048] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.280750 15987 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.282256 10635 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.288455 15986 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:38.292893 11379 leader_election.cc:336] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.272976 15960 raft_consensus.cc:697] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:38.295346 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:38.295981 10666 raft_consensus.cc:3060] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.286936 15941 raft_consensus.cc:2804] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.298662 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:38.299415 10739 raft_consensus.cc:3060] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.300159 15941 raft_consensus.cc:697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:38.307279 15932 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.309278 15941 consensus_queue.cc:237] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.310230 15932 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:38.311177 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:38.311216 15960 consensus_queue.cc:237] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.312072 10667 raft_consensus.cc:3060] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.308171 15991 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.298785 15917 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.321595 15991 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:38.307148 10706 leader_election.cc:336] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:38.324708 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.318747 10667 raft_consensus.cc:2468] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:38.323902 10669 raft_consensus.cc:1275] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:38.326665 11381 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:38.327005 15888 consensus_queue.cc:1048] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:38.327466 15932 raft_consensus.cc:2804] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:38.328109 10632 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.328981 15991 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:38.304247 11379 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.328866 15932 raft_consensus.cc:697] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:38.329794 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:38.333674 15917 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:38.337886 15932 consensus_queue.cc:237] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.342159 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:38.342752 10737 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:38.347404 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.348399 15988 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.348825 15988 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.349457 15988 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.355489 10491 catalog_manager.cc:5697] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 14 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 15 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:38.356462 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.367615 15988 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.332333 10739 raft_consensus.cc:2468] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
W20260709 13:17:38.413837 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 45999.1us
I20260709 13:17:38.507484 10666 raft_consensus.cc:2468] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 11.
I20260709 13:17:38.508414 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:38.508994 10737 raft_consensus.cc:3060] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:38.511801 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 97238.3us
W20260709 13:17:38.512420 11379 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.516053 10737 raft_consensus.cc:2468] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 15.
W20260709 13:17:38.522388 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 106063us
I20260709 13:17:38.530251 10491 catalog_manager.cc:5697] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 8 to 9, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 9 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.521570 15988 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.565719 11409 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:38.563776 11382 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.575956 16007 raft_consensus.cc:2804] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:38.576449 16007 raft_consensus.cc:697] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:38.577337 16007 consensus_queue.cc:237] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:38.608280 11379 leader_election.cc:336] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.602448 15989 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
W20260709 13:17:38.661798  9489 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:38.673595 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 90190.9us
W20260709 13:17:38.678737 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 129438us
I20260709 13:17:38.681972 10666 raft_consensus.cc:1275] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:38.673461 16008 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:38.671633 15990 log.cc:927] Time spent T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:38.684584 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 83404.6us
I20260709 13:17:38.604911 15888 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:17:38.676657 16020 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.691298 10669 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:38.696614 10708 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:38.621920 15989 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:38.692728 16020 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.717447 10635 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:17:38.722146 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.733554 16013 raft_consensus.cc:2804] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.761145 16020 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:38.767309 15989 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:38.768347 16031 raft_consensus.cc:2804] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:38.769922 10632 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.772528 10488 catalog_manager.cc:5697] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 14 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 15 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.780604 16013 raft_consensus.cc:697] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:38.781488 16013 consensus_queue.cc:237] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.783138 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:38.783720 11409 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 19.
I20260709 13:17:38.793730 10669 raft_consensus.cc:1275] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:38.799727 16031 raft_consensus.cc:697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
W20260709 13:17:38.800153 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.800657 16031 consensus_queue.cc:237] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:38.805626 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:38.806241 10740 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:38.807548 10739 raft_consensus.cc:1275] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:38.829311 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.830422 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:38.837186 15981 consensus_queue.cc:1048] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:38.838385 16033 consensus_queue.cc:1048] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.837709 16018 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:17:38.857048 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:38.857625 10706 consensus_peers.cc:597] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:38.876474 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 47926.2us
W20260709 13:17:38.891817 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 61469.7us
I20260709 13:17:38.891419 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:38.900102 16030 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:38.900705 16030 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.901098 16030 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:38.907862 15963 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:38.908357 15963 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 09799b1ddd3f45f1a08fcd6e271cdcf7)
I20260709 13:17:38.908743 15963 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.932327 16020 consensus_queue.cc:1048] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:38.932482 15963 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:38.937433 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:38.938107 16030 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:38.941659 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:38.940591 16030 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:38.963943 10669 raft_consensus.cc:1275] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:38.965792 16021 consensus_queue.cc:1048] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:38.958892 10632 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:38.970165 10632 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:38.977031 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:38.977600 11409 raft_consensus.cc:3060] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:38.974062 10488 catalog_manager.cc:5697] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 13 to 14, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68). New cstate: current_term: 14 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.058297 11409 raft_consensus.cc:2468] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 20.
W20260709 13:17:39.062317 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 69578.4us
I20260709 13:17:39.075111 10632 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:39.088670 10491 catalog_manager.cc:5697] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 10 to 11, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 11 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.097643 10487 catalog_manager.cc:5697] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 14 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 15 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.099581 10487 catalog_manager.cc:5697] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 14 to 15, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 15 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.103663 16020 raft_consensus.cc:2804] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:39.105829 10742 raft_consensus.cc:1275] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:39.106060 10669 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:39.109757 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:39.110224 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:39.110796 10632 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:39.112509 15963 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:39.138010 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:39.138624 10739 raft_consensus.cc:3060] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.108333 16020 raft_consensus.cc:697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 20 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:39.114498 16021 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:17:39.141438 15988 consensus_queue.cc:1048] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:39.147521 16020 consensus_queue.cc:237] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:39.153337 10742 raft_consensus.cc:1275] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:39.171787 10632 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:39.206420 10739 raft_consensus.cc:2468] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 14.
I20260709 13:17:39.216398 10635 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7
I20260709 13:17:39.185226 15989 consensus_queue.cc:1048] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:39.230684 15991 raft_consensus.cc:2804] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:39.259102 10476 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 150031us
I20260709 13:17:39.264194 15991 raft_consensus.cc:697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 LEADER]: Becoming Leader. State: Replica: 18f1a9f5e66846dba474825fb5b2b784, State: Running, Role: LEADER
I20260709 13:17:39.281935 15991 consensus_queue.cc:237] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
W20260709 13:17:39.304600 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 112710us
I20260709 13:17:39.312170 10742 raft_consensus.cc:1275] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:39.313213 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 118989us
I20260709 13:17:39.345363 16021 consensus_queue.cc:1048] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:39.358347 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 099b1366ff5e4753be5bd192a535a9fe: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:39.391642 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:39.406153 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.418908 10667 raft_consensus.cc:1275] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:39.527825 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.544155 10737 raft_consensus.cc:1275] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:39.553951 15981 consensus_queue.cc:1048] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:39.581697 15960 consensus_queue.cc:1048] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:39.599871 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:39.648099 11409 raft_consensus.cc:1275] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:39.650959 15991 consensus_queue.cc:1048] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:39.665745 10488 catalog_manager.cc:5697] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 19 to 20, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 20 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.668089 10488 catalog_manager.cc:5697] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: term changed from 13 to 14, leader changed from 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) to 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66). New cstate: current_term: 14 leader_uuid: "18f1a9f5e66846dba474825fb5b2b784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:39.671947  9489 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10615)
I20260709 13:17:39.721259 10740 raft_consensus.cc:1275] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Refusing update from remote peer 18f1a9f5e66846dba474825fb5b2b784: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:39.723027 16036 consensus_queue.cc:1048] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:39.738435 10736 consensus_queue.cc:237] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:39.750766 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.760842 11409 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:39.761397 10661 raft_consensus.cc:1275] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:39.762755 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:39.764184 16074 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:39.765072 16016 consensus_queue.cc:1048] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:39.779381 15981 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:39.782480 10661 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:39.834103 11409 raft_consensus.cc:2955] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
I20260709 13:17:39.835018 10479 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e245cc261b6415fac3d372489a49ceb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:39.839658 10488 catalog_manager.cc:5697] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 reported cstate change: config changed from index 6 to 12, VOTER 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65) evicted. New cstate: current_term: 14 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } } }
W20260709 13:17:39.950568 11379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111) [suppressed 437 similar messages]
W20260709 13:17:39.963260 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:39.979228 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.017072 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.046545 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.089427 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.188715 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.189357 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.195783 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:40.255228 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.255690 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.273056 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.304327 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.340863 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.363119 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.364260 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.395944 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.494222 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.516335 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.517086 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.609859 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.624815 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.625523 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.632467 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:40.672391  9489 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:40.679914 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.685285 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.691399 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.715700 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.729216 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:40.735019 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.749699 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.755119 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.819046 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.827199 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.875907 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:40.883525 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:40.911515 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:41.073772 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:41.141099 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:41.187882 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.265938 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.269137 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.375159 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.387691 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.481032 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.603991 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.672888  9489 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:41.851856 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:41.979660 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:42.015780 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:42.157186 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.194519 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:42.270649 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:42.304417 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.346576 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:42.346858 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.503834 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:42.562785 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.579180 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.590948 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.594139 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.595639 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.673480  9489 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:42.765142 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.794543 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.801368 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.837491 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.928013 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.950820 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:42.963058 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.042819 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.115459 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 152440us
W20260709 13:17:43.115656 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 72889.4us
W20260709 13:17:43.133090 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.170379 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.179239 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.199831 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.280404 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 80613.2us
W20260709 13:17:43.312575 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.313278 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.337442 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 86395.7us
W20260709 13:17:43.340746 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.344735 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.351567 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.352017 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.355062 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.360731 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.361495 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.381903 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.394014 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 46680.6us
W20260709 13:17:43.445552 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:43.539443 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.612320 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.646065 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:43.654973 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.674154  9489 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:43.722653 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:43.844578 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:43.881784 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:43.972757 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:43.995702 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.208595 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.209462 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08002db620 after lost signal to thread 9492
W20260709 13:17:44.210529 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08003126a0 after lost signal to thread 10526
W20260709 13:17:44.211773 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3280 after lost signal to thread 10693
W20260709 13:17:44.214131 10764 debug-util.cc:398] Leaking SignalData structure 0x7b08001678c0 after lost signal to thread 10767
W20260709 13:17:44.215857 10764 debug-util.cc:398] Leaking SignalData structure 0x7b0800389180 after lost signal to thread 11442
W20260709 13:17:44.221845 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.238023 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.387135 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.435531 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.499435 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:44.533617 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:44.547215 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:44.567849 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.675160  9489 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:44.725425 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:44.785540 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:44.821990 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:44.846451 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 60122.5us
W20260709 13:17:44.922603 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:44.950943 11379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111) [suppressed 493 similar messages]
W20260709 13:17:45.021533 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.039923 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:45.078862 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.130698 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.250428 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.278054 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.281201 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.288362 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.355677 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.381960 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.390089 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.417675 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.485376 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.515409 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.524981 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.559026 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.561937 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.564563 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 099b1366ff5e4753be5bd192a535a9fe: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:45.581977 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.594424 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.676043  9489 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:45.793805 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.797221 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.812933 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.824579 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.858176 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.964563 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:45.985420 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.059508 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.093004 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.113669 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.278559 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.282743 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.347313 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.464320 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.477906 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.512749 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.552134 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.619208 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.630764 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.676512  9489 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:46.873585 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.902216 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.905042 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.977905 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:46.982838 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:46.999604 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.172125 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.217501 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:47.248265 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:47.273198 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.301036 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.427911 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.473903 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:47.545089 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.546577 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.677081  9489 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:47.724722 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.725241 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.778106 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.792716 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.840785 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.863778 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.910452 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:47.993842 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.014973 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.042431 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 77900us
W20260709 13:17:48.063711 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.094127 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.134248 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.180135 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.188369 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.268141 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.271394 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.253979 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.276847 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.353567 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 68446.5us
W20260709 13:17:48.374692 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.416478 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.437127 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.529027 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:48.540313 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.544004 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:48.628460 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.634756 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.677696  9489 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:48.700523 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:48.725507 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.871827 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.899194 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:48.908480 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:48.972450 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.103667 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.200848 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.312891 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.329598 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.427919 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.449116 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:49.495488 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.509830 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:49.565466 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.602360 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:49.626873 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:49.635259 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.678197  9489 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:49.833891 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:49.901625 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:49.915609 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:49.957477 11379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111) [suppressed 487 similar messages]
W20260709 13:17:49.959753 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:49.979482 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.163354 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.211299 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.244884 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.333698 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.347766 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.367995 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.443773 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.470352 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.444736 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 43554.3us
W20260709 13:17:50.559206 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.562444 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.573520 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.574004 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.586335 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.622588 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.629841 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.670258 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.678656  9489 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:50.806547 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.816185 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.893996 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.900283 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.918538 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.939899 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:50.957005 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.088596 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.123660 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.249744 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.330178 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.423403 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.494630 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.564072 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.606395 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:51.613082 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.679229  9489 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:51.712164 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.725556 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.745486 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.860044 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.886276 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.893525 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.901824 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.935213 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:51.943722 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:52.100214 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.191061 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.208585 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.257350 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.284881 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.379602 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:52.421656 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.479954 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:52.498674 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.588209 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:52.679724  9489 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:52.833753 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.032231 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.033004 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.038725 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.042246 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.074519 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.100368 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.106189 10708 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 78010.8us
W20260709 13:17:53.121201 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.143255 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.191700 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.208772 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.220775 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.252991 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.288908 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.325217 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:53.360682 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.362854 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.394877 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.489022 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.514997 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.515931 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.603394 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.680213  9489 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:53.691977 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.781404 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.807091 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:53.847702 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 099b1366ff5e4753be5bd192a535a9fe: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:53.866554 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800373320 after lost signal to thread 9492
W20260709 13:17:53.867659 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800265640 after lost signal to thread 10526
W20260709 13:17:53.868876 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080031d640 after lost signal to thread 10693
W20260709 13:17:53.869931 10690 debug-util.cc:398] Leaking SignalData structure 0x7b0800276c80 after lost signal to thread 10767
W20260709 13:17:53.871016 10690 debug-util.cc:398] Leaking SignalData structure 0x7b080003e880 after lost signal to thread 11442
W20260709 13:17:54.010227 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:54.680703  9489 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:55.244421 10632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111) [suppressed 399 similar messages]
I20260709 13:17:55.262533 16160 raft_consensus.cc:493] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.263622 16160 raft_consensus.cc:515] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.265902 10736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 1296) took 1129 ms. Trace:
I20260709 13:17:55.266343 10736 rpcz_store.cc:276] 0709 13:17:54.136328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.265049 (+1128721us) service_pool.cc:224] Handling call
0709 13:17:55.265354 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.265514 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.265537 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:55.265579 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:55.265610 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.265660 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.265755 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:55.267037 16160 leader_election.cc:290] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.268529 10666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35992 (request call id 3558) took 1094 ms. Trace:
I20260709 13:17:55.268913 10666 rpcz_store.cc:276] 0709 13:17:54.174104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.267727 (+1093623us) service_pool.cc:224] Handling call
0709 13:17:55.267997 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.268142 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.268158 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:55.268207 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:55.268236 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.268282 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.268379 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:55.366268 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:55.407833 16172 raft_consensus.cc:493] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.409195 16172 raft_consensus.cc:515] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.432132 16172 leader_election.cc:290] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.432874 16172 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.433768 16172 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.436482 16172 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.446589 16173 raft_consensus.cc:493] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.447661 16173 raft_consensus.cc:515] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.488598 16175 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.616598 16175 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.620433 16175 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.514266 16176 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.622022 16176 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.624818 16176 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.552559 16177 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.625908 16177 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.628757 16177 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.629437 16176 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.630493 16176 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.635648 16175 raft_consensus.cc:493] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.636816 16175 raft_consensus.cc:515] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.646908 16175 leader_election.cc:290] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.615396 16179 raft_consensus.cc:493] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.637795 16177 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.640729 16173 leader_election.cc:290] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.633664 16176 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:55.643193 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 202562us
I20260709 13:17:55.643941 16181 raft_consensus.cc:493] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.614187 16178 raft_consensus.cc:493] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.612787 16180 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.666023 16159 raft_consensus.cc:493] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.437008 16172 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.671942 16159 raft_consensus.cc:515] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.650247 16158 raft_consensus.cc:493] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.673694 16177 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.650245 16167 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.675222 16164 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:17:55.682848  9489 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 10615)
I20260709 13:17:55.683406 16164 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.685686 16158 raft_consensus.cc:515] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.675926 16160 raft_consensus.cc:493] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.688753 16160 raft_consensus.cc:515] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.689628 16177 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.689471 16181 raft_consensus.cc:515] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.666478 16180 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.666471 16178 raft_consensus.cc:515] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.692792 16181 leader_election.cc:290] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.679560 16173 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.694161 16173 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.682861 16167 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.681725 16179 raft_consensus.cc:515] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.697960 16167 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.699029 16164 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.709401 16184 raft_consensus.cc:493] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.710011 16186 raft_consensus.cc:493] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.710649 16184 raft_consensus.cc:515] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.710843 16186 raft_consensus.cc:515] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.685035 16159 leader_election.cc:290] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.715876 16183 raft_consensus.cc:493] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.716717 16183 raft_consensus.cc:515] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.717811 16186 leader_election.cc:290] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.719547 16183 leader_election.cc:290] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.708226 16158 leader_election.cc:290] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.719903 16179 leader_election.cc:290] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.723140 16183 raft_consensus.cc:493] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.723541 16172 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.724433 16183 raft_consensus.cc:515] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.726493 16172 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.727208 16183 leader_election.cc:290] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:55.727221 10633 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.612s	user 0.020s	sys 0.027s
W20260709 13:17:55.736963 10633 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.020s	sys 0.027s
I20260709 13:17:55.737553 16169 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.738456 16169 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.741954 16158 raft_consensus.cc:493] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.764102 16184 leader_election.cc:290] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.761353 16158 raft_consensus.cc:515] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.767057 16158 leader_election.cc:290] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.743165 16176 raft_consensus.cc:493] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.770304 16176 raft_consensus.cc:515] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.809926 16163 raft_consensus.cc:493] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.810766 16163 raft_consensus.cc:515] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.813514 16191 raft_consensus.cc:493] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.814334 16191 raft_consensus.cc:515] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.816764 16164 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.817684 16164 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.773432 16186 raft_consensus.cc:493] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.821074 16186 raft_consensus.cc:515] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.813274 16163 leader_election.cc:290] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.845840 16183 raft_consensus.cc:493] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.846391 16159 raft_consensus.cc:493] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.846601 16183 raft_consensus.cc:515] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.847193 16159 raft_consensus.cc:515] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.848841 16183 leader_election.cc:290] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.823730 16178 leader_election.cc:290] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.850522 16179 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.775787 16180 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.773304 16176 leader_election.cc:290] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.851292 16179 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.823659 16186 leader_election.cc:290] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.843928 16164 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.863181 16191 leader_election.cc:290] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.863287 16167 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.866604 16160 leader_election.cc:290] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.866984 16167 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.868676 16164 raft_consensus.cc:493] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.869273 16167 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.869493 16164 raft_consensus.cc:515] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.873761 16168 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.874521 16168 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.876483 16170 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.876801 16169 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.877427 16169 raft_consensus.cc:493] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.877290 16170 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.878063 16169 raft_consensus.cc:515] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.878434 16168 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.878681 16173 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.880076 16169 leader_election.cc:290] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.885236 16181 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.871225 16176 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.902186 16176 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.902282 16181 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.907713 16169 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.907886 16170 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.908239 16190 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.908499 16170 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.908367 16169 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.908797 16181 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.909111 16170 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.909740 16182 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.909969 16168 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.910413 16182 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.910686 16168 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.911536 16170 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.912719 16182 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.912958 16168 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.914908 16169 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.908990 16190 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.915223 16164 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:55.918044 16192 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.921624 16171 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
W20260709 13:17:55.913550 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 47238.4us
I20260709 13:17:55.922135 16167 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:55.931321 16167 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.933911 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.926307 16182 raft_consensus.cc:493] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:55.933795 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.925545 16179 leader_election.cc:290] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.924259 16159 leader_election.cc:290] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.935515 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.948376 16190 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.938048 16171 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.940497 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.940279 16192 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:55.950572 16171 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.952076 16192 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.935331 16182 raft_consensus.cc:515] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:55.953704 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.954555 16182 leader_election.cc:290] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.955130 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.945166 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b40fb00bae3d4baa92d6e9276011a816" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:55.946592 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e29890b8e04ddca3426014b2514656" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:55.941798 10632 consensus_peers.cc:597] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:55.955415 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.955868 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aab7d76cb3149698a925aad05e45589" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.956944 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b107ac4e22944b388450acfe815a08e" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.965977 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.967007 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.971390 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.967036 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602f135686c6438ea75a7b4f28a2625d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.972846 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb4252c2cb946b2833f090b57f26ad4" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.968647 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1a927fea2843f890fde9160ee8b796" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.956476 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20723d90fba84eedaeb069a608e6a40f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.925936 16176 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:55.969810 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f325308e46064da6807ac7edc8a20717" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.969650 16167 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:55.969624 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db1ee475344550afb0eaebc5046df6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:17:55.988847 11382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 50509.1us
I20260709 13:17:55.996897 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c293ace9b264b57b21dd6b308e25a1f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:55.998257 10743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bb31da8c4c4ef8a1530905a2369172" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:55.998893 16164 raft_consensus.cc:493] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.999396 16195 raft_consensus.cc:493] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:55.999607 16164 raft_consensus.cc:515] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.000102 16195 raft_consensus.cc:515] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.001590 16162 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:56.002334 16162 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.002861 16164 leader_election.cc:290] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:56.004667 16162 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:56.012603 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b691cd466c7645fbba119f2344854ddb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.013147 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c98bbebd7a849a6b0596781b7853ce3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.014187 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.019341 16199 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:56.019975 16199 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.024809 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.025094 16195 leader_election.cc:290] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:56.030556 16195 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:56.030920 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa932526573f47178aa5a402a17388ad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.031443 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cf3c0497064f47ad08a6d5a7a28853" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.031138 16195 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.023603 16159 raft_consensus.cc:493] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:56.032680 10666 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:56.034029 16158 raft_consensus.cc:493] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:56.034267 16193 raft_consensus.cc:493] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:56.033069 16159 raft_consensus.cc:515] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } attrs { replace: true } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.034806 16158 raft_consensus.cc:515] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.034992 16193 raft_consensus.cc:515] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } attrs { replace: true } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.037557 16159 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.038326 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2298132784d24fb2b78c3a21c68a9d40" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.043742 16196 raft_consensus.cc:493] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:56.044415 16196 raft_consensus.cc:515] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.025300 16179 raft_consensus.cc:493] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:56.037392 16158 leader_election.cc:290] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.045667 16179 raft_consensus.cc:515] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.046557 16196 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.047919 16179 leader_election.cc:290] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.038185 16193 leader_election.cc:290] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.051343 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.051959 10663 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 9.
I20260709 13:17:56.057729 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.060585 16195 leader_election.cc:290] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:56.061853 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d22506ba0474e93940b67cdd5d59af6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.066246 16163 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
I20260709 13:17:56.066943 16163 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.069031 16163 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:17:56.069260 10632 leader_election.cc:336] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.070132 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.070791 16197 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:56.071467 16197 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.076161 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81565cb1f2054410aae97284b914f79c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.077600 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.079046 16199 leader_election.cc:290] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:56.079917 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.084991 11417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf67a9a92d14fbeaf459c21b6c42278" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.085364 10669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaf88905a8f4cc8bf8e751c1f163180" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.087844 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.088924 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.089413 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.090298 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae2b9cd744b4a2bba38c92a5f4b94f3" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.092366 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.092729 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7624b04076142a0bbf29cbbf066c4bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.092947 11411 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18f1a9f5e66846dba474825fb5b2b784 in term 13.
I20260709 13:17:56.095597 11410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e246154849412a97842c9d673bd0a8" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.094759 11412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ac19ea4edd4e26890c806619f5b551" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.100589 11409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63a40a747147e987c1c81889fd1a0d" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.100806 11411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.093921 11418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b98b9d27524f83a9b567dee7f0718f" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.103821 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.110385 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2904e05a1d154393bc63b07589fd6537" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.111799 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.116690 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3bc7fc30ef40e79df7e6a1bfdcb227" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.096639 11415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456c58bcf67c4357b892184c57ce7e09" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.099056 11416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.117835 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a3acb5ddc84e7e91b896e4a278cec7" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.093750 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.105898 16197 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:56.125221 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3e32279b914c319fcf8afa158efa9c" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.125792 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:56.134639 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 75345.5us
I20260709 13:17:56.141549 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16782ce53741e19df4f216701c641a" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.142597 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee360fe4b438464d8580245f06181d8f" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.143661 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.144759 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13f2688a0464257b5162c27e06aeaad" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.145825 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55846c170448461696e53d2649ed09d8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.146342 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed347880eeb491baa0d6d22c5964d18" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.147395 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b930877bb3e45ff96d2babd2b0f8bc8" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:56.148094 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:56.148507 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
W20260709 13:17:56.148702 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.150262 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.145869 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939b0eadbf7c4b4e842fc542cbaae675" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.152971 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7247478c2fbc418f85cf61569e673a75" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.157495 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.159790 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.161787 11381 leader_election.cc:304] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.161912 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.164243 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0958810fe1d74c67af02bd74dc0488bb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:56.168947 10632 leader_election.cc:336] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.181607 10632 leader_election.cc:336] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.171277 16199 raft_consensus.cc:2749] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.182610 11381 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.183167 10632 leader_election.cc:336] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.183830 10632 leader_election.cc:336] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.184373 10632 leader_election.cc:336] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.184871 10632 leader_election.cc:336] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.185424 10632 leader_election.cc:336] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.185658 16195 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:56.185968 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:56.186530 10632 leader_election.cc:336] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.186908 11381 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.187126 10632 leader_election.cc:336] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.187870 10632 leader_election.cc:336] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.188369 10632 leader_election.cc:336] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.188880 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:56.189530 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.189920 10708 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:56.190747 16167 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:56.191104 16167 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:56.191462 16167 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:56.198772 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:56.199565 10632 leader_election.cc:336] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.200069 10632 leader_election.cc:336] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.205636 16195 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.207439 10632 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22; no voters: 
I20260709 13:17:56.208295 16179 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:56.208684 16179 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fac2164a6f874d7dbd29db83a7cf019b)
W20260709 13:17:56.178629 11379 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.170840 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.209056 16179 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.216482 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a5bdce0f0846e2a7f8c9c6f36d560e" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.217723 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.220227 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:56.221467 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f08f529e274f3799aa41f54ca844f9" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
W20260709 13:17:56.221915 11379 leader_election.cc:336] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.222332 11379 leader_election.cc:304] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.223136 16195 raft_consensus.cc:2749] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:56.224196 11379 leader_election.cc:336] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.224592 11379 leader_election.cc:304] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.225262 16195 raft_consensus.cc:2749] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.227093 10632 leader_election.cc:304] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.230322 16193 raft_consensus.cc:2749] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:56.231984 10632 leader_election.cc:304] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.229213 16179 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.237468 16179 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Requested vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.238000 16193 raft_consensus.cc:2749] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:56.238843 16176 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:56.238873 10632 leader_election.cc:304] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.239465 16176 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:56.240155 16193 raft_consensus.cc:2749] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.242071 16176 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:56.243644 10708 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:56.244486 16176 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:56.244858 16176 raft_consensus.cc:493] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:56.245250 16176 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.200259 16167 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.255686 16167 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:56.257351 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
W20260709 13:17:56.259665 10632 leader_election.cc:336] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.260165 10632 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.260492 16176 raft_consensus.cc:515] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.260967 16179 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:56.261713 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08003da140 after lost signal to thread 9492
W20260709 13:17:56.263188 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800340b20 after lost signal to thread 10526
W20260709 13:17:56.264763 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08003338a0 after lost signal to thread 10693
W20260709 13:17:56.266090 11439 debug-util.cc:398] Leaking SignalData structure 0x7b08001671e0 after lost signal to thread 10767
W20260709 13:17:56.267740 11439 debug-util.cc:398] Leaking SignalData structure 0x7b0800283ec0 after lost signal to thread 11442
W20260709 13:17:56.277499 10632 leader_election.cc:336] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.278029 10632 leader_election.cc:304] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.278805 16179 raft_consensus.cc:2749] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:56.279917 10632 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.283694 10632 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.237103 11381 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.284718 16195 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:56.285619 11381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:33499, user_credentials={real_user=slave}} blocked reactor thread for 78873.6us
I20260709 13:17:56.286509 16179 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:56.287916 10632 leader_election.cc:336] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.293154 10632 leader_election.cc:304] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.295778 16179 raft_consensus.cc:2749] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:56.296972 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.291611 11379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 67427.6us
I20260709 13:17:56.294941 11381 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.302472 11379 leader_election.cc:336] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.302843 16195 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.304286 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.305681 16195 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.302870 11379 leader_election.cc:304] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.307739 10706 leader_election.cc:336] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.308146 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:56.308971 10706 leader_election.cc:336] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.309367 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.310019 16182 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.310623 16182 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.311275 16195 raft_consensus.cc:2749] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:56.312264 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.312676 11379 leader_election.cc:336] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.312759 11381 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.318042 16195 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.320086 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.321529 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5351bf3c5fe147f7b60882433345dd0b" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.322907 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:56.324594 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db5b0c3da3b45289300a692b98fa1c1" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:56.327921 16176 leader_election.cc:290] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
W20260709 13:17:56.329934 10706 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.330361 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:56.331162 10706 leader_election.cc:336] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.331606 10706 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.331928 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.332439 11381 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.333542 16195 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.334841 11381 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.336079 10660 raft_consensus.cc:1240] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Rejecting Update request from peer fac2164a6f874d7dbd29db83a7cf019b for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:56.340576 10667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:56.346228 16195 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.346823 16167 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.347469 16167 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:56.348459 10706 leader_election.cc:336] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.348914 10706 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.349246 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:56.350080 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.354200 16176 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:56.361400 10632 consensus_peers.cc:597] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.368903 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:56.369364 10706 leader_election.cc:336] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.395527 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6d3a109d6054b8ba7b3b1ff65909ade" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.396492 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e922c08ea15b4851815093b0021df81c" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.394681 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:56.398257 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e245cc261b6415fac3d372489a49ceb" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.400112 10741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c470d1bf042369166e3a795c3e963" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.401983 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd88b6bef8141f2a7c75714e0233dfd" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:56.398294 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:56.417804 10635 leader_election.cc:304] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.421792 10635 leader_election.cc:304] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.422094 16158 raft_consensus.cc:2749] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.423269 10635 leader_election.cc:304] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.423388 16158 raft_consensus.cc:2749] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.424084 16158 raft_consensus.cc:2749] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.424337 10635 leader_election.cc:304] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.444145 10632 consensus_peers.cc:597] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:56.460260 16193 raft_consensus.cc:2749] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.461658 10635 leader_election.cc:304] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.463511 16193 raft_consensus.cc:2749] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.464967 10635 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.465464 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:56.467348 10706 leader_election.cc:304] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.468062 16176 raft_consensus.cc:2749] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.469201 10706 leader_election.cc:304] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.469300 16193 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.469743 10740 raft_consensus.cc:1240] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:56.471174 16198 consensus_queue.cc:1059] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:56.472182 16198 raft_consensus.cc:3055] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:56.472512 16198 raft_consensus.cc:740] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
W20260709 13:17:56.473341 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.474277 16182 raft_consensus.cc:2749] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.473577 16198 consensus_queue.cc:260] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.476889 16198 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.485044 10706 leader_election.cc:304] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.488233 10635 leader_election.cc:304] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
W20260709 13:17:56.490937 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:56.528225 10635 leader_election.cc:304] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.529667 10635 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.530375 16179 raft_consensus.cc:2749] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.531145 16179 raft_consensus.cc:2749] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.531786 16179 raft_consensus.cc:2749] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.532919 10635 leader_election.cc:304] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.534060 10635 leader_election.cc:304] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.534710 16180 raft_consensus.cc:2749] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.535181 10635 leader_election.cc:304] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.535530 16180 raft_consensus.cc:2749] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.536216 16196 raft_consensus.cc:2749] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.537822 10635 leader_election.cc:304] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.540216 10635 leader_election.cc:304] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.540895 16179 raft_consensus.cc:2749] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.541591 16179 raft_consensus.cc:2749] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:56.542348 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:56.544224 16176 raft_consensus.cc:2749] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:56.545499 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 60528.9us
I20260709 13:17:56.546380 10706 leader_election.cc:304] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.547854 10635 leader_election.cc:304] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.549124 16159 raft_consensus.cc:2749] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.555823 16176 raft_consensus.cc:2749] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.556777 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.562542 16176 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.566135 10706 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.568028 11414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2efcf18c8e45be8aebbfa42f61e9f5" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:56.568547 16169 consensus_queue.cc:1059] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:56.569614 16169 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.571125 16169 raft_consensus.cc:3055] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:56.571470 16169 raft_consensus.cc:740] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:56.572749 16169 consensus_queue.cc:260] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.574911 16169 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.578392 11414 raft_consensus.cc:2468] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 10.
W20260709 13:17:56.583443 10706 leader_election.cc:336] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.594648 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:56.606796 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.611685 16169 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:56.612725 10706 leader_election.cc:336] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.615509 10706 leader_election.cc:304] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.618868 16169 raft_consensus.cc:2749] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.631490 10635 leader_election.cc:304] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.639518 16193 raft_consensus.cc:2749] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.640817 10635 leader_election.cc:304] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.642377 16193 raft_consensus.cc:2749] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:56.646490 10632 consensus_peers.cc:597] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:17:56.649370 10740 raft_consensus.cc:1240] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Rejecting Update request from peer e71e2e44af1e46d8a8423ae08646bc22 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:56.644181 10635 leader_election.cc:304] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.650837 16198 consensus_queue.cc:1059] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:56.651849 16198 raft_consensus.cc:3055] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:56.652170 16198 raft_consensus.cc:740] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:56.653079 16198 consensus_queue.cc:260] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:56.655857 16198 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.666585 16193 raft_consensus.cc:2749] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.669786 10635 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784; no voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:17:56.670440 16193 raft_consensus.cc:2749] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:56.683370  9489 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 10615)
W20260709 13:17:56.682334 10706 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.684103 10706 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.684764 16169 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:56.687433 10706 leader_election.cc:336] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.687808 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.688578 16169 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:56.689769 10706 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.690193 10706 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.690982 16169 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:56.691864 10706 leader_election.cc:336] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:56.692659 10706 leader_election.cc:336] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.693053 10706 leader_election.cc:304] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, e71e2e44af1e46d8a8423ae08646bc22
I20260709 13:17:56.693759 16169 raft_consensus.cc:2749] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:56.694622 10706 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.695037 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.695904 16169 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:56.696910 10706 leader_election.cc:336] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.697384 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.698127 16169 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:56.699146 10706 leader_election.cc:336] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.699591 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.700289 16169 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:56.701233 10706 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.701700 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.702466 16169 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:56.704716 10706 leader_election.cc:336] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.705181 10706 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.705930 16169 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:56.707029 10706 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.707491 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.708221 16169 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:56.709335 10706 leader_election.cc:336] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.709761 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.710438 16169 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:56.718631 10706 leader_election.cc:336] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.719063 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.719877 16169 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.739495 10706 leader_election.cc:304] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:56.740286 16169 raft_consensus.cc:2804] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.740746 16169 raft_consensus.cc:697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:56.741727 16169 consensus_queue.cc:237] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:56.764135 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.849629 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.921504 10632 consensus_peers.cc:597] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.935437 10632 consensus_peers.cc:597] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:56.935936 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 126811us
W20260709 13:17:56.958252 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:56.967651 10485 catalog_manager.cc:5697] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 9 to 10, leader changed from e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 10 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:57.071820 10632 consensus_peers.cc:597] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.139031 10632 consensus_peers.cc:597] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.139389 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.159060 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.159724 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.186177 10632 consensus_peers.cc:597] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.208112 11414 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:57.209743 16169 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:57.254773 10667 raft_consensus.cc:3060] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:57.269550 10632 consensus_peers.cc:597] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.277832 10667 raft_consensus.cc:1275] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:57.313081 16176 consensus_queue.cc:1048] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:57.394968 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.398118 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.417798 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.427790 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.446547 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:57.499679 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.537608 10632 consensus_peers.cc:597] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.606990 10632 consensus_peers.cc:597] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.662490 10632 consensus_peers.cc:597] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.711138 16167 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.711684 16167 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:57.715531 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:57.716117 10668 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 14.
I20260709 13:17:57.717564 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:57.718547 16176 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.719013 16176 raft_consensus.cc:493] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.716084 16167 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:57.719412 16176 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.720573 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:57.721251 11413 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:17:57.735498 16176 raft_consensus.cc:515] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:57.739012 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
I20260709 13:17:57.739512 10668 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.742153 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099b1366ff5e4753be5bd192a535a9fe" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:17:57.742877 11413 raft_consensus.cc:3060] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.746142 10668 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
I20260709 13:17:57.747449 10708 leader_election.cc:304] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:57.748662 16167 raft_consensus.cc:2804] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:57.749141 16167 raft_consensus.cc:697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:17:57.749965 16167 consensus_queue.cc:237] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:57.762943 16176 leader_election.cc:290] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:57.765882 11413 raft_consensus.cc:2468] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 15.
W20260709 13:17:57.772040 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.778270 10488 catalog_manager.cc:5697] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.804005 16208 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.804647 16208 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:57.807149 16208 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:57.808066 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784" is_pre_election: true
I20260709 13:17:57.810128 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:57.810828 10735 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 14.
I20260709 13:17:57.812207 11382 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
I20260709 13:17:57.813238 16208 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.813643 16208 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.813958 16208 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.822752 16208 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:57.825148 16208 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
I20260709 13:17:57.826570 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b"
I20260709 13:17:57.827111 10735 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.827380 10668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "18f1a9f5e66846dba474825fb5b2b784"
W20260709 13:17:57.829612 10632 consensus_peers.cc:597] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:57.838714 10735 raft_consensus.cc:2468] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e71e2e44af1e46d8a8423ae08646bc22 in term 15.
I20260709 13:17:57.844210 11382 leader_election.cc:304] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:57.845444 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.845959 16208 raft_consensus.cc:2804] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:57.848088 16208 raft_consensus.cc:697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Becoming Leader. State: Replica: e71e2e44af1e46d8a8423ae08646bc22, State: Running, Role: LEADER
I20260709 13:17:57.849191 16208 consensus_queue.cc:237] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:17:57.905628 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:57.940304 10632 consensus_peers.cc:597] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:57.950068 10488 catalog_manager.cc:5697] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e71e2e44af1e46d8a8423ae08646bc22" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:58.030165 10632 consensus_peers.cc:597] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:58.071126 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:58.197407 16209 raft_consensus.cc:493] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e71e2e44af1e46d8a8423ae08646bc22)
I20260709 13:17:58.199573 16209 raft_consensus.cc:515] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:17:58.211879 16209 leader_election.cc:290] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:17:58.235292 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
I20260709 13:17:58.236063 10735 raft_consensus.cc:2368] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:58.240406 10635 leader_election.cc:400] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:58.240708 10635 leader_election.cc:403] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.241302 16193 raft_consensus.cc:3060] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.252065 16193 raft_consensus.cc:2749] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771) with higher term. Message: Invalid argument: T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18f1a9f5e66846dba474825fb5b2b784 for earlier term 14. Current term is 15.
I20260709 13:17:58.273124 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f93e93739544bc8c7af65e566a65d6" candidate_uuid: "18f1a9f5e66846dba474825fb5b2b784" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:17:58.289616  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
W20260709 13:17:58.306418 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:58.405871 10668 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.410295 16208 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:58.431720 10735 raft_consensus.cc:1275] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Refusing update from remote peer e71e2e44af1e46d8a8423ae08646bc22: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.434459 16208 consensus_queue.cc:1048] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:58.435768 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 91819.1us
W20260709 13:17:58.433871 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:35619, user_credentials={real_user=slave}} blocked reactor thread for 63536.4us
I20260709 13:17:58.455780  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
W20260709 13:17:58.487574 10706 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:58.513484 11381 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.553998 11413 raft_consensus.cc:1275] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Refusing update from remote peer fac2164a6f874d7dbd29db83a7cf019b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.567365 16234 consensus_queue.cc:1048] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:58.572168 10706 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:58.586288 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:58.589497 10632 consensus_peers.cc:597] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:58.595680 10635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:32771, user_credentials={real_user=slave}} blocked reactor thread for 56946.9us
W20260709 13:17:58.595969 10632 consensus_peers.cc:597] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:58.602401 10632 consensus_peers.cc:597] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:58.619786 10706 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:58.621779 10708 consensus_peers.cc:597] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.622896 10708 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.623422 10708 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.637912 11381 consensus_peers.cc:597] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.628681 10708 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.638695 10632 consensus_peers.cc:597] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:58.642791 10708 consensus_peers.cc:597] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.648641 10708 consensus_peers.cc:597] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.661404 10632 consensus_peers.cc:597] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:58.666414 10708 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.670403 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:17:58.680420  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:58.682170  9489 tablet_replica.cc:333] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.682996  9489 raft_consensus.cc:2243] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.686394  9489 raft_consensus.cc:2272] T 5351bf3c5fe147f7b60882433345dd0b P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.688938  9489 tablet_replica.cc:333] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.689724  9489 raft_consensus.cc:2243] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.690595  9489 raft_consensus.cc:2272] T a78c470d1bf042369166e3a795c3e963 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.693186  9489 tablet_replica.cc:333] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.693948  9489 raft_consensus.cc:2243] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.694883  9489 raft_consensus.cc:2272] T ee360fe4b438464d8580245f06181d8f P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.697664  9489 tablet_replica.cc:333] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.698354  9489 raft_consensus.cc:2243] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.699446  9489 raft_consensus.cc:2272] T fa932526573f47178aa5a402a17388ad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.705948  9489 tablet_replica.cc:333] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.706650  9489 raft_consensus.cc:2243] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.707679  9489 raft_consensus.cc:2272] T 8e245cc261b6415fac3d372489a49ceb P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.710104  9489 tablet_replica.cc:333] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.710779  9489 raft_consensus.cc:2243] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.711437  9489 raft_consensus.cc:2272] T feaf88905a8f4cc8bf8e751c1f163180 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.713833  9489 tablet_replica.cc:333] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.714533  9489 raft_consensus.cc:2243] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.715476  9489 raft_consensus.cc:2272] T 251650397d264ac1a42a2fde5932424f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.717803  9489 tablet_replica.cc:333] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.718549  9489 raft_consensus.cc:2243] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.719123  9489 raft_consensus.cc:2272] T edb4252c2cb946b2833f090b57f26ad4 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.721688  9489 tablet_replica.cc:333] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.722435  9489 raft_consensus.cc:2243] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.722991  9489 raft_consensus.cc:2272] T 602f135686c6438ea75a7b4f28a2625d P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.730757 11381 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.731019  9489 tablet_replica.cc:333] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
W20260709 13:17:58.731019 10708 consensus_peers.cc:597] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.731913  9489 raft_consensus.cc:2243] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.732860  9489 raft_consensus.cc:2272] T 939b0eadbf7c4b4e842fc542cbaae675 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.734297 10708 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.735584  9489 tablet_replica.cc:333] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.736389  9489 raft_consensus.cc:2243] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:17:58.737365 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:17:58.737510  9489 raft_consensus.cc:2272] T 7485460ddbcb4574882c669f7bdbbf47 P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.741184  9489 tablet_replica.cc:333] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.742053  9489 raft_consensus.cc:2243] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.743095  9489 raft_consensus.cc:2272] T b8e29890b8e04ddca3426014b2514656 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.745620  9489 tablet_replica.cc:333] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.746371  9489 raft_consensus.cc:2243] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.747141  9489 raft_consensus.cc:2272] T d9ac19ea4edd4e26890c806619f5b551 P 18f1a9f5e66846dba474825fb5b2b784 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.749517  9489 tablet_replica.cc:333] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.750295  9489 raft_consensus.cc:2243] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.750907  9489 raft_consensus.cc:2272] T 6aab7d76cb3149698a925aad05e45589 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.753582  9489 tablet_replica.cc:333] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.754292  9489 raft_consensus.cc:2243] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.755265  9489 raft_consensus.cc:2272] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.758567  9489 tablet_replica.cc:333] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.759323  9489 raft_consensus.cc:2243] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.759936  9489 raft_consensus.cc:2272] T 27b7b057c54346c0b47758f08031d007 P 18f1a9f5e66846dba474825fb5b2b784 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.760653 10708 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.762630  9489 tablet_replica.cc:333] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.763397  9489 raft_consensus.cc:2243] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.763950  9489 raft_consensus.cc:2272] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.766286  9489 tablet_replica.cc:333] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.767072  9489 raft_consensus.cc:2243] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.767760  9489 raft_consensus.cc:2272] T 5b107ac4e22944b388450acfe815a08e P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.768982 10708 consensus_peers.cc:597] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.770449  9489 tablet_replica.cc:333] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.771251  9489 raft_consensus.cc:2243] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.771921  9489 raft_consensus.cc:2272] T 6f1a927fea2843f890fde9160ee8b796 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.774674  9489 tablet_replica.cc:333] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.775424  9489 raft_consensus.cc:2243] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.776113  9489 raft_consensus.cc:2272] T 75bb31da8c4c4ef8a1530905a2369172 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.778713  9489 tablet_replica.cc:333] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.779439  9489 raft_consensus.cc:2243] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.780083  9489 raft_consensus.cc:2272] T 0958810fe1d74c67af02bd74dc0488bb P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.781503 10706 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:58.782707  9489 tablet_replica.cc:333] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.783510  9489 raft_consensus.cc:2243] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.784555  9489 raft_consensus.cc:2272] T 63a3acb5ddc84e7e91b896e4a278cec7 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.787011  9489 tablet_replica.cc:333] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.787678  9489 raft_consensus.cc:2243] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.788709  9489 raft_consensus.cc:2272] T 7bd88b6bef8141f2a7c75714e0233dfd P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.791366  9489 tablet_replica.cc:333] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.792091  9489 raft_consensus.cc:2243] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.792922  9489 raft_consensus.cc:2272] T 9d1c58f717d74f2fba0ed73c78de0673 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.792982 11381 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.795535  9489 tablet_replica.cc:333] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.796360  9489 raft_consensus.cc:2243] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.796958  9489 raft_consensus.cc:2272] T e1e246154849412a97842c9d673bd0a8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.799484  9489 tablet_replica.cc:333] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.800225  9489 raft_consensus.cc:2243] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:58.803025 10708 consensus_peers.cc:597] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.810902 11381 consensus_peers.cc:597] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.800870  9489 raft_consensus.cc:2272] T 20723d90fba84eedaeb069a608e6a40f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.813711  9489 tablet_replica.cc:333] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
W20260709 13:17:58.818912 10708 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.818902  9489 raft_consensus.cc:2243] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.820353  9489 raft_consensus.cc:2272] T 0db5b0c3da3b45289300a692b98fa1c1 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.823017  9489 tablet_replica.cc:333] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
W20260709 13:17:58.823563 11381 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.823812  9489 raft_consensus.cc:2243] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.824723  9489 raft_consensus.cc:2272] T e922c08ea15b4851815093b0021df81c P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.827590  9489 tablet_replica.cc:333] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.828362  9489 raft_consensus.cc:2243] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.829103  9489 raft_consensus.cc:2272] T 3d63a40a747147e987c1c81889fd1a0d P 18f1a9f5e66846dba474825fb5b2b784 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.831724  9489 tablet_replica.cc:333] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.832449  9489 raft_consensus.cc:2243] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.833536  9489 raft_consensus.cc:2272] T 62cf3c0497064f47ad08a6d5a7a28853 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.836503  9489 tablet_replica.cc:333] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.837225  9489 raft_consensus.cc:2243] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.839211  9489 raft_consensus.cc:2272] T 2d16782ce53741e19df4f216701c641a P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.841737  9489 tablet_replica.cc:333] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.842438  9489 raft_consensus.cc:2243] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.843372  9489 raft_consensus.cc:2272] T 2904e05a1d154393bc63b07589fd6537 P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.846102  9489 tablet_replica.cc:333] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.846829  9489 raft_consensus.cc:2243] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:58.847000 10708 consensus_peers.cc:597] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.847647  9489 raft_consensus.cc:2272] T f7624b04076142a0bbf29cbbf066c4bb P 18f1a9f5e66846dba474825fb5b2b784 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.850220  9489 tablet_replica.cc:333] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.850942  9489 raft_consensus.cc:2243] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.852149  9489 raft_consensus.cc:2272] T 5c293ace9b264b57b21dd6b308e25a1f P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.854682  9489 tablet_replica.cc:333] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.855398  9489 raft_consensus.cc:2243] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.856385  9489 raft_consensus.cc:2272] T d13f2688a0464257b5162c27e06aeaad P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.858038 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:58.857563 11381 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.858863  9489 tablet_replica.cc:333] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.859748  9489 raft_consensus.cc:2243] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.860500  9489 raft_consensus.cc:2272] T 72b98b9d27524f83a9b567dee7f0718f P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.863030  9489 tablet_replica.cc:333] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.863737  9489 raft_consensus.cc:2243] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.864428  9489 raft_consensus.cc:2272] T 7247478c2fbc418f85cf61569e673a75 P 18f1a9f5e66846dba474825fb5b2b784 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.866696  9489 tablet_replica.cc:333] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.867550  9489 raft_consensus.cc:2243] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.868129  9489 raft_consensus.cc:2272] T b691cd466c7645fbba119f2344854ddb P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.870484  9489 tablet_replica.cc:333] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
W20260709 13:17:58.870455 11381 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.872169  9489 raft_consensus.cc:2243] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.873139  9489 raft_consensus.cc:2272] T f325308e46064da6807ac7edc8a20717 P 18f1a9f5e66846dba474825fb5b2b784 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.873443 10708 consensus_peers.cc:597] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.876497  9489 tablet_replica.cc:333] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.877301  9489 raft_consensus.cc:2243] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.878944  9489 raft_consensus.cc:2272] T b40fb00bae3d4baa92d6e9276011a816 P 18f1a9f5e66846dba474825fb5b2b784 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.881917  9489 tablet_replica.cc:333] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.882658  9489 raft_consensus.cc:2243] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:17:58.882684 10708 consensus_peers.cc:597] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.884123  9489 raft_consensus.cc:2272] T 9d22506ba0474e93940b67cdd5d59af6 P 18f1a9f5e66846dba474825fb5b2b784 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.856515 10706 consensus_peers.cc:597] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:17:58.886620  9489 tablet_replica.cc:333] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.887377  9489 raft_consensus.cc:2243] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.888470  9489 raft_consensus.cc:2272] T 099b1366ff5e4753be5bd192a535a9fe P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.891064  9489 tablet_replica.cc:333] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.891783  9489 raft_consensus.cc:2243] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.892433  9489 raft_consensus.cc:2272] T 6d3e32279b914c319fcf8afa158efa9c P 18f1a9f5e66846dba474825fb5b2b784 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.894755  9489 tablet_replica.cc:333] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.895507  9489 raft_consensus.cc:2243] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:17:58.896251 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:17:58.896901  9489 raft_consensus.cc:2272] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P 18f1a9f5e66846dba474825fb5b2b784 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.899485  9489 tablet_replica.cc:333] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.900118  9489 raft_consensus.cc:2243] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.901022  9489 pending_rounds.cc:70] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Trying to abort 1 pending ops.
I20260709 13:17:58.901279  9489 pending_rounds.cc:77] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784: Aborting op as it isn't in flight: id { term: 15 index: 12 } timestamp: 7305638206881308672 op_type: NO_OP noop_request { }
I20260709 13:17:58.901661  9489 raft_consensus.cc:2889] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:58.901984  9489 raft_consensus.cc:2272] T 86f93e93739544bc8c7af65e566a65d6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.905012  9489 tablet_replica.cc:333] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.905709  9489 raft_consensus.cc:2243] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.906244  9489 raft_consensus.cc:2272] T 94a8b7e07671442dafc4c3dcb271d352 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.908651  9489 tablet_replica.cc:333] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.909231  9489 raft_consensus.cc:2243] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.910274  9489 raft_consensus.cc:2272] T 55846c170448461696e53d2649ed09d8 P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.912582  9489 tablet_replica.cc:333] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.913188  9489 raft_consensus.cc:2243] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.914230  9489 raft_consensus.cc:2272] T 3ed347880eeb491baa0d6d22c5964d18 P 18f1a9f5e66846dba474825fb5b2b784 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.916803  9489 tablet_replica.cc:333] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.917428  9489 raft_consensus.cc:2243] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.917906  9489 raft_consensus.cc:2272] T d6db1ee475344550afb0eaebc5046df6 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.920110  9489 tablet_replica.cc:333] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.920780  9489 raft_consensus.cc:2243] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:58.921788  9489 raft_consensus.cc:2272] T 1b930877bb3e45ff96d2babd2b0f8bc8 P 18f1a9f5e66846dba474825fb5b2b784 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:58.924021  9489 tablet_replica.cc:333] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784: stopping tablet replica
I20260709 13:17:58.924633  9489 raft_consensus.cc:2243] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:58.925199  9489 raft_consensus.cc:2272] T e6d3a109d6054b8ba7b3b1ff65909ade P 18f1a9f5e66846dba474825fb5b2b784 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:58.946086 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:58.953516 11381 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.958698 10708 consensus_peers.cc:597] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.984869 10708 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.992008 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:41805, user_credentials={real_user=slave}} blocked reactor thread for 57778.2us
W20260709 13:17:59.008366 10708 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:59.029285 10706 consensus_peers.cc:597] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.041441 10708 consensus_peers.cc:597] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:59.150225 11379 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.379473 11379 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.505820 11379 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.532729 10706 consensus_peers.cc:597] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.612478 10706 consensus_peers.cc:597] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:17:59.818938 16240 raft_consensus.cc:493] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.819495 16240 raft_consensus.cc:515] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.820475 16224 raft_consensus.cc:493] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.820991 16224 raft_consensus.cc:515] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.823081 16224 leader_election.cc:290] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:59.825515 16240 leader_election.cc:290] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:59.830042 10708 leader_election.cc:336] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:17:59.830555 10706 leader_election.cc:336] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:59.831118 10706 leader_election.cc:304] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:17:59.830585 10708 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:17:59.832063 10706 leader_election.cc:336] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:17:59.832681 16240 raft_consensus.cc:2749] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.832463 10706 leader_election.cc:304] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:59.834009 16240 raft_consensus.cc:2749] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:59.844841 16240 raft_consensus.cc:493] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.845543 16240 raft_consensus.cc:515] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.848826 16240 leader_election.cc:290] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:17:59.853451 10706 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:17:59.855195 10708 leader_election.cc:336] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:17:59.855547 10708 leader_election.cc:304] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:17:59.856106 16240 raft_consensus.cc:2749] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:59.883946 10706 consensus_peers.cc:597] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.899825 11379 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:59.954895 10706 consensus_peers.cc:597] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:17:59.988191 16224 raft_consensus.cc:493] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.988577 16240 raft_consensus.cc:493] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.988730 16224 raft_consensus.cc:515] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.989705 16169 raft_consensus.cc:493] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:17:59.990200 16169 raft_consensus.cc:515] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.990938 16224 leader_election.cc:290] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:59.991994 16169 leader_election.cc:290] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:17:59.989105 16240 raft_consensus.cc:515] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:17:59.994644 16240 leader_election.cc:290] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.004253 10708 leader_election.cc:336] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.004894 10708 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.010716 16240 raft_consensus.cc:493] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.011157 16240 raft_consensus.cc:515] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.013332 16240 leader_election.cc:290] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.016013 10706 leader_election.cc:336] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.016501 10706 leader_election.cc:304] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.017184 16240 raft_consensus.cc:2749] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:00.018175 10706 leader_election.cc:336] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.018618 10706 leader_election.cc:304] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.019345 16169 raft_consensus.cc:2749] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:00.019470 10706 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:18:00.021816 10708 leader_election.cc:336] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.022287 10708 leader_election.cc:304] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.022984 16240 raft_consensus.cc:2749] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:00.030757 11379 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:00.033839 10706 leader_election.cc:336] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:18:00.037070 10708 leader_election.cc:336] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.037489 10708 leader_election.cc:304] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:18:00.039391 10706 consensus_peers.cc:597] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:00.039510 16240 raft_consensus.cc:2749] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.071171 16198 raft_consensus.cc:493] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.071743 16198 raft_consensus.cc:515] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:18:00.073707 16198 leader_election.cc:290] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.078112 11381 leader_election.cc:336] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.078868 11379 leader_election.cc:336] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.079252 11379 leader_election.cc:304] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.079926 16198 raft_consensus.cc:2749] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:00.098996 16224 raft_consensus.cc:493] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.099505 16224 raft_consensus.cc:515] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.101437 16224 leader_election.cc:290] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.104554 10708 leader_election.cc:336] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.110886 10706 leader_election.cc:336] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.111986 10706 leader_election.cc:304] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.113533 16224 raft_consensus.cc:2749] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.123266 16169 raft_consensus.cc:493] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.123723 16169 raft_consensus.cc:515] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.124071 16224 raft_consensus.cc:493] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.124611 16224 raft_consensus.cc:515] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.125701 16169 leader_election.cc:290] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.126586 16224 leader_election.cc:290] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.134267 16224 raft_consensus.cc:493] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.134765 16224 raft_consensus.cc:515] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.137485 16169 raft_consensus.cc:493] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.137573 16224 leader_election.cc:290] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.138027 16169 raft_consensus.cc:515] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.139986 16169 leader_election.cc:290] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.142908 16169 raft_consensus.cc:493] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.143327 16169 raft_consensus.cc:515] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.145249 16169 leader_election.cc:290] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.153254 11379 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:00.160761 16240 raft_consensus.cc:493] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.161238 16240 raft_consensus.cc:515] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.163102 16240 leader_election.cc:290] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.172013 10708 leader_election.cc:336] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.172680 10708 leader_election.cc:336] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.174686 16240 raft_consensus.cc:493] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.175146 16240 raft_consensus.cc:515] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.176987 16240 leader_election.cc:290] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.179204 10708 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.179665 10708 leader_election.cc:336] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.180085 10708 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.182890 16242 raft_consensus.cc:493] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.183379 16242 raft_consensus.cc:515] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
W20260709 13:18:00.185220 10708 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.188553 10708 leader_election.cc:336] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.189270 11381 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.191164 16242 leader_election.cc:290] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.182485 10706 leader_election.cc:336] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.191854 10706 leader_election.cc:304] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:18:00.192920 10706 leader_election.cc:336] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.193125 16240 raft_consensus.cc:2749] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.193619 10706 leader_election.cc:304] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.194494 16240 raft_consensus.cc:2749] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:00.194506 10706 leader_election.cc:336] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:18:00.196169 11379 leader_election.cc:336] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.196309 10706 leader_election.cc:304] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.196841 11379 leader_election.cc:304] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.197103 16240 raft_consensus.cc:2749] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.198762 16242 raft_consensus.cc:2749] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:00.197741 10706 leader_election.cc:336] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.201066 10706 leader_election.cc:304] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.202800 16240 raft_consensus.cc:2749] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:00.203605 10706 leader_election.cc:336] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.203971 10706 leader_election.cc:304] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.207643 16240 raft_consensus.cc:2749] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:00.212575 10706 leader_election.cc:336] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.213002 10706 leader_election.cc:304] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.213701 16224 raft_consensus.cc:2749] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:00.217994 10706 leader_election.cc:336] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.218408 10706 leader_election.cc:304] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.219656 16224 raft_consensus.cc:2749] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.241850 16242 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.242385 16242 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:18:00.245028 16242 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771)
W20260709 13:18:00.245745 11381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111) [suppressed 563 similar messages]
I20260709 13:18:00.246748 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "e71e2e44af1e46d8a8423ae08646bc22" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fac2164a6f874d7dbd29db83a7cf019b" is_pre_election: true
W20260709 13:18:00.250402 11381 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.250829 11381 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22; no voters: 18f1a9f5e66846dba474825fb5b2b784, fac2164a6f874d7dbd29db83a7cf019b
I20260709 13:18:00.251511 16198 raft_consensus.cc:2749] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.283257 16240 raft_consensus.cc:493] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.283774 16240 raft_consensus.cc:515] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.285717 16240 leader_election.cc:290] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.287395 16224 raft_consensus.cc:493] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.287842 16224 raft_consensus.cc:515] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.290082 16224 leader_election.cc:290] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.293632 10708 leader_election.cc:336] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.295998 10706 leader_election.cc:336] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.296849 10706 leader_election.cc:304] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
W20260709 13:18:00.296432 10708 leader_election.cc:336] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.298008 16224 raft_consensus.cc:2749] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:00.301180 10706 leader_election.cc:336] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.301645 10706 leader_election.cc:304] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.302343 16224 raft_consensus.cc:2749] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.305009 16224 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.305531 16224 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:18:00.307515 16224 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:18:00.311396 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22" is_pre_election: true
I20260709 13:18:00.312089 11413 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 12.
I20260709 13:18:00.314983 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 
W20260709 13:18:00.315210 11379 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:00.315797 16224 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.316217 16224 raft_consensus.cc:493] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.316596 16224 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:00.319587 10708 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.324196 16224 raft_consensus.cc:515] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:18:00.326238 16224 leader_election.cc:290] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Requested vote from peers 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499), e71e2e44af1e46d8a8423ae08646bc22 (127.9.68.68:35619)
I20260709 13:18:00.327241 11413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1c58f717d74f2fba0ed73c78de0673" candidate_uuid: "fac2164a6f874d7dbd29db83a7cf019b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e71e2e44af1e46d8a8423ae08646bc22"
I20260709 13:18:00.327745 11413 raft_consensus.cc:3060] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:00.331296 10708 leader_election.cc:336] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
I20260709 13:18:00.336094 11413 raft_consensus.cc:2468] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac2164a6f874d7dbd29db83a7cf019b in term 13.
I20260709 13:18:00.337260 10706 leader_election.cc:304] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e71e2e44af1e46d8a8423ae08646bc22, fac2164a6f874d7dbd29db83a7cf019b; no voters: 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.337993 16224 raft_consensus.cc:2804] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:00.338477 16224 raft_consensus.cc:697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Becoming Leader. State: Replica: fac2164a6f874d7dbd29db83a7cf019b, State: Running, Role: LEADER
I20260709 13:18:00.340214 16224 consensus_queue.cc:237] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } }
I20260709 13:18:00.352465 10488 catalog_manager.cc:5697] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b reported cstate change: term changed from 12 to 13, leader changed from 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66) to fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67). New cstate: current_term: 13 leader_uuid: "fac2164a6f874d7dbd29db83a7cf019b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e71e2e44af1e46d8a8423ae08646bc22" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 35619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.388000 16224 raft_consensus.cc:493] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.388586 16224 raft_consensus.cc:515] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.389777 16240 raft_consensus.cc:493] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 18f1a9f5e66846dba474825fb5b2b784)
I20260709 13:18:00.390293 16240 raft_consensus.cc:515] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09799b1ddd3f45f1a08fcd6e271cdcf7" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 41805 } } peers { permanent_uuid: "18f1a9f5e66846dba474825fb5b2b784" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 33499 } } peers { permanent_uuid: "fac2164a6f874d7dbd29db83a7cf019b" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 32771 } }
I20260709 13:18:00.392122 16240 leader_election.cc:290] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
I20260709 13:18:00.396355 16224 leader_election.cc:290] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805), 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499)
W20260709 13:18:00.397969 10708 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.400935 10708 leader_election.cc:336] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111)
W20260709 13:18:00.401782 10706 leader_election.cc:336] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.402275 10706 leader_election.cc:304] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.402962 16169 raft_consensus.cc:2749] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:00.406129 10706 leader_election.cc:336] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:00.406744 10706 leader_election.cc:304] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac2164a6f874d7dbd29db83a7cf019b; no voters: 09799b1ddd3f45f1a08fcd6e271cdcf7, 18f1a9f5e66846dba474825fb5b2b784
I20260709 13:18:00.408167 16169 raft_consensus.cc:2749] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:00.415870 10706 consensus_peers.cc:597] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:00.427641  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
W20260709 13:18:00.497915 10706 consensus_peers.cc:597] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:00.549906  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
W20260709 13:18:00.589890 11382 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.608201  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:00.609292  9489 tablet_replica.cc:333] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.610204  9489 raft_consensus.cc:2243] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.610737  9489 raft_consensus.cc:2272] T 5351bf3c5fe147f7b60882433345dd0b P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.612977  9489 tablet_replica.cc:333] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.613746  9489 raft_consensus.cc:2243] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.614179  9489 raft_consensus.cc:2272] T 00e9824bb588413ab262854eb713a965 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.616695  9489 tablet_replica.cc:333] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
W20260709 13:18:00.616698 11382 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.617657  9489 raft_consensus.cc:2243] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.618985  9489 raft_consensus.cc:2272] T a78c470d1bf042369166e3a795c3e963 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.620988  9489 tablet_replica.cc:333] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.621706  9489 raft_consensus.cc:2243] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.622310  9489 raft_consensus.cc:2272] T fa932526573f47178aa5a402a17388ad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.624966  9489 tablet_replica.cc:333] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.625901  9489 raft_consensus.cc:2243] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.626588  9489 raft_consensus.cc:2272] T ee360fe4b438464d8580245f06181d8f P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.626791 11382 consensus_peers.cc:597] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.629117  9489 tablet_replica.cc:333] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.629918  9489 raft_consensus.cc:2243] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.630580  9489 raft_consensus.cc:2272] T 251650397d264ac1a42a2fde5932424f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.633138  9489 tablet_replica.cc:333] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.633797  9489 raft_consensus.cc:2243] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.634570  9489 raft_consensus.cc:2272] T feaf88905a8f4cc8bf8e751c1f163180 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.636359  9489 tablet_replica.cc:333] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.636911  9489 raft_consensus.cc:2243] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.637739  9489 raft_consensus.cc:2272] T 8e245cc261b6415fac3d372489a49ceb P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.639932  9489 tablet_replica.cc:333] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.640462  9489 raft_consensus.cc:2243] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.641093  9489 raft_consensus.cc:2272] T 55846c170448461696e53d2649ed09d8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.642256 11382 consensus_peers.cc:597] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.643303  9489 tablet_replica.cc:333] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.643864  9489 raft_consensus.cc:2243] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.644304  9489 raft_consensus.cc:2272] T 939b0eadbf7c4b4e842fc542cbaae675 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.646606  9489 tablet_replica.cc:333] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.647164  9489 raft_consensus.cc:2243] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.648103  9489 raft_consensus.cc:2272] T 456c58bcf67c4357b892184c57ce7e09 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.650450  9489 tablet_replica.cc:333] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.651199  9489 raft_consensus.cc:2243] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:18:00.651746 10706 consensus_peers.cc:597] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:00.652343  9489 raft_consensus.cc:2272] T 602f135686c6438ea75a7b4f28a2625d P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.654992  9489 tablet_replica.cc:333] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.655799  9489 raft_consensus.cc:2243] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.656769  9489 raft_consensus.cc:2272] T edb4252c2cb946b2833f090b57f26ad4 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.658629 11382 consensus_peers.cc:597] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.659194  9489 tablet_replica.cc:333] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.659772  9489 raft_consensus.cc:2243] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.660487  9489 raft_consensus.cc:2272] T 6aab7d76cb3149698a925aad05e45589 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.662774  9489 tablet_replica.cc:333] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.663338  9489 raft_consensus.cc:2243] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.663901  9489 raft_consensus.cc:2272] T 7d3bc7fc30ef40e79df7e6a1bfdcb227 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.666266  9489 tablet_replica.cc:333] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.666834  9489 raft_consensus.cc:2243] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.667548  9489 raft_consensus.cc:2272] T 27b7b057c54346c0b47758f08031d007 P fac2164a6f874d7dbd29db83a7cf019b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.669539  9489 tablet_replica.cc:333] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.670037  9489 raft_consensus.cc:2243] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.670459  9489 raft_consensus.cc:2272] T 7485460ddbcb4574882c669f7bdbbf47 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.672525  9489 tablet_replica.cc:333] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.673260  9489 raft_consensus.cc:2243] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.673790  9489 raft_consensus.cc:2272] T b8e29890b8e04ddca3426014b2514656 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.676210  9489 tablet_replica.cc:333] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.677027  9489 raft_consensus.cc:2243] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.678057  9489 raft_consensus.cc:2272] T 2c98bbebd7a849a6b0596781b7853ce3 P fac2164a6f874d7dbd29db83a7cf019b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.680486  9489 tablet_replica.cc:333] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.681260  9489 raft_consensus.cc:2243] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.682224  9489 raft_consensus.cc:2272] T 6f1a927fea2843f890fde9160ee8b796 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.684464  9489 tablet_replica.cc:333] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.685146  9489 raft_consensus.cc:2243] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.686074  9489 raft_consensus.cc:2272] T 5b107ac4e22944b388450acfe815a08e P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.687992  9489 tablet_replica.cc:333] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.688541  9489 raft_consensus.cc:2243] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.689450  9489 raft_consensus.cc:2272] T 75bb31da8c4c4ef8a1530905a2369172 P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.691839  9489 tablet_replica.cc:333] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.692494  9489 raft_consensus.cc:2243] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.693368  9489 raft_consensus.cc:2272] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.695475  9489 tablet_replica.cc:333] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.696434  9489 raft_consensus.cc:2243] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.697029  9489 pending_rounds.cc:70] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Trying to abort 1 pending ops.
I20260709 13:18:00.697211  9489 pending_rounds.cc:77] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b: Aborting op as it isn't in flight: id { term: 13 index: 11 } timestamp: 7305638217082200064 op_type: NO_OP noop_request { }
I20260709 13:18:00.697516  9489 raft_consensus.cc:2889] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:00.697811  9489 raft_consensus.cc:2272] T 9d1c58f717d74f2fba0ed73c78de0673 P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.699790  9489 tablet_replica.cc:333] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.700368  9489 raft_consensus.cc:2243] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.700826  9489 raft_consensus.cc:2272] T e1e246154849412a97842c9d673bd0a8 P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.702857  9489 tablet_replica.cc:333] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.703467  9489 raft_consensus.cc:2243] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.704372  9489 raft_consensus.cc:2272] T 20723d90fba84eedaeb069a608e6a40f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.706471  9489 tablet_replica.cc:333] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.706983  9489 raft_consensus.cc:2243] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.707397  9489 raft_consensus.cc:2272] T 63a3acb5ddc84e7e91b896e4a278cec7 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.709204  9489 tablet_replica.cc:333] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.709722  9489 raft_consensus.cc:2243] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.710410  9489 raft_consensus.cc:2272] T 7bd88b6bef8141f2a7c75714e0233dfd P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.712178  9489 tablet_replica.cc:333] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.712929  9489 raft_consensus.cc:2243] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.713616  9489 raft_consensus.cc:2272] T 68a5bdce0f0846e2a7f8c9c6f36d560e P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.715922  9489 tablet_replica.cc:333] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.716490  9489 raft_consensus.cc:2243] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.717195  9489 raft_consensus.cc:2272] T e922c08ea15b4851815093b0021df81c P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.719211  9489 tablet_replica.cc:333] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.719727  9489 raft_consensus.cc:2243] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.720381  9489 raft_consensus.cc:2272] T 2d16782ce53741e19df4f216701c641a P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.722909  9489 tablet_replica.cc:333] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.723598  9489 raft_consensus.cc:2243] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.724156  9489 raft_consensus.cc:2272] T 2904e05a1d154393bc63b07589fd6537 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.726646  9489 tablet_replica.cc:333] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.727327  9489 raft_consensus.cc:2243] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:18:00.727327 10706 consensus_peers.cc:597] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:00.728390  9489 raft_consensus.cc:2272] T f7624b04076142a0bbf29cbbf066c4bb P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.730373  9489 tablet_replica.cc:333] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.730870  9489 raft_consensus.cc:2243] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.731573  9489 raft_consensus.cc:2272] T 81565cb1f2054410aae97284b914f79c P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.733410  9489 tablet_replica.cc:333] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.733903  9489 raft_consensus.cc:2243] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.734372  9489 raft_consensus.cc:2272] T 5c293ace9b264b57b21dd6b308e25a1f P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.736052  9489 tablet_replica.cc:333] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.736714  9489 raft_consensus.cc:2243] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.737398  9489 raft_consensus.cc:2272] T 62cf3c0497064f47ad08a6d5a7a28853 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.739603  9489 tablet_replica.cc:333] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.740207  9489 raft_consensus.cc:2243] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.740823  9489 raft_consensus.cc:2272] T d13f2688a0464257b5162c27e06aeaad P fac2164a6f874d7dbd29db83a7cf019b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.743304  9489 tablet_replica.cc:333] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.743893  9489 raft_consensus.cc:2243] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.744837  9489 raft_consensus.cc:2272] T 2298132784d24fb2b78c3a21c68a9d40 P fac2164a6f874d7dbd29db83a7cf019b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.746722  9489 tablet_replica.cc:333] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.747207  9489 raft_consensus.cc:2243] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.747779  9489 raft_consensus.cc:2272] T eaf67a9a92d14fbeaf459c21b6c42278 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.749866  9489 tablet_replica.cc:333] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.750495  9489 raft_consensus.cc:2243] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.751477  9489 raft_consensus.cc:2272] T b691cd466c7645fbba119f2344854ddb P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.753746  9489 tablet_replica.cc:333] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.754307  9489 raft_consensus.cc:2243] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.755038  9489 raft_consensus.cc:2272] T f325308e46064da6807ac7edc8a20717 P fac2164a6f874d7dbd29db83a7cf019b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.756698  9489 tablet_replica.cc:333] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.757156  9489 raft_consensus.cc:2243] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.757874  9489 raft_consensus.cc:2272] T 099b1366ff5e4753be5bd192a535a9fe P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.759608  9489 tablet_replica.cc:333] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.760061  9489 raft_consensus.cc:2243] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.760701  9489 raft_consensus.cc:2272] T 46f08f529e274f3799aa41f54ca844f9 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.762547  9489 tablet_replica.cc:333] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.763005  9489 raft_consensus.cc:2243] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.763453  9489 raft_consensus.cc:2272] T b40fb00bae3d4baa92d6e9276011a816 P fac2164a6f874d7dbd29db83a7cf019b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.765101  9489 tablet_replica.cc:333] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.765620  9489 raft_consensus.cc:2243] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.766134  9489 raft_consensus.cc:2272] T 9d22506ba0474e93940b67cdd5d59af6 P fac2164a6f874d7dbd29db83a7cf019b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.767902  9489 tablet_replica.cc:333] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.768376  9489 raft_consensus.cc:2243] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.769097  9489 raft_consensus.cc:2272] T 6d3e32279b914c319fcf8afa158efa9c P fac2164a6f874d7dbd29db83a7cf019b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.770872  9489 tablet_replica.cc:333] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.771402  9489 raft_consensus.cc:2243] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.772148  9489 raft_consensus.cc:2272] T e6d3a109d6054b8ba7b3b1ff65909ade P fac2164a6f874d7dbd29db83a7cf019b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.774135  9489 tablet_replica.cc:333] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.774613  9489 raft_consensus.cc:2243] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.775004  9489 raft_consensus.cc:2272] T 86f93e93739544bc8c7af65e566a65d6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.776609  9489 tablet_replica.cc:333] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.777076  9489 raft_consensus.cc:2243] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.777506  9489 raft_consensus.cc:2272] T 3ed347880eeb491baa0d6d22c5964d18 P fac2164a6f874d7dbd29db83a7cf019b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.779464  9489 tablet_replica.cc:333] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.779908  9489 raft_consensus.cc:2243] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.780813  9489 raft_consensus.cc:2272] T d6db1ee475344550afb0eaebc5046df6 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.782555  9489 tablet_replica.cc:333] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b: stopping tablet replica
I20260709 13:18:00.782996  9489 raft_consensus.cc:2243] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.783538  9489 raft_consensus.cc:2272] T 1b930877bb3e45ff96d2babd2b0f8bc8 P fac2164a6f874d7dbd29db83a7cf019b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.812207 11382 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:00.893926 11382 consensus_peers.cc:597] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.67:32771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:00.910868 11379 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:00.930676 11381 consensus_peers.cc:597] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:00.958307 11382 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.67:32771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.112730 11381 consensus_peers.cc:597] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.129261 11379 consensus_peers.cc:597] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:01.149732 11381 consensus_peers.cc:597] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.151391 11382 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer fac2164a6f874d7dbd29db83a7cf019b (127.9.68.67:32771): Couldn't send request to peer fac2164a6f874d7dbd29db83a7cf019b. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.67:32771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.156678 11379 consensus_peers.cc:597] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:18:01.157830 11381 consensus_peers.cc:597] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.204249 11381 consensus_peers.cc:597] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.285360 11381 consensus_peers.cc:597] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.301553 11379 consensus_peers.cc:597] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:18:01.315069 11381 consensus_peers.cc:597] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:01.346537  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
W20260709 13:18:01.383456 11379 consensus_peers.cc:597] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:01.429095 11379 consensus_peers.cc:597] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): Couldn't send request to peer 09799b1ddd3f45f1a08fcd6e271cdcf7. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:18:01.453387  9489 tablet_server.cc:179] TabletServer@127.9.68.68:0 shutting down...
I20260709 13:18:01.501096  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:01.501910  9489 tablet_replica.cc:333] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.502939  9489 raft_consensus.cc:2243] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.503655  9489 raft_consensus.cc:2272] T a78c470d1bf042369166e3a795c3e963 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.505995  9489 tablet_replica.cc:333] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.506603  9489 raft_consensus.cc:2243] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.507109  9489 raft_consensus.cc:2272] T 7bd88b6bef8141f2a7c75714e0233dfd P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.509274  9489 tablet_replica.cc:333] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.509923  9489 raft_consensus.cc:2243] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.510465  9489 raft_consensus.cc:2272] T 099b1366ff5e4753be5bd192a535a9fe P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.513600  9489 tablet_replica.cc:333] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.514259  9489 raft_consensus.cc:2243] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.515197  9489 raft_consensus.cc:2272] T 46f08f529e274f3799aa41f54ca844f9 P e71e2e44af1e46d8a8423ae08646bc22 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.518153  9489 tablet_replica.cc:333] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.518739  9489 raft_consensus.cc:2243] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.519313  9489 raft_consensus.cc:2272] T 2c98bbebd7a849a6b0596781b7853ce3 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.521281  9489 tablet_replica.cc:333] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.521965  9489 raft_consensus.cc:2243] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.522367  9489 raft_consensus.cc:2272] T 4d2efcf18c8e45be8aebbfa42f61e9f5 P e71e2e44af1e46d8a8423ae08646bc22 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.524281  9489 tablet_replica.cc:333] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.524817  9489 raft_consensus.cc:2243] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.525743  9489 raft_consensus.cc:2272] T 0958810fe1d74c67af02bd74dc0488bb P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.528213  9489 tablet_replica.cc:333] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.528988  9489 raft_consensus.cc:2243] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.529609  9489 raft_consensus.cc:2272] T 6d3e32279b914c319fcf8afa158efa9c P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.532804  9489 tablet_replica.cc:333] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.533794  9489 raft_consensus.cc:2243] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.534688  9489 raft_consensus.cc:2272] T 3ae2b9cd744b4a2bba38c92a5f4b94f3 P e71e2e44af1e46d8a8423ae08646bc22 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.536865  9489 tablet_replica.cc:333] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.537443  9489 raft_consensus.cc:2243] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.537951  9489 raft_consensus.cc:2272] T feaf88905a8f4cc8bf8e751c1f163180 P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.539830  9489 tablet_replica.cc:333] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.540522  9489 raft_consensus.cc:2243] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.541525  9489 raft_consensus.cc:2272] T 68a5bdce0f0846e2a7f8c9c6f36d560e P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.544003  9489 tablet_replica.cc:333] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.544641  9489 raft_consensus.cc:2243] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.545635  9489 raft_consensus.cc:2272] T 72b98b9d27524f83a9b567dee7f0718f P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.548193  9489 tablet_replica.cc:333] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.548971  9489 raft_consensus.cc:2243] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.549906  9489 raft_consensus.cc:2272] T eaf67a9a92d14fbeaf459c21b6c42278 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:01.551628 11381 consensus_peers.cc:597] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 -> Peer 18f1a9f5e66846dba474825fb5b2b784 (127.9.68.66:33499): Couldn't send request to peer 18f1a9f5e66846dba474825fb5b2b784. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:33499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:01.552297  9489 tablet_replica.cc:333] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.552856  9489 raft_consensus.cc:2243] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.553428  9489 raft_consensus.cc:2272] T 2298132784d24fb2b78c3a21c68a9d40 P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.555323  9489 tablet_replica.cc:333] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.555877  9489 raft_consensus.cc:2243] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.556640  9489 raft_consensus.cc:2272] T 3d63a40a747147e987c1c81889fd1a0d P e71e2e44af1e46d8a8423ae08646bc22 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.558535  9489 tablet_replica.cc:333] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.559070  9489 raft_consensus.cc:2243] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.559698  9489 raft_consensus.cc:2272] T 8e245cc261b6415fac3d372489a49ceb P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.561569  9489 tablet_replica.cc:333] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.562074  9489 raft_consensus.cc:2243] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.562516  9489 raft_consensus.cc:2272] T 9d1c58f717d74f2fba0ed73c78de0673 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.564267  9489 tablet_replica.cc:333] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.564769  9489 raft_consensus.cc:2243] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.565610  9489 raft_consensus.cc:2272] T e1e246154849412a97842c9d673bd0a8 P e71e2e44af1e46d8a8423ae08646bc22 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.567503  9489 tablet_replica.cc:333] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.568019  9489 raft_consensus.cc:2243] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.568800  9489 raft_consensus.cc:2272] T 81565cb1f2054410aae97284b914f79c P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.570833  9489 tablet_replica.cc:333] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.571544  9489 raft_consensus.cc:2243] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.572784  9489 raft_consensus.cc:2272] T e922c08ea15b4851815093b0021df81c P e71e2e44af1e46d8a8423ae08646bc22 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.575695  9489 tablet_replica.cc:333] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.576375  9489 raft_consensus.cc:2243] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.577028  9489 raft_consensus.cc:2272] T 0db5b0c3da3b45289300a692b98fa1c1 P e71e2e44af1e46d8a8423ae08646bc22 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.579048  9489 tablet_replica.cc:333] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.579545  9489 raft_consensus.cc:2243] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.580268  9489 raft_consensus.cc:2272] T 86f93e93739544bc8c7af65e566a65d6 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.582196  9489 tablet_replica.cc:333] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.582684  9489 raft_consensus.cc:2243] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.583118  9489 raft_consensus.cc:2272] T f7624b04076142a0bbf29cbbf066c4bb P e71e2e44af1e46d8a8423ae08646bc22 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.584882  9489 tablet_replica.cc:333] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.585440  9489 raft_consensus.cc:2243] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.586215  9489 raft_consensus.cc:2272] T d9ac19ea4edd4e26890c806619f5b551 P e71e2e44af1e46d8a8423ae08646bc22 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.588063  9489 tablet_replica.cc:333] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.588518  9489 raft_consensus.cc:2243] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.589253  9489 raft_consensus.cc:2272] T 00e9824bb588413ab262854eb713a965 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.591060  9489 tablet_replica.cc:333] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.591533  9489 raft_consensus.cc:2243] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.592418  9489 raft_consensus.cc:2272] T 456c58bcf67c4357b892184c57ce7e09 P e71e2e44af1e46d8a8423ae08646bc22 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.594267  9489 tablet_replica.cc:333] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.594725  9489 raft_consensus.cc:2243] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.595433  9489 raft_consensus.cc:2272] T 7247478c2fbc418f85cf61569e673a75 P e71e2e44af1e46d8a8423ae08646bc22 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.597652  9489 tablet_replica.cc:333] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22: stopping tablet replica
I20260709 13:18:01.598192  9489 raft_consensus.cc:2243] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.599043  9489 raft_consensus.cc:2272] T 94a8b7e07671442dafc4c3dcb271d352 P e71e2e44af1e46d8a8423ae08646bc22 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.992434  9489 tablet_server.cc:196] TabletServer@127.9.68.68:0 shutdown complete.
I20260709 13:18:02.043121  9489 master.cc:562] Master@127.9.68.126:35023 shutting down...
W20260709 13:18:02.080935 10540 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:18:02.081244 10540 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:02.081511 10540 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:10.280568 10476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111) [suppressed 115 similar messages]
W20260709 13:18:10.284634 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 099b1366ff5e4753be5bd192a535a9fe: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
W20260709 13:18:13.370702 10476 catalog_manager.cc:4755] TS 09799b1ddd3f45f1a08fcd6e271cdcf7 (127.9.68.65:41805): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e245cc261b6415fac3d372489a49ceb: Network error: Client connection negotiation failed: client connection to 127.9.68.65:41805: connect: Connection refused (error 111)
I20260709 13:18:15.723412  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:15.724861  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:15.725423  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P 956662ca83ea4bd99d8b7557260d32d7: stopping tablet replica
I20260709 13:18:15.954001  9489 master.cc:584] Master@127.9.68.126:35023 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (193900 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:18:16.072168  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:35691
I20260709 13:18:16.073215  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.078922 16256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.079664 16257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.080292 16259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.080466  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:16.083187  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:16.083408  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.083590  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603096083573 us; error 0 us; skew 500 ppm
I20260709 13:18:16.084100  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.086436  9489 webserver.cc:533] Webserver started at http://127.9.68.126:39577/ using document root <none> and password file <none>
I20260709 13:18:16.086927  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.087121  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.087389  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.088595  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "e11a1b3a37964353913db5deca7ae93c"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.093161  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:18:16.096657 16264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.097716  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:18:16.098206  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "e11a1b3a37964353913db5deca7ae93c"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.098580  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.121246  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.122442  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.164578  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:35691
I20260709 13:18:16.164759 16315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:35691 every 8 connection(s)
I20260709 13:18:16.169402 16316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.180915 16316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c: Bootstrap starting.
I20260709 13:18:16.185554 16316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.189471 16316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c: No bootstrap required, opened a new log
I20260709 13:18:16.191546 16316 raft_consensus.cc:359] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER }
I20260709 13:18:16.191973 16316 raft_consensus.cc:385] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.192181 16316 raft_consensus.cc:740] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11a1b3a37964353913db5deca7ae93c, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.192785 16316 consensus_queue.cc:260] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER }
I20260709 13:18:16.193236 16316 raft_consensus.cc:399] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:16.193493 16316 raft_consensus.cc:493] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:16.193789 16316 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.197651 16316 raft_consensus.cc:515] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER }
I20260709 13:18:16.198132 16316 leader_election.cc:304] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e11a1b3a37964353913db5deca7ae93c; no voters: 
I20260709 13:18:16.199147 16316 leader_election.cc:290] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:16.199630 16319 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.200971 16319 raft_consensus.cc:697] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 1 LEADER]: Becoming Leader. State: Replica: e11a1b3a37964353913db5deca7ae93c, State: Running, Role: LEADER
I20260709 13:18:16.201967 16316 sys_catalog.cc:565] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:16.201664 16319 consensus_queue.cc:237] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER }
I20260709 13:18:16.208408 16320 sys_catalog.cc:455] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e11a1b3a37964353913db5deca7ae93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER } }
I20260709 13:18:16.208910 16320 sys_catalog.cc:458] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:16.208540 16321 sys_catalog.cc:455] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e11a1b3a37964353913db5deca7ae93c. Latest consensus state: current_term: 1 leader_uuid: "e11a1b3a37964353913db5deca7ae93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e11a1b3a37964353913db5deca7ae93c" member_type: VOTER } }
I20260709 13:18:16.209339 16321 sys_catalog.cc:458] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:16.210932 16326 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:16.215785 16326 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:16.219520  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:16.225078 16326 catalog_manager.cc:1383] Generated new cluster ID: 9c3a1fb8e2c44b959942a654509200d2
I20260709 13:18:16.225431 16326 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:16.236196 16326 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:16.237422 16326 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:16.249686 16326 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c: Generated new TSK 0
I20260709 13:18:16.250377 16326 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:16.286449  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.293026 16337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.294538 16338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.296206 16340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.297281  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:16.299782  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:16.299966  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.300205  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603096300187 us; error 0 us; skew 500 ppm
I20260709 13:18:16.300798  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.303829  9489 webserver.cc:533] Webserver started at http://127.9.68.65:45075/ using document root <none> and password file <none>
I20260709 13:18:16.304414  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.304628  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.304957  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.306408  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "1135cc63751942c48da76d29e573b5b8"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.311698  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:16.316008 16345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.316895  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:16.317375  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "1135cc63751942c48da76d29e573b5b8"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.317664  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.340142  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.341248  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.342702  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:16.344882  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:16.345091  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.345371  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:16.345569  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:18:16.389465  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:44563
I20260709 13:18:16.389606 16407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:44563 every 8 connection(s)
I20260709 13:18:16.394660  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.402772 16412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.404206 16413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.406976  9489 server_base.cc:1061] running on GCE node
W20260709 13:18:16.407671 16415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.409986  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:16.410259  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.410477  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603096410455 us; error 0 us; skew 500 ppm
I20260709 13:18:16.411264  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.413311 16408 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35691
I20260709 13:18:16.413805 16408 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:16.414740  9489 webserver.cc:533] Webserver started at http://127.9.68.66:36207/ using document root <none> and password file <none>
I20260709 13:18:16.415264 16408 heartbeater.cc:507] Master 127.9.68.126:35691 requested a full tablet report, sending...
I20260709 13:18:16.415444  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.415731  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.416060  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.417591  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.417863 16281 ts_manager.cc:194] Registered new tserver with Master: 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:16.420359 16281 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42882
I20260709 13:18:16.423372  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:16.426807 16420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.427529  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:16.427834  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.428069  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.454821  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.455935  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.457471  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:16.459599  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:16.459820  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.460059  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:16.460233  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.503611  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:34933
I20260709 13:18:16.503775 16482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:34933 every 8 connection(s)
I20260709 13:18:16.508551  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.516059 16486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.517097 16487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.520126  9489 server_base.cc:1061] running on GCE node
W20260709 13:18:16.520673 16490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.521641 16483 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35691
I20260709 13:18:16.521763  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:16.522027  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.522048 16483 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:16.522416  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603096522394 us; error 0 us; skew 500 ppm
I20260709 13:18:16.523156 16483 heartbeater.cc:507] Master 127.9.68.126:35691 requested a full tablet report, sending...
I20260709 13:18:16.523247  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.525949 16281 ts_manager.cc:194] Registered new tserver with Master: 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:16.526461  9489 webserver.cc:533] Webserver started at http://127.9.68.67:38999/ using document root <none> and password file <none>
I20260709 13:18:16.527029  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.527245  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.527508  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.527827 16281 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42888
I20260709 13:18:16.528847  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "6b5db6fa2cd44206908172d50ddf3532"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.533452  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:18:16.536751 16494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.537636  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:16.537878  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "6b5db6fa2cd44206908172d50ddf3532"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.538111  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.561865  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.562976  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.564373  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:16.566618  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:16.566787  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.567070  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:16.567426  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.610252  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:39149
I20260709 13:18:16.610371 16556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:39149 every 8 connection(s)
I20260709 13:18:16.615247  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.622478 16560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.623507 16561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.626861 16563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.627823  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:16.628793  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:16.628912 16557 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35691
W20260709 13:18:16.629091  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.629312 16557 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:16.629371  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603096629353 us; error 0 us; skew 500 ppm
I20260709 13:18:16.630347  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.630369 16557 heartbeater.cc:507] Master 127.9.68.126:35691 requested a full tablet report, sending...
I20260709 13:18:16.633592 16281 ts_manager.cc:194] Registered new tserver with Master: 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:16.633775  9489 webserver.cc:533] Webserver started at http://127.9.68.68:46541/ using document root <none> and password file <none>
I20260709 13:18:16.634377  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.634799  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.635210 16281 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42896
I20260709 13:18:16.635212  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.637491  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-3-root/instance:
uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.642307  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:16.646324 16568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.647176  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:18:16.647508  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:16.647764  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.657619  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.658777  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.660221  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:16.662748  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:16.663059  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.663321  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:16.663523  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.708000  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.68:45619
I20260709 13:18:16.708247 16630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.68:45619 every 8 connection(s)
I20260709 13:18:16.723412 16631 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35691
I20260709 13:18:16.723877 16631 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:16.724597 16631 heartbeater.cc:507] Master 127.9.68.126:35691 requested a full tablet report, sending...
I20260709 13:18:16.726792 16281 ts_manager.cc:194] Registered new tserver with Master: 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:16.727672  9489 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016611911s
I20260709 13:18:16.728142 16281 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42912
I20260709 13:18:16.755311 16281 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:18:17.000741 16448 tablet_service.cc:1511] Processing CreateTablet for tablet ec158588f7a145b6bb53ff67441c3e65 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:17.002354 16448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec158588f7a145b6bb53ff67441c3e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.003996 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 99cad407ad0d450db9c2bc97b1deefe3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:17.005550 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cad407ad0d450db9c2bc97b1deefe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.009723 16445 tablet_service.cc:1511] Processing CreateTablet for tablet a4a28d714f0646cf96db4e9be81b2de6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:17.010524 16372 tablet_service.cc:1511] Processing CreateTablet for tablet 691f918df0f648568ef24d57f8633d34 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:17.011117 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a28d714f0646cf96db4e9be81b2de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.011827 16372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691f918df0f648568ef24d57f8633d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.013793 16447 tablet_service.cc:1511] Processing CreateTablet for tablet 691f918df0f648568ef24d57f8633d34 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:17.014135 16519 tablet_service.cc:1511] Processing CreateTablet for tablet a4a28d714f0646cf96db4e9be81b2de6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:17.015136 16447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691f918df0f648568ef24d57f8633d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.014873 16446 tablet_service.cc:1511] Processing CreateTablet for tablet bd4b3d6cec454dffaaf81084fdf67a55 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:17.016428 16446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4b3d6cec454dffaaf81084fdf67a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.016866 16522 tablet_service.cc:1511] Processing CreateTablet for tablet ec158588f7a145b6bb53ff67441c3e65 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:17.018656 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec158588f7a145b6bb53ff67441c3e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.018882 16373 tablet_service.cc:1511] Processing CreateTablet for tablet ec158588f7a145b6bb53ff67441c3e65 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:17.012795 16370 tablet_service.cc:1511] Processing CreateTablet for tablet a4a28d714f0646cf96db4e9be81b2de6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:17.021786 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec158588f7a145b6bb53ff67441c3e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.022440 16370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a28d714f0646cf96db4e9be81b2de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.022620 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 0b59053fce284e67b6a3871de35a9078 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:17.022975 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 99cad407ad0d450db9c2bc97b1deefe3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:17.024317 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cad407ad0d450db9c2bc97b1deefe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.024422 16521 tablet_service.cc:1511] Processing CreateTablet for tablet 99cad407ad0d450db9c2bc97b1deefe3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:17.026204 16520 tablet_service.cc:1511] Processing CreateTablet for tablet bd4b3d6cec454dffaaf81084fdf67a55 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:17.026434 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 84f209f9fb8b4c7c803d38dee43db5b9 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:17.027664 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f209f9fb8b4c7c803d38dee43db5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.027958 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a28d714f0646cf96db4e9be81b2de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.030004 16592 tablet_service.cc:1511] Processing CreateTablet for tablet 0b59053fce284e67b6a3871de35a9078 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:17.030821 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b59053fce284e67b6a3871de35a9078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.031334 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b59053fce284e67b6a3871de35a9078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.033877 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cad407ad0d450db9c2bc97b1deefe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.035229 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 84f209f9fb8b4c7c803d38dee43db5b9 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:17.037658 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f209f9fb8b4c7c803d38dee43db5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.037889 16594 tablet_service.cc:1511] Processing CreateTablet for tablet bd4b3d6cec454dffaaf81084fdf67a55 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:17.040283 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4b3d6cec454dffaaf81084fdf67a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.021812 16596 tablet_service.cc:1511] Processing CreateTablet for tablet 691f918df0f648568ef24d57f8633d34 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:17.042872 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4b3d6cec454dffaaf81084fdf67a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.045724 16596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691f918df0f648568ef24d57f8633d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.058902 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 84f209f9fb8b4c7c803d38dee43db5b9 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:17.060316 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f209f9fb8b4c7c803d38dee43db5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.062897 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 0b59053fce284e67b6a3871de35a9078 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:17.064221 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b59053fce284e67b6a3871de35a9078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.097280 16651 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:17.098737 16443 tablet_service.cc:1511] Processing CreateTablet for tablet d46de5f77dc445b39fe65f5ee1c65935 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:17.100162 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46de5f77dc445b39fe65f5ee1c65935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.103473 16591 tablet_service.cc:1511] Processing CreateTablet for tablet d46de5f77dc445b39fe65f5ee1c65935 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:17.105031 16591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46de5f77dc445b39fe65f5ee1c65935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.106441 16590 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4146e0f3ef4f748a9b3f0b29acc291 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:17.106527 16516 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1607c4cac14c5598baefa0a5a278a7 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:17.107964 16590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4146e0f3ef4f748a9b3f0b29acc291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.108048 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1607c4cac14c5598baefa0a5a278a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.119465 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1607c4cac14c5598baefa0a5a278a7 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:17.110421 16517 tablet_service.cc:1511] Processing CreateTablet for tablet d46de5f77dc445b39fe65f5ee1c65935 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:17.116875 16373 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1607c4cac14c5598baefa0a5a278a7 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:17.121289 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1607c4cac14c5598baefa0a5a278a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.124496 16370 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4146e0f3ef4f748a9b3f0b29acc291 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:17.122709 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46de5f77dc445b39fe65f5ee1c65935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.126686 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4146e0f3ef4f748a9b3f0b29acc291 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:17.123875 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1607c4cac14c5598baefa0a5a278a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.131929 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4146e0f3ef4f748a9b3f0b29acc291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.143910 16652 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:17.159214 16520 tablet_service.cc:1511] Processing CreateTablet for tablet 6d99153b406b4158ab960b4429dd2c7e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:17.159708 16651 tablet_bootstrap.cc:654] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.160521 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d99153b406b4158ab960b4429dd2c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.161103 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 6d99153b406b4158ab960b4429dd2c7e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:17.163748 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d99153b406b4158ab960b4429dd2c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.164307 16444 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8d57fe9a14ea5b84b25239c03b674 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:17.165686 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 6d99153b406b4158ab960b4429dd2c7e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:17.165699 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8d57fe9a14ea5b84b25239c03b674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.181702 16370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4146e0f3ef4f748a9b3f0b29acc291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.188016 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d99153b406b4158ab960b4429dd2c7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:17.215560 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:17.246990 16652 tablet_bootstrap.cc:654] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.267705 16653 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:17.271358 16651 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:17.271858 16651 ts_tablet_manager.cc:1403] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.003s
I20260709 13:18:17.274780 16651 raft_consensus.cc:359] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.275496 16651 raft_consensus.cc:385] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.275847 16651 raft_consensus.cc:740] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.268728 16654 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:17.280978 16446 tablet_service.cc:1511] Processing CreateTablet for tablet 00291aa4a1be425a8dd5911f290c7fb2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:17.278752 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 00291aa4a1be425a8dd5911f290c7fb2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:17.281903 16593 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8d57fe9a14ea5b84b25239c03b674 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:17.283154 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8d57fe9a14ea5b84b25239c03b674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.283310 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18a2e264c34f4291b3bb9965abf150 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:17.290279 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18a2e264c34f4291b3bb9965abf150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.283442 16651 consensus_queue.cc:260] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.283161 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00291aa4a1be425a8dd5911f290c7fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.286748 16522 tablet_service.cc:1511] Processing CreateTablet for tablet 00291aa4a1be425a8dd5911f290c7fb2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:17.297087 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00291aa4a1be425a8dd5911f290c7fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.284345 16517 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8d57fe9a14ea5b84b25239c03b674 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:17.290333 16373 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18a2e264c34f4291b3bb9965abf150 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:17.302248 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8d57fe9a14ea5b84b25239c03b674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.302418 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18a2e264c34f4291b3bb9965abf150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.305157 16653 tablet_bootstrap.cc:654] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.310681 16408 heartbeater.cc:499] Master 127.9.68.126:35691 was elected leader, sending a full tablet report...
I20260709 13:18:17.314582 16651 ts_tablet_manager.cc:1434] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 13:18:17.301174 16446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00291aa4a1be425a8dd5911f290c7fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.292699 16652 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:17.330015 16652 ts_tablet_manager.cc:1403] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.005s
I20260709 13:18:17.331387 16370 tablet_service.cc:1511] Processing CreateTablet for tablet 7e72e3aaa572413bb34bccd2652bed01 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:17.321224 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18a2e264c34f4291b3bb9965abf150 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:17.333346 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 7e72e3aaa572413bb34bccd2652bed01 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:17.334208 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18a2e264c34f4291b3bb9965abf150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.334666 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e72e3aaa572413bb34bccd2652bed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.323474 16516 tablet_service.cc:1511] Processing CreateTablet for tablet 7e72e3aaa572413bb34bccd2652bed01 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:17.338135 16651 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:17.338231 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e72e3aaa572413bb34bccd2652bed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.340008 16652 raft_consensus.cc:359] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.333169 16370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e72e3aaa572413bb34bccd2652bed01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.341272 16652 raft_consensus.cc:385] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.341671 16652 raft_consensus.cc:740] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.342576 16652 consensus_queue.cc:260] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.351334 16653 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:17.351857 16653 ts_tablet_manager.cc:1403] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.000s
I20260709 13:18:17.355160 16653 raft_consensus.cc:359] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.339267 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 2213423f89b4439f93a8692f6fcd5cf8 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:17.361069 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2213423f89b4439f93a8692f6fcd5cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.359289 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 2213423f89b4439f93a8692f6fcd5cf8 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:17.373929 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2213423f89b4439f93a8692f6fcd5cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.373981 16519 tablet_service.cc:1511] Processing CreateTablet for tablet 24cfd1e3653147699df1ac0e9482ba3e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:17.375257 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cfd1e3653147699df1ac0e9482ba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.375687 16651 tablet_bootstrap.cc:654] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.375528 16594 tablet_service.cc:1511] Processing CreateTablet for tablet 2b61bde285854aadb8c899675630d767 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:17.376789 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b61bde285854aadb8c899675630d767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.377730 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 2b61bde285854aadb8c899675630d767 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:17.378943 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b61bde285854aadb8c899675630d767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.381768 16521 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca9c7566aa4318a09633ed422a10a2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:17.382263 16448 tablet_service.cc:1511] Processing CreateTablet for tablet 2b61bde285854aadb8c899675630d767 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:17.382974 16521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca9c7566aa4318a09633ed422a10a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.383723 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca9c7566aa4318a09633ed422a10a2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:17.384891 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca9c7566aa4318a09633ed422a10a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.357808 16654 tablet_bootstrap.cc:654] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.361442 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 2213423f89b4439f93a8692f6fcd5cf8 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:17.365144 16373 tablet_service.cc:1511] Processing CreateTablet for tablet 24cfd1e3653147699df1ac0e9482ba3e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:17.393754 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2213423f89b4439f93a8692f6fcd5cf8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:17.394636 16409 tablet.cc:2406] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:17.394761 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca9c7566aa4318a09633ed422a10a2 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:17.371954 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 24cfd1e3653147699df1ac0e9482ba3e (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:17.393857 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cfd1e3653147699df1ac0e9482ba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.397051 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca9c7566aa4318a09633ed422a10a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.359278 16653 raft_consensus.cc:385] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.403532 16441 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7dab472244946b139542a19c2e9a6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:17.407109 16520 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7dab472244946b139542a19c2e9a6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:17.409744 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cfd1e3653147699df1ac0e9482ba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.414690 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7dab472244946b139542a19c2e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.412179 16592 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7dab472244946b139542a19c2e9a6 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:17.415512 16653 raft_consensus.cc:740] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.418167 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7dab472244946b139542a19c2e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.421572 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7dab472244946b139542a19c2e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.421664 16653 consensus_queue.cc:260] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.425294 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcd8b1fff044727b789cd91ac9a4e80 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:17.426568 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcd8b1fff044727b789cd91ac9a4e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.433643 16448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b61bde285854aadb8c899675630d767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.473731 16446 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcd8b1fff044727b789cd91ac9a4e80 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:17.475328 16446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcd8b1fff044727b789cd91ac9a4e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.474975 16519 tablet_service.cc:1511] Processing CreateTablet for tablet 7fcd8b1fff044727b789cd91ac9a4e80 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:17.476543 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fcd8b1fff044727b789cd91ac9a4e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.465443 16657 raft_consensus.cc:493] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.478009 16657 raft_consensus.cc:515] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.480531 16657 leader_election.cc:290] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:17.498310 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 8890c126d72a49d0a58319b296abe490 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:17.499557 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8890c126d72a49d0a58319b296abe490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.515463 16652 ts_tablet_manager.cc:1434] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.185s	user 0.026s	sys 0.021s
I20260709 13:18:17.520141 16557 heartbeater.cc:499] Master 127.9.68.126:35691 was elected leader, sending a full tablet report...
I20260709 13:18:17.525216 16483 heartbeater.cc:499] Master 127.9.68.126:35691 was elected leader, sending a full tablet report...
I20260709 13:18:17.530340 16592 tablet_service.cc:1511] Processing CreateTablet for tablet dec45191582145d2a68d3146fb5008e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:17.531558 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec45191582145d2a68d3146fb5008e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.534252 16368 tablet_service.cc:1511] Processing CreateTablet for tablet dec45191582145d2a68d3146fb5008e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:17.535473 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec45191582145d2a68d3146fb5008e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.535670 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 8890c126d72a49d0a58319b296abe490 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:17.537209 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8890c126d72a49d0a58319b296abe490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.537714 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 8890c126d72a49d0a58319b296abe490 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:17.537714 16445 tablet_service.cc:1511] Processing CreateTablet for tablet da7424bbbce44e14bf037b51e9f86195 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:17.539302 16653 ts_tablet_manager.cc:1434] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.187s	user 0.021s	sys 0.004s
I20260709 13:18:17.540201 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7424bbbce44e14bf037b51e9f86195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.540680 16653 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:17.542435 16522 tablet_service.cc:1511] Processing CreateTablet for tablet da7424bbbce44e14bf037b51e9f86195 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:17.544243 16652 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:17.544338 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7424bbbce44e14bf037b51e9f86195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.546288 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8890c126d72a49d0a58319b296abe490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.557650 16594 tablet_service.cc:1511] Processing CreateTablet for tablet da7424bbbce44e14bf037b51e9f86195 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:17.559005 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7424bbbce44e14bf037b51e9f86195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.571062 16654 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:17.571626 16654 ts_tablet_manager.cc:1403] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.303s	user 0.023s	sys 0.040s
I20260709 13:18:17.574733 16654 raft_consensus.cc:359] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.579526 16654 raft_consensus.cc:385] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.579895 16654 raft_consensus.cc:740] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.580809 16654 consensus_queue.cc:260] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.586018 16367 tablet_service.cc:1511] Processing CreateTablet for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:17.590138 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:17.591856 16652 tablet_bootstrap.cc:654] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.591955 16653 tablet_bootstrap.cc:654] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.595973 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.596598 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.616978 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:17.611431 16651 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:17.598402 16520 tablet_service.cc:1511] Processing CreateTablet for tablet dec45191582145d2a68d3146fb5008e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:17.636124 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec45191582145d2a68d3146fb5008e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.639853 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904a0b2b8c6b4ce6aa8e271a91ca8268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.643297 16651 ts_tablet_manager.cc:1403] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.304s	user 0.014s	sys 0.019s
I20260709 13:18:17.648401 16651 raft_consensus.cc:359] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.649093 16651 raft_consensus.cc:385] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.653469 16651 raft_consensus.cc:740] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.654349 16651 consensus_queue.cc:260] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.662339 16652 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:17.662848 16652 ts_tablet_manager.cc:1403] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.119s	user 0.003s	sys 0.008s
I20260709 13:18:17.665779 16652 raft_consensus.cc:359] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.666489 16652 raft_consensus.cc:385] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.666791 16652 raft_consensus.cc:740] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.667831 16654 ts_tablet_manager.cc:1434] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.016s
I20260709 13:18:17.669818 16654 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:17.668375 16631 heartbeater.cc:499] Master 127.9.68.126:35691 was elected leader, sending a full tablet report...
I20260709 13:18:17.678483 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:17.672008 16651 ts_tablet_manager.cc:1434] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.004s
I20260709 13:18:17.667480 16652 consensus_queue.cc:260] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.680465 16651 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:17.683578 16652 ts_tablet_manager.cc:1434] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:17.683524 16369 tablet_service.cc:1511] Processing CreateTablet for tablet dc279b02590c4d1d8bb12e237d2b6879 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:17.684659 16652 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:17.684912 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc279b02590c4d1d8bb12e237d2b6879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.685973 16653 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:17.686703 16519 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b762eaf2849079198e3c617927974 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:17.691615 16653 ts_tablet_manager.cc:1403] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.011s
I20260709 13:18:17.675966 16592 tablet_service.cc:1511] Processing CreateTablet for tablet dc279b02590c4d1d8bb12e237d2b6879 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:17.692103 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b762eaf2849079198e3c617927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.692739 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc279b02590c4d1d8bb12e237d2b6879. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:17.689694 16348 leader_election.cc:343] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.694691 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:17.694983 16653 raft_consensus.cc:359] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.695818 16653 raft_consensus.cc:385] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:17.696209 16348 leader_election.cc:343] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.696377 16653 raft_consensus.cc:740] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.696712 16348 leader_election.cc:304] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:17.697413 16653 consensus_queue.cc:260] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.699836 16653 ts_tablet_manager.cc:1434] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:17.699965 16657 raft_consensus.cc:2749] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.700846 16653 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:17.691035 16654 tablet_bootstrap.cc:654] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.712543 16653 tablet_bootstrap.cc:654] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.717585 16651 tablet_bootstrap.cc:654] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.718767 16652 tablet_bootstrap.cc:654] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.723625 16444 tablet_service.cc:1511] Processing CreateTablet for tablet dc279b02590c4d1d8bb12e237d2b6879 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:17.730763 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc279b02590c4d1d8bb12e237d2b6879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.733255 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b762eaf2849079198e3c617927974 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:17.737836 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7b762eaf2849079198e3c617927974 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:17.739647 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b762eaf2849079198e3c617927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.740142 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7b762eaf2849079198e3c617927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.741575 16666 raft_consensus.cc:493] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.742082 16666 raft_consensus.cc:515] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.744493 16666 leader_election.cc:290] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:17.754014 16594 tablet_service.cc:1511] Processing CreateTablet for tablet f262d583f3a445c68bd8196d351fee97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:17.755280 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f262d583f3a445c68bd8196d351fee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.762606 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 6597b6be11d44863bb49b53494f07b3b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:17.763177 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a639be7534d3881309e65107f6276 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:17.763568 16659 raft_consensus.cc:493] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.763863 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6597b6be11d44863bb49b53494f07b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.764940 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a639be7534d3881309e65107f6276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.767607 16445 tablet_service.cc:1511] Processing CreateTablet for tablet f262d583f3a445c68bd8196d351fee97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:17.768824 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f262d583f3a445c68bd8196d351fee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.773204 16653 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:17.771469 16659 raft_consensus.cc:515] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.773831 16653 ts_tablet_manager.cc:1403] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 13:18:17.773484 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a639be7534d3881309e65107f6276 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:17.775148 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a639be7534d3881309e65107f6276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.776022 16659 leader_election.cc:290] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:17.795809 16652 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:17.796418 16652 ts_tablet_manager.cc:1403] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.003s
I20260709 13:18:17.777017 16653 raft_consensus.cc:359] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.804567 16653 raft_consensus.cc:385] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.817655 16654 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:17.818409 16654 ts_tablet_manager.cc:1403] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.022s
I20260709 13:18:17.819617 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 6597b6be11d44863bb49b53494f07b3b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:17.821429 16654 raft_consensus.cc:359] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.822139 16654 raft_consensus.cc:385] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.822424 16654 raft_consensus.cc:740] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.823316 16654 consensus_queue.cc:260] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.825800 16654 ts_tablet_manager.cc:1434] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:17.825906 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6597b6be11d44863bb49b53494f07b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.826867 16654 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:17.808916 16519 tablet_service.cc:1511] Processing CreateTablet for tablet f262d583f3a445c68bd8196d351fee97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:17.829102 16519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f262d583f3a445c68bd8196d351fee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.833748 16448 tablet_service.cc:1511] Processing CreateTablet for tablet 6597b6be11d44863bb49b53494f07b3b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:17.847509 16661 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.848166 16448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6597b6be11d44863bb49b53494f07b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.848001 16661 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.852779 16661 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:17.852872 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a639be7534d3881309e65107f6276 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:17.854205 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a639be7534d3881309e65107f6276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.813293 16653 raft_consensus.cc:740] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.862496 16652 raft_consensus.cc:359] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.865250 16652 raft_consensus.cc:385] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.864396 16653 consensus_queue.cc:260] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:17.863961 16651 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:17.866894 16652 raft_consensus.cc:740] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.872792 16653 ts_tablet_manager.cc:1434] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:18:17.881525 16520 tablet_service.cc:1511] Processing CreateTablet for tablet cb76a2947ae845cab4136ccd212eb71f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:17.887212 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76a2947ae845cab4136ccd212eb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.886860 16652 consensus_queue.cc:260] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.889166 16652 ts_tablet_manager.cc:1434] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 13:18:17.891284 16652 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:17.891489 16367 tablet_service.cc:1511] Processing CreateTablet for tablet cb76a2947ae845cab4136ccd212eb71f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:17.892758 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76a2947ae845cab4136ccd212eb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.887244 16653 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:17.900848 16441 tablet_service.cc:1511] Processing CreateTablet for tablet e871d54ea7e74517a5f6baa2a0e3d96c (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:17.902065 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e871d54ea7e74517a5f6baa2a0e3d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.907657 16653 tablet_bootstrap.cc:654] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.911593 16651 ts_tablet_manager.cc:1403] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.231s	user 0.033s	sys 0.022s
I20260709 13:18:17.915566 16661 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.928436 16661 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:17.930608 16661 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:17.930707 16522 tablet_service.cc:1511] Processing CreateTablet for tablet e871d54ea7e74517a5f6baa2a0e3d96c (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:17.931981 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e871d54ea7e74517a5f6baa2a0e3d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.934118 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:17.935272 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.937330 16654 tablet_bootstrap.cc:654] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.949508 16651 raft_consensus.cc:359] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.950093 16666 raft_consensus.cc:493] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.950301 16651 raft_consensus.cc:385] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.950594 16666 raft_consensus.cc:515] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:17.951709 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:17.960352 16594 tablet_service.cc:1511] Processing CreateTablet for tablet cb76a2947ae845cab4136ccd212eb71f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 13:18:17.960628 16497 leader_election.cc:343] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.961697 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76a2947ae845cab4136ccd212eb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.951257 16589 tablet_service.cc:1511] Processing CreateTablet for tablet e871d54ea7e74517a5f6baa2a0e3d96c (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:17.970052 16652 tablet_bootstrap.cc:654] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.970178 16666 leader_election.cc:290] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:17.972868 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 80f3da48c10048b7b13cfa0b45d7ea8a (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:17.973587 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e871d54ea7e74517a5f6baa2a0e3d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.974334 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 80f3da48c10048b7b13cfa0b45d7ea8a (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:17.974948 16516 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:17.975524 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f3da48c10048b7b13cfa0b45d7ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.976193 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.976320 16592 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf73a024d584db697c00de0dc28ca5b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:17.974948 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 80f3da48c10048b7b13cfa0b45d7ea8a (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:17.978642 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f3da48c10048b7b13cfa0b45d7ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.978289 16517 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf73a024d584db697c00de0dc28ca5b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:17.979593 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf73a024d584db697c00de0dc28ca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.950614 16651 raft_consensus.cc:740] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.982007 16651 consensus_queue.cc:260] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:17.984064 16373 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf73a024d584db697c00de0dc28ca5b (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:17.985308 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf73a024d584db697c00de0dc28ca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.985652 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf73a024d584db697c00de0dc28ca5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.986128 16443 tablet_service.cc:1511] Processing CreateTablet for tablet ca85bd059c93407bad570daec3df678f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:17.987349 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85bd059c93407bad570daec3df678f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.951603 16445 tablet_service.cc:1511] Processing CreateTablet for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:17.988440 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cb00929bfa4e8eb1eb9cbcbfd81575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.993274 16651 ts_tablet_manager.cc:1434] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:18:17.994315 16651 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:18.027532 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.029101 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:18.034219 16424 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:18.034909 16424 leader_election.cc:343] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.009852 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f3da48c10048b7b13cfa0b45d7ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.061174 16659 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.061751 16659 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.062484 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.063163 16654 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:18.063653 16654 ts_tablet_manager.cc:1403] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.237s	user 0.020s	sys 0.014s
I20260709 13:18:18.064074 16659 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.064852 16657 raft_consensus.cc:493] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.065379 16657 raft_consensus.cc:515] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.065843 16520 tablet_service.cc:1511] Processing CreateTablet for tablet ca85bd059c93407bad570daec3df678f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:18.067137 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85bd059c93407bad570daec3df678f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.067351 16657 leader_election.cc:290] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:18.071044 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.071408 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.063176 16532 raft_consensus.cc:2468] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
W20260709 13:18:18.072623 16348 leader_election.cc:343] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.072765 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
W20260709 13:18:18.074555 16348 leader_election.cc:343] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.074978 16348 leader_election.cc:304] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:18.075260 16654 raft_consensus.cc:359] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.075749 16657 raft_consensus.cc:2749] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.076370 16654 raft_consensus.cc:385] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.076771 16654 raft_consensus.cc:740] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.075239 16652 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:18.082963 16659 raft_consensus.cc:493] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.085657 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.085954 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.086154 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.086992 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:18.087910 16423 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.088442 16423 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.088967 16651 tablet_bootstrap.cc:654] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.089429 16661 raft_consensus.cc:2749] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.083174 16652 ts_tablet_manager.cc:1403] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.012s
W20260709 13:18:18.089926 16423 leader_election.cc:343] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.086289 16659 raft_consensus.cc:515] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.090744 16423 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.091524 16661 raft_consensus.cc:2749] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.093670 16653 tablet_bootstrap.cc:492] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:18.094202 16653 ts_tablet_manager.cc:1403] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.012s
I20260709 13:18:18.095398 16659 leader_election.cc:290] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.095753 16654 consensus_queue.cc:260] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.097350 16653 raft_consensus.cc:359] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.098093 16653 raft_consensus.cc:385] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.098383 16653 raft_consensus.cc:740] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.099342 16653 consensus_queue.cc:260] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.101601 16653 ts_tablet_manager.cc:1434] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:18:18.098094 16654 ts_tablet_manager.cc:1434] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:18:18.104349 16654 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:18.107539 16653 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:18.109997 16652 raft_consensus.cc:359] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.110719 16652 raft_consensus.cc:385] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.111047 16652 raft_consensus.cc:740] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.112185 16652 consensus_queue.cc:260] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.122169 16652 ts_tablet_manager.cc:1434] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:18:18.124552 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 94aaf89415784d2dbc3cf7640506a4cd (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:18.125981 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aaf89415784d2dbc3cf7640506a4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.127413 16654 tablet_bootstrap.cc:654] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.131605 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 94aaf89415784d2dbc3cf7640506a4cd (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:18.133268 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aaf89415784d2dbc3cf7640506a4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.133858 16589 tablet_service.cc:1511] Processing CreateTablet for tablet ca85bd059c93407bad570daec3df678f (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:18.140838 16652 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:18.142935 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.143836 16605 raft_consensus.cc:2468] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:18.149618 16653 tablet_bootstrap.cc:654] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.150878 16516 tablet_service.cc:1511] Processing CreateTablet for tablet 94aaf89415784d2dbc3cf7640506a4cd (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:18.152086 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aaf89415784d2dbc3cf7640506a4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.152930 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85bd059c93407bad570daec3df678f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.157073 16651 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:18.157613 16651 ts_tablet_manager.cc:1403] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.011s
I20260709 13:18:18.165517 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.165882 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cad407ad0d450db9c2bc97b1deefe3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.173269 16594 tablet_service.cc:1511] Processing CreateTablet for tablet 572881c47e5e493a8a45f1bb34f4d7e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:18.174604 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572881c47e5e493a8a45f1bb34f4d7e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:18.165927 16571 leader_election.cc:343] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.179379 16571 leader_election.cc:304] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:18.180992 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 572881c47e5e493a8a45f1bb34f4d7e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:18.182309 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572881c47e5e493a8a45f1bb34f4d7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.185549 16666 raft_consensus.cc:2804] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.185976 16666 raft_consensus.cc:493] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.186375 16666 raft_consensus.cc:3060] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.186116 16651 raft_consensus.cc:359] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.187170 16651 raft_consensus.cc:385] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.187579 16651 raft_consensus.cc:740] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.188540 16651 consensus_queue.cc:260] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.193467 16498 leader_election.cc:304] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:18.194375 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:18.194692 16571 leader_election.cc:343] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.195379 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cad407ad0d450db9c2bc97b1deefe3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.195701 16571 leader_election.cc:304] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:18.196163 16383 raft_consensus.cc:2468] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
W20260709 13:18:18.196285 16498 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.197572 16659 raft_consensus.cc:2804] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.197945 16659 raft_consensus.cc:493] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.198261 16659 raft_consensus.cc:3060] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.199007 16651 ts_tablet_manager.cc:1434] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:18:18.200028 16651 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:18.201550 16497 leader_election.cc:304] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
W20260709 13:18:18.204051 16498 leader_election.cc:343] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.205480 16653 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:18.205591 16657 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.206000 16653 ts_tablet_manager.cc:1403] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.009s
I20260709 13:18:18.206113 16657 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.206602 16651 tablet_bootstrap.cc:654] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.208797 16445 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16ffbf47354393b50c7d429e157a85 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:18.210171 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16ffbf47354393b50c7d429e157a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.209151 16653 raft_consensus.cc:359] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.215449 16691 raft_consensus.cc:2804] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:18.216212 16497 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.216944 16520 tablet_service.cc:1511] Processing CreateTablet for tablet e56b22b1a54c4c578938b845034bf989 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:18.217254 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 572881c47e5e493a8a45f1bb34f4d7e5 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:18.214395 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.229204 16458 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:18.229825 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572881c47e5e493a8a45f1bb34f4d7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.213708 16657 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.230873 16348 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:18.231714 16657 raft_consensus.cc:2804] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.232059 16657 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.232378 16657 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.219465 16371 tablet_service.cc:1511] Processing CreateTablet for tablet e56b22b1a54c4c578938b845034bf989 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:18.234119 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56b22b1a54c4c578938b845034bf989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.218477 16593 tablet_service.cc:1511] Processing CreateTablet for tablet e56b22b1a54c4c578938b845034bf989 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:18:18.222859 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:18.228068 16497 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.227731 16653 raft_consensus.cc:385] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.228688 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56b22b1a54c4c578938b845034bf989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.249208 16653 raft_consensus.cc:740] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
W20260709 13:18:18.249452 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 54777.9us
W20260709 13:18:18.250437 16571 leader_election.cc:343] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.250375 16653 consensus_queue.cc:260] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.253634 16654 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:18.254143 16654 ts_tablet_manager.cc:1403] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.150s	user 0.028s	sys 0.018s
I20260709 13:18:18.257154 16653 ts_tablet_manager.cc:1434] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:18:18.222456 16652 tablet_bootstrap.cc:654] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.257180 16654 raft_consensus.cc:359] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.258129 16654 raft_consensus.cc:385] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.258400 16653 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:18.258436 16654 raft_consensus.cc:740] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.259361 16654 consensus_queue.cc:260] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.227568 16691 raft_consensus.cc:493] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.244995 16657 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.277611 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56b22b1a54c4c578938b845034bf989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.279167 16690 raft_consensus.cc:2749] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.271008 16661 raft_consensus.cc:493] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.268473 16691 raft_consensus.cc:3060] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.281771 16661 raft_consensus.cc:515] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.283005 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16ffbf47354393b50c7d429e157a85 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:18.284071 16661 leader_election.cc:290] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:18.284240 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16ffbf47354393b50c7d429e157a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.287667 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.288805 16666 raft_consensus.cc:515] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.290086 16606 raft_consensus.cc:2393] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:18.292481 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.293013 16458 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.299721 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.301743 16592 tablet_service.cc:1511] Processing CreateTablet for tablet cabb8db6421b49da935435b9f4dd7afa (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:18.302479 16458 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:18.303036 16592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb8db6421b49da935435b9f4dd7afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.303634 16348 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:18.309168 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 62aa96fdb9e94536805e98e02a69f564 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:18.309909 16666 leader_election.cc:290] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:18.310598 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aa96fdb9e94536805e98e02a69f564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.311924 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:18.271023 16659 raft_consensus.cc:515] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.314323 16530 raft_consensus.cc:2393] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:18.316663 16423 leader_election.cc:304] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.317870 16661 raft_consensus.cc:3060] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.319356 16653 tablet_bootstrap.cc:654] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.320101 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:18.320921 16606 raft_consensus.cc:2393] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:18.321805 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.316931 16659 leader_election.cc:290] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:18.306432 16657 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.334717 16657 raft_consensus.cc:2804] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.335307 16657 raft_consensus.cc:697] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:18.333536 16445 tablet_service.cc:1511] Processing CreateTablet for tablet 62aa96fdb9e94536805e98e02a69f564 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:18.336576 16445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aa96fdb9e94536805e98e02a69f564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.336531 16657 consensus_queue.cc:237] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.330466 16652 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:18.343083 16652 ts_tablet_manager.cc:1403] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.004s
I20260709 13:18:18.346287 16652 raft_consensus.cc:359] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.346962 16652 raft_consensus.cc:385] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.347262 16652 raft_consensus.cc:740] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.325225 16659 raft_consensus.cc:2749] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.348004 16652 consensus_queue.cc:260] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
W20260709 13:18:18.327497 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44563, user_credentials={real_user=slave}} blocked reactor thread for 109897us
I20260709 13:18:18.358120 16373 tablet_service.cc:1511] Processing CreateTablet for tablet cabb8db6421b49da935435b9f4dd7afa (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:18.359966 16654 ts_tablet_manager.cc:1434] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.106s	user 0.016s	sys 0.018s
I20260709 13:18:18.360088 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb8db6421b49da935435b9f4dd7afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.360198 16691 raft_consensus.cc:515] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.359660 16443 tablet_service.cc:1511] Processing CreateTablet for tablet cabb8db6421b49da935435b9f4dd7afa (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:18.362387 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb8db6421b49da935435b9f4dd7afa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.362967 16654 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:18.366320 16594 tablet_service.cc:1511] Processing CreateTablet for tablet 112f015baf52408f865d1b5784545dfe (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:18.367527 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112f015baf52408f865d1b5784545dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.368253 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cad407ad0d450db9c2bc97b1deefe3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
W20260709 13:18:18.369685 16498 leader_election.cc:343] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.370064 16654 tablet_bootstrap.cc:654] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.370772 16691 leader_election.cc:290] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.379076 16651 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:18.381824 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cad407ad0d450db9c2bc97b1deefe3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:18.382629 16694 raft_consensus.cc:493] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.384284 16520 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16ffbf47354393b50c7d429e157a85 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:18.386514 16522 tablet_service.cc:1511] Processing CreateTablet for tablet 112f015baf52408f865d1b5784545dfe (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:18.399037 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112f015baf52408f865d1b5784545dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.386554 16516 tablet_service.cc:1511] Processing CreateTablet for tablet 62aa96fdb9e94536805e98e02a69f564 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:18.401448 16653 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:18.401970 16653 ts_tablet_manager.cc:1403] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.005s
I20260709 13:18:18.402372 16516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aa96fdb9e94536805e98e02a69f564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.404546 16653 raft_consensus.cc:359] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.405032 16653 raft_consensus.cc:385] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.405205 16653 raft_consensus.cc:740] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.406077 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16ffbf47354393b50c7d429e157a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.407967 16651 ts_tablet_manager.cc:1403] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.208s	user 0.025s	sys 0.032s
I20260709 13:18:18.406078 16653 consensus_queue.cc:260] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.410073 16694 raft_consensus.cc:515] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.410812 16382 raft_consensus.cc:3060] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.412922 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4b3d6cec454dffaaf81084fdf67a55" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.412943 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 112f015baf52408f865d1b5784545dfe (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:18.416296 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112f015baf52408f865d1b5784545dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.416086 16497 leader_election.cc:304] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.423148 16659 raft_consensus.cc:2749] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.426473 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.427109 16457 raft_consensus.cc:2468] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:18.428390 16497 leader_election.cc:304] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:18.429157 16691 raft_consensus.cc:2804] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.429539 16691 raft_consensus.cc:493] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.429865 16691 raft_consensus.cc:3060] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.453404 16659 raft_consensus.cc:493] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.457299 16659 raft_consensus.cc:515] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.446394 16694 leader_election.cc:290] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.457800 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.466326 16383 raft_consensus.cc:2468] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:18.467250 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:18.468511 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.482043 16651 raft_consensus.cc:359] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.483163 16651 raft_consensus.cc:385] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.483104 16517 tablet_service.cc:1511] Processing CreateTablet for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:18.483857 16651 raft_consensus.cc:740] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.484639 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.485559 16651 consensus_queue.cc:260] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.498950 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.499600 16383 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:18.499755 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.500869 16497 leader_election.cc:304] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:18.501865 16694 raft_consensus.cc:2804] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.502235 16694 raft_consensus.cc:493] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.502573 16694 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.487191 16382 raft_consensus.cc:2468] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:18.489864 16661 raft_consensus.cc:2749] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.490878 16652 ts_tablet_manager.cc:1434] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.000s
I20260709 13:18:18.498368 16659 leader_election.cc:290] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.500942 16651 ts_tablet_manager.cc:1434] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.000s
I20260709 13:18:18.489493 16699 raft_consensus.cc:493] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.508270 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.510301 16497 leader_election.cc:304] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.511235 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:18.514336 16606 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:18.514941 16659 raft_consensus.cc:2804] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.508800 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:18.515883 16605 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.521677 16371 tablet_service.cc:1511] Processing CreateTablet for tablet c3c54af7077b472491a17152358dfcd0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:18.523365 16661 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.523835 16661 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.523097 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c54af7077b472491a17152358dfcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.531814 16443 tablet_service.cc:1511] Processing CreateTablet for tablet c3c54af7077b472491a17152358dfcd0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:18.513379 16699 raft_consensus.cc:515] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.533080 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c54af7077b472491a17152358dfcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.535386 16520 tablet_service.cc:1511] Processing CreateTablet for tablet c3c54af7077b472491a17152358dfcd0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:18.556468 16520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c54af7077b472491a17152358dfcd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.537056 16281 catalog_manager.cc:5697] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.541698 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958f3c6c84a24c3e9a6a13aa83ea11c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.544811 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 769cef901a274500b98b9322eab57bc4 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:18.559544 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:18.559914 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769cef901a274500b98b9322eab57bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.542068 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.535950 16373 tablet_service.cc:1511] Processing CreateTablet for tablet d8a1ccad75124fc1836b2ebf138c18b1 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:18.539394 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.565747 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a1ccad75124fc1836b2ebf138c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.536608 16441 tablet_service.cc:1511] Processing CreateTablet for tablet d8a1ccad75124fc1836b2ebf138c18b1 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:18.567028 16441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a1ccad75124fc1836b2ebf138c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.533540 16696 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.548132 16595 tablet_service.cc:1511] Processing CreateTablet for tablet d8a1ccad75124fc1836b2ebf138c18b1 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:18.569559 16696 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.570505 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a1ccad75124fc1836b2ebf138c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.572448 16606 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:18.540867 16661 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.582636 16654 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:18.583285 16654 ts_tablet_manager.cc:1403] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.220s	user 0.028s	sys 0.040s
I20260709 13:18:18.585568 16652 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
W20260709 13:18:18.590095 16423 leader_election.cc:343] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.591243 16696 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.591925 16651 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:18.593660 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.594283 16382 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:18.595582 16423 leader_election.cc:304] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:18.598232 16458 raft_consensus.cc:2468] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:18.534109 16699 leader_election.cc:290] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:18.601001 16424 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:18.513234 16694 raft_consensus.cc:515] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.534327 16457 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:18.533211 16691 raft_consensus.cc:515] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.606714 16659 raft_consensus.cc:697] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:18.615664 16594 tablet_service.cc:1511] Processing CreateTablet for tablet 769cef901a274500b98b9322eab57bc4 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:18.617714 16594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769cef901a274500b98b9322eab57bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.616362 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 769cef901a274500b98b9322eab57bc4 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:18.620210 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769cef901a274500b98b9322eab57bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.620136 16444 tablet_service.cc:1511] Processing CreateTablet for tablet d70f92685aef44de910d2e3645e4ed91 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:18.620775 16659 consensus_queue.cc:237] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.621554 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f92685aef44de910d2e3645e4ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.621289 16517 tablet_service.cc:1511] Processing CreateTablet for tablet d70f92685aef44de910d2e3645e4ed91 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:18.622747 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f92685aef44de910d2e3645e4ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.625905 16653 ts_tablet_manager.cc:1434] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.224s	user 0.009s	sys 0.018s
I20260709 13:18:18.631016 16653 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:18.639354 16651 tablet_bootstrap.cc:654] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.641793 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:18.606457 16605 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:18.611693 16661 raft_consensus.cc:2804] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.649869 16699 raft_consensus.cc:2804] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.670040 16530 raft_consensus.cc:2393] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:18.685626 16456 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:18.687484 16571 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:18.673008 16593 tablet_service.cc:1511] Processing CreateTablet for tablet d70f92685aef44de910d2e3645e4ed91 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:18.688318 16696 raft_consensus.cc:2804] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.673950 16652 tablet_bootstrap.cc:654] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.688701 16696 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.689105 16696 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.674651 16694 leader_election.cc:290] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.676839 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:18.693588 16699 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.693810 16382 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.694041 16699 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.677745 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.688701 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70f92685aef44de910d2e3645e4ed91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.698761 16571 leader_election.cc:304] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:18.700145 16666 raft_consensus.cc:2804] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.700691 16666 raft_consensus.cc:697] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:18.701083 16455 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.701553 16666 consensus_queue.cc:237] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.677167 16653 tablet_bootstrap.cc:654] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.632289 16654 raft_consensus.cc:359] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.706477 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1de4c82797410d855b09dc2152d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:18.709851 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1de4c82797410d855b09dc2152d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.708966 16654 raft_consensus.cc:385] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.721266 16455 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:18.739566 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.768512 16458 raft_consensus.cc:3060] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.737246 16696 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.739899 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec158588f7a145b6bb53ff67441c3e65" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:18.738137 16691 leader_election.cc:290] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.753955 16654 raft_consensus.cc:740] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.772312 16278 catalog_manager.cc:5697] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.771387 16383 raft_consensus.cc:3060] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.777942 16497 leader_election.cc:304] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:18.788092 16654 consensus_queue.cc:260] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.789906 16659 raft_consensus.cc:2804] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.790465 16659 raft_consensus.cc:697] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:18.791384 16659 consensus_queue.cc:237] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.794538 16522 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1de4c82797410d855b09dc2152d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:18.795935 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1de4c82797410d855b09dc2152d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.795780 16458 raft_consensus.cc:2468] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:18.797144 16497 leader_election.cc:304] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:18.798131 16694 raft_consensus.cc:2804] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.798755 16694 raft_consensus.cc:697] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:18.798609 16699 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:18.799892 16694 consensus_queue.cc:237] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.804109 16654 ts_tablet_manager.cc:1434] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.220s	user 0.012s	sys 0.002s
I20260709 13:18:18.805178 16654 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:18.809214 16382 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:18.809638 16652 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:18.810127 16652 ts_tablet_manager.cc:1403] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.246s	user 0.033s	sys 0.071s
I20260709 13:18:18.811156 16666 raft_consensus.cc:493] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.811641 16666 raft_consensus.cc:515] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.778221 16696 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:18.813243 16652 raft_consensus.cc:359] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.781786 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4f3010d6a401980cde5692a80f092 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:18.813742 16383 raft_consensus.cc:2468] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:18.814829 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4f3010d6a401980cde5692a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.815114 16652 raft_consensus.cc:385] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.815631 16652 raft_consensus.cc:740] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.784404 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:18.820382 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:18.821271 16605 raft_consensus.cc:2393] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:18.821813 16699 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.818007 16455 raft_consensus.cc:2393] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:18.767984 16661 raft_consensus.cc:493] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.825469 16661 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.792464 16279 catalog_manager.cc:5697] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.826233 16666 leader_election.cc:290] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:18.814401 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.829267 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:18.829718 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
W20260709 13:18:18.831601 16571 leader_election.cc:343] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.832196 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:18.832531 16571 leader_election.cc:343] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.832700 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 55a58fe97303471a81a4511d2bdc4933 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:18.830834 16652 consensus_queue.cc:260] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.833797 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a58fe97303471a81a4511d2bdc4933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.834939 16651 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:18.835434 16651 ts_tablet_manager.cc:1403] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.261s	user 0.028s	sys 0.019s
I20260709 13:18:18.836721 16653 tablet_bootstrap.cc:492] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:18.832969 16571 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:18.786365 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1de4c82797410d855b09dc2152d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:18.839798 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4f3010d6a401980cde5692a80f092 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:18.841259 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1de4c82797410d855b09dc2152d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.840831 16517 tablet_service.cc:1511] Processing CreateTablet for tablet 55a58fe97303471a81a4511d2bdc4933 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:18.841548 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4f3010d6a401980cde5692a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.842247 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a58fe97303471a81a4511d2bdc4933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.837256 16653 ts_tablet_manager.cc:1403] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.000s
W20260709 13:18:18.846208 16571 leader_election.cc:343] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:18.849644 16571 leader_election.cc:343] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.849684 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 55a58fe97303471a81a4511d2bdc4933 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:18.850167 16571 leader_election.cc:304] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:18.851008 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a58fe97303471a81a4511d2bdc4933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.846279 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4f3010d6a401980cde5692a80f092 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:18.854548 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4f3010d6a401980cde5692a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.855880 16654 tablet_bootstrap.cc:654] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.837225 16661 raft_consensus.cc:515] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.859815 16661 leader_election.cc:290] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:18.846875 16666 raft_consensus.cc:2749] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.861775 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:18.863268 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a28d714f0646cf96db4e9be81b2de6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:18.863905 16381 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:18.864347 16696 raft_consensus.cc:2749] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.865491 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
W20260709 13:18:18.866954 16423 leader_election.cc:343] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.867408 16423 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.867816 16651 raft_consensus.cc:359] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.868484 16651 raft_consensus.cc:385] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.868659 16661 raft_consensus.cc:2749] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.868824 16651 raft_consensus.cc:740] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.873157 16653 raft_consensus.cc:359] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.873909 16653 raft_consensus.cc:385] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.874146 16652 ts_tablet_manager.cc:1434] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:18:18.874197 16653 raft_consensus.cc:740] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.875375 16652 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:18.875790 16651 consensus_queue.cc:260] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.888032 16651 ts_tablet_manager.cc:1434] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:18:18.882550 16381 raft_consensus.cc:2468] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:18.888701 16442 tablet_service.cc:1511] Processing CreateTablet for tablet 4383915d34cf48d2b5a1bd28a79089ae (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:18.894290 16423 leader_election.cc:304] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:18.895277 16651 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:18.895714 16661 raft_consensus.cc:2804] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:18.896272 16661 raft_consensus.cc:697] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:18.897248 16661 consensus_queue.cc:237] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:18.894687 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4383915d34cf48d2b5a1bd28a79089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.879501 16653 consensus_queue.cc:260] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:18.904660 16593 tablet_service.cc:1511] Processing CreateTablet for tablet 4383915d34cf48d2b5a1bd28a79089ae (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:18.905843 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4383915d34cf48d2b5a1bd28a79089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.906072 16652 tablet_bootstrap.cc:654] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.909938 16518 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:18.910408 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb6727c39d3449f9ec4674c95b36423 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:18.911242 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.911654 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb6727c39d3449f9ec4674c95b36423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.911306 16369 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb6727c39d3449f9ec4674c95b36423 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:18.915581 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:18.909741 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:18.918303 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb6727c39d3449f9ec4674c95b36423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.919803 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.917277 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d0fd0cc28d7407a94234bdc87b0d6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.928720 16522 tablet_service.cc:1511] Processing CreateTablet for tablet 4383915d34cf48d2b5a1bd28a79089ae (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:18.933354 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4383915d34cf48d2b5a1bd28a79089ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.935389 16443 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb6727c39d3449f9ec4674c95b36423 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:18.936180 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6fc8233a26484889a5212bec2b69ed (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:18.930495 16657 consensus_queue.cc:1048] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:18.937417 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6fc8233a26484889a5212bec2b69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.939286 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb6727c39d3449f9ec4674c95b36423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.940948 16653 ts_tablet_manager.cc:1434] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.003s
I20260709 13:18:18.940212 16517 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6fc8233a26484889a5212bec2b69ed (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:18.930472 16651 tablet_bootstrap.cc:654] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.952291 16657 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.953928 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6fc8233a26484889a5212bec2b69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.954053 16657 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:18.956166 16657 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:18.957306 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:18.957962 16530 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:18.959355 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:18.962813 16349 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.963889 16348 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:18.965446 16653 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:18.967088 16697 raft_consensus.cc:2804] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.967494 16697 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.967851 16697 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.972929 16657 consensus_queue.cc:1048] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:18.981562 16654 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:18.982065 16654 ts_tablet_manager.cc:1403] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.001s
I20260709 13:18:18.997802 16651 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.000025 16589 tablet_service.cc:1511] Processing CreateTablet for tablet bf91bf6c338842e8b2042525dff782ec (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:19.001148 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91bf6c338842e8b2042525dff782ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.986408 16659 raft_consensus.cc:493] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.998308 16651 ts_tablet_manager.cc:1403] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.009s
I20260709 13:18:19.005462 16659 raft_consensus.cc:515] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.014037 16281 catalog_manager.cc:5697] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.016559 16281 catalog_manager.cc:5697] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.020522 16368 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6fc8233a26484889a5212bec2b69ed (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:19.028124 16659 leader_election.cc:290] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.029397 16589 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1f497bdffb4230b18aaec54cb04de0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:19.029723 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.030473 16589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1f497bdffb4230b18aaec54cb04de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.030346 16606 raft_consensus.cc:2468] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.027905 16443 tablet_service.cc:1511] Processing CreateTablet for tablet bf91bf6c338842e8b2042525dff782ec (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:19.032177 16443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91bf6c338842e8b2042525dff782ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.031165 16368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6fc8233a26484889a5212bec2b69ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.037061 16498 leader_election.cc:304] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.037973 16659 raft_consensus.cc:2804] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.038333 16659 raft_consensus.cc:493] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.038694 16659 raft_consensus.cc:3060] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.038357 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.040062 16455 raft_consensus.cc:2468] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.042552 16369 tablet_service.cc:1511] Processing CreateTablet for tablet ceb398a629fc4b66bd64c691b6f3c181 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:19.042668 16444 tablet_service.cc:1511] Processing CreateTablet for tablet ceb398a629fc4b66bd64c691b6f3c181 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:19.043692 16369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb398a629fc4b66bd64c691b6f3c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.043825 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb398a629fc4b66bd64c691b6f3c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.025100 16697 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.049676 16517 tablet_service.cc:1511] Processing CreateTablet for tablet ceb398a629fc4b66bd64c691b6f3c181 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:19.050889 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb398a629fc4b66bd64c691b6f3c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.051169 16652 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.051661 16652 ts_tablet_manager.cc:1403] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.016s
I20260709 13:18:19.051448 16518 tablet_service.cc:1511] Processing CreateTablet for tablet bf91bf6c338842e8b2042525dff782ec (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:19.052654 16518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91bf6c338842e8b2042525dff782ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.053820 16659 raft_consensus.cc:515] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.057348 16653 tablet_bootstrap.cc:654] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.057780 16371 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1f497bdffb4230b18aaec54cb04de0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:19.058347 16654 raft_consensus.cc:359] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.058884 16371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1f497bdffb4230b18aaec54cb04de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.059111 16654 raft_consensus.cc:385] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.059443 16654 raft_consensus.cc:740] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.060148 16654 consensus_queue.cc:260] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.062184 16697 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.062664 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:19.063247 16530 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.064765 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
W20260709 13:18:19.066150 16349 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.063153 16652 raft_consensus.cc:359] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.070375 16652 raft_consensus.cc:385] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.070662 16652 raft_consensus.cc:740] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.060673 16280 catalog_manager.cc:5697] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.071822 16652 consensus_queue.cc:260] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.074257 16652 ts_tablet_manager.cc:1434] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 13:18:19.075232 16652 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.077667 16654 ts_tablet_manager.cc:1434] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:18:19.078677 16654 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.078887 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.079453 16458 raft_consensus.cc:3060] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.106820 16652 tablet_bootstrap.cc:654] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.116732 16530 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:19.108944 16651 raft_consensus.cc:359] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.120970 16651 raft_consensus.cc:385] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.121292 16651 raft_consensus.cc:740] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.123412 16654 tablet_bootstrap.cc:654] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.124110 16595 tablet_service.cc:1511] Processing CreateTablet for tablet 628e387b7d7546b2a4c4f4e476304b97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:19.132905 16595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628e387b7d7546b2a4c4f4e476304b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.124994 16659 leader_election.cc:290] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.126065 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46de5f77dc445b39fe65f5ee1c65935" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:19.122169 16651 consensus_queue.cc:260] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.140556 16458 raft_consensus.cc:2468] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.146904 16444 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1f497bdffb4230b18aaec54cb04de0 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:19.148545 16444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1f497bdffb4230b18aaec54cb04de0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.148599 16348 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:19.149610 16729 raft_consensus.cc:2804] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.150086 16729 raft_consensus.cc:697] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:19.151026 16666 consensus_queue.cc:1048] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.150899 16729 consensus_queue.cc:237] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.147595 16373 tablet_service.cc:1511] Processing CreateTablet for tablet 628e387b7d7546b2a4c4f4e476304b97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:19.156276 16517 tablet_service.cc:1511] Processing CreateTablet for tablet 628e387b7d7546b2a4c4f4e476304b97 (DEFAULT_TABLE table=test-workload [id=d283df9a4e984bf8b09a3098febda245]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:19.157686 16517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628e387b7d7546b2a4c4f4e476304b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.151999 16605 raft_consensus.cc:3060] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.166594 16652 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.166909 16651 ts_tablet_manager.cc:1434] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.157s	user 0.003s	sys 0.004s
I20260709 13:18:19.167065 16652 ts_tablet_manager.cc:1403] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.028s
I20260709 13:18:19.168654 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628e387b7d7546b2a4c4f4e476304b97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.168972 16651 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.170347 16653 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.170835 16653 ts_tablet_manager.cc:1403] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.011s
I20260709 13:18:19.172098 16652 raft_consensus.cc:359] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.172755 16652 raft_consensus.cc:385] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.173018 16652 raft_consensus.cc:740] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.174394 16652 consensus_queue.cc:260] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.176494 16651 tablet_bootstrap.cc:654] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.176769 16652 ts_tablet_manager.cc:1434] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:18:19.181679 16653 raft_consensus.cc:359] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.182336 16653 raft_consensus.cc:385] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.182598 16653 raft_consensus.cc:740] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.184355 16497 leader_election.cc:304] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:19.186298 16653 consensus_queue.cc:260] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.190111 16652 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.191064 16653 ts_tablet_manager.cc:1434] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:19.195315 16654 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.196276 16654 ts_tablet_manager.cc:1403] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.007s
I20260709 13:18:19.191900 16659 raft_consensus.cc:2804] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.200726 16659 raft_consensus.cc:697] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:19.201609 16659 consensus_queue.cc:237] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.205338 16654 raft_consensus.cc:359] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.206060 16654 raft_consensus.cc:385] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.206373 16654 raft_consensus.cc:740] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.207651 16652 tablet_bootstrap.cc:654] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.207180 16654 consensus_queue.cc:260] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.209878 16605 raft_consensus.cc:2468] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.208045 16694 raft_consensus.cc:493] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.210768 16694 raft_consensus.cc:515] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.191927 16653 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.212615 16694 leader_election.cc:290] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.206632 16278 catalog_manager.cc:5697] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.214334 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.215029 16606 raft_consensus.cc:3060] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.215163 16381 raft_consensus.cc:2468] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.216979 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:19.218753 16497 leader_election.cc:343] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.219432 16497 leader_election.cc:304] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:19.221531 16694 raft_consensus.cc:2804] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.222671 16694 raft_consensus.cc:493] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.222994 16694 raft_consensus.cc:3060] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.241811 16691 consensus_queue.cc:1048] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.254457 16659 consensus_queue.cc:1048] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.257063 16653 tablet_bootstrap.cc:654] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.248595 16654 ts_tablet_manager.cc:1434] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.005s
I20260709 13:18:19.259985 16654 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.260720 16694 raft_consensus.cc:515] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.266570 16654 tablet_bootstrap.cc:654] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:19.267225 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:19.272145 16279 catalog_manager.cc:5697] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.273608 16651 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.274158 16651 ts_tablet_manager.cc:1403] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.006s
I20260709 13:18:19.273608 16652 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.274106 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:19.275092 16652 ts_tablet_manager.cc:1403] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.013s
I20260709 13:18:19.275151 16383 raft_consensus.cc:3060] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.277699 16661 raft_consensus.cc:493] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.278275 16661 raft_consensus.cc:515] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.278541 16652 raft_consensus.cc:359] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.279207 16652 raft_consensus.cc:385] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.279475 16652 raft_consensus.cc:740] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.280216 16652 consensus_queue.cc:260] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.280519 16694 leader_election.cc:290] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.280627 16661 leader_election.cc:290] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.283084 16652 ts_tablet_manager.cc:1434] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:19.282925 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.284053 16652 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.291759 16666 consensus_queue.cc:1048] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.293905 16383 raft_consensus.cc:2468] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.294415 16651 raft_consensus.cc:359] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.295321 16651 raft_consensus.cc:385] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.295646 16651 raft_consensus.cc:740] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.296514 16651 consensus_queue.cc:260] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
W20260709 13:18:19.299329 16424 leader_election.cc:343] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.306110 16651 ts_tablet_manager.cc:1434] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:18:19.307265 16651 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.314126 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
W20260709 13:18:19.317982 16423 leader_election.cc:343] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.318447 16423 leader_election.cc:304] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:19.326529 16661 raft_consensus.cc:2749] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.314193 16497 leader_election.cc:304] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:19.327034 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.327625 16659 raft_consensus.cc:2804] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.328107 16659 raft_consensus.cc:697] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
W20260709 13:18:19.328486 16497 leader_election.cc:343] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.328919 16659 consensus_queue.cc:237] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.331136 16652 tablet_bootstrap.cc:654] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.336792 16653 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.338842 16653 ts_tablet_manager.cc:1403] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.029s
I20260709 13:18:19.339700 16651 tablet_bootstrap.cc:654] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.340873 16729 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.341507 16729 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.345103 16729 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.346386 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.347075 16605 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:19.348383 16349 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.349049 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.349493 16729 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.350005 16729 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.350528 16729 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.349251 16653 raft_consensus.cc:359] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.352417 16456 raft_consensus.cc:1240] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Rejecting Update request from peer 6b5db6fa2cd44206908172d50ddf3532 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:19.355554 16532 raft_consensus.cc:3055] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:19.356153 16532 raft_consensus.cc:740] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:19.357239 16532 consensus_queue.cc:260] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.362687 16455 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:19.362607 16691 consensus_queue.cc:1059] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.352366 16653 raft_consensus.cc:385] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.371145 16653 raft_consensus.cc:740] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.372889 16653 consensus_queue.cc:260] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.382786 16653 ts_tablet_manager.cc:1434] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:18:19.389156 16654 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.388947 16729 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.389714 16654 ts_tablet_manager.cc:1403] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.019s
I20260709 13:18:19.389008 16652 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.391116 16652 ts_tablet_manager.cc:1403] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.006s
I20260709 13:18:19.391433 16729 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.393381 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:19.393949 16606 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.394387 16654 raft_consensus.cc:359] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.395030 16654 raft_consensus.cc:385] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.395275 16654 raft_consensus.cc:740] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.396008 16654 consensus_queue.cc:260] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.396651 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.397423 16455 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.398020 16654 ts_tablet_manager.cc:1434] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:19.398692 16653 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.401361 16651 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.401818 16651 ts_tablet_manager.cc:1403] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.002s
I20260709 13:18:19.403012 16652 raft_consensus.cc:359] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.403642 16652 raft_consensus.cc:385] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.403918 16652 raft_consensus.cc:740] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.404304 16654 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.404809 16652 consensus_queue.cc:260] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.399511 16691 consensus_queue.cc:1243] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Peer 21b412f6f5fb4170b45dd85f95c1ce2f log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:18:19.414407 16651 raft_consensus.cc:359] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.415387 16651 raft_consensus.cc:385] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.415762 16651 raft_consensus.cc:740] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.416785 16651 consensus_queue.cc:260] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.418915 16532 raft_consensus.cc:3060] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:19.420791 16606 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:19.422441 16651 ts_tablet_manager.cc:1434] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:19.423453 16651 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.428200 16455 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:19.428843 16349 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.430348 16729 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.431041 16729 raft_consensus.cc:697] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:19.431951 16729 consensus_queue.cc:237] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.430404 16746 raft_consensus.cc:493] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.437206 16746 raft_consensus.cc:515] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.436794 16694 consensus_queue.cc:1048] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:19.440258 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.440893 16606 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.441061 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.441520 16654 tablet_bootstrap.cc:654] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.442081 16498 leader_election.cc:304] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.444926 16750 raft_consensus.cc:2804] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.445309 16750 raft_consensus.cc:493] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.453035 16750 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.455314 16746 leader_election.cc:290] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.458070 16740 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.450220 16381 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.458760 16740 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.460347 16532 raft_consensus.cc:1275] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:18:19.449158 16278 catalog_manager.cc:5697] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.451637 16751 consensus_queue.cc:1048] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:19.462535 16532 pending_rounds.cc:85] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Aborting all ops after (but not including) 0
I20260709 13:18:19.462693 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.462858 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.463516 16530 raft_consensus.cc:2393] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:19.462898 16532 pending_rounds.cc:107] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:18:19.465269 16532 raft_consensus.cc:2889] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.461920 16740 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.451596 16691 raft_consensus.cc:493] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.464758 16571 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:19.464946 16653 tablet_bootstrap.cc:654] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.469640 16740 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.470274 16661 consensus_queue.cc:1048] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:19.476747 16651 tablet_bootstrap.cc:654] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.473548 16691 raft_consensus.cc:515] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.483562 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:19.484800 16498 leader_election.cc:343] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.478550 16750 raft_consensus.cc:515] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.487591 16750 leader_election.cc:290] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.492518 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:19.493675 16381 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.496383 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:19.497383 16606 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.506716 16653 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.507776 16653 ts_tablet_manager.cc:1403] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.002s
I20260709 13:18:19.510046 16652 ts_tablet_manager.cc:1434] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.119s	user 0.014s	sys 0.029s
I20260709 13:18:19.511412 16652 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.530282 16279 catalog_manager.cc:5697] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.534955 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:19.536469 16497 leader_election.cc:343] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.537045 16497 leader_election.cc:304] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:19.538095 16751 raft_consensus.cc:2749] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.546120 16654 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.546562 16654 ts_tablet_manager.cc:1403] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.028s
I20260709 13:18:19.547039 16653 raft_consensus.cc:359] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.549297 16653 raft_consensus.cc:385] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.549660 16653 raft_consensus.cc:740] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.543018 16691 leader_election.cc:290] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.554219 16654 raft_consensus.cc:359] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.555624 16654 raft_consensus.cc:385] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.555969 16654 raft_consensus.cc:740] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.559207 16653 consensus_queue.cc:260] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.557919 16654 consensus_queue.cc:260] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.563306 16383 raft_consensus.cc:1275] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:19.566061 16652 tablet_bootstrap.cc:654] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.567973 16653 ts_tablet_manager.cc:1434] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.003s
I20260709 13:18:19.570896 16653 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.569590 16381 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.574229 16497 leader_election.cc:304] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:19.575065 16751 raft_consensus.cc:2804] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.575531 16751 raft_consensus.cc:697] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:19.575966 16758 consensus_queue.cc:1048] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.576328 16751 consensus_queue.cc:237] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.561215 16740 raft_consensus.cc:2749] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.568437 16606 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.589802 16654 ts_tablet_manager.cc:1434] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.003s
I20260709 13:18:19.593770 16654 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.597297 16652 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.597913 16652 ts_tablet_manager.cc:1403] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.013s
I20260709 13:18:19.602124 16279 catalog_manager.cc:5697] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.603168 16751 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.603863 16751 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.610157 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:19.611723 16497 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.612857 16651 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.614472 16651 ts_tablet_manager.cc:1403] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.191s	user 0.022s	sys 0.015s
I20260709 13:18:19.614730 16652 raft_consensus.cc:359] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.615402 16652 raft_consensus.cc:385] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.615671 16652 raft_consensus.cc:740] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.616119 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.616406 16652 consensus_queue.cc:260] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.617060 16651 raft_consensus.cc:359] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.617746 16651 raft_consensus.cc:385] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.618010 16651 raft_consensus.cc:740] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.618593 16751 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.618762 16652 ts_tablet_manager.cc:1434] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:18:19.619660 16652 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
W20260709 13:18:19.620296 16497 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.620625 16653 tablet_bootstrap.cc:654] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.620797 16497 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:19.625183 16751 raft_consensus.cc:2749] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.627061 16654 tablet_bootstrap.cc:654] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.627919 16651 consensus_queue.cc:260] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.632987 16651 ts_tablet_manager.cc:1434] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:18:19.633879 16651 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.638157 16652 tablet_bootstrap.cc:654] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.642753 16651 tablet_bootstrap.cc:654] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.646616 16654 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.647022 16653 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.647106 16654 ts_tablet_manager.cc:1403] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.000s
I20260709 13:18:19.647554 16653 ts_tablet_manager.cc:1403] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.001s
I20260709 13:18:19.654443 16653 raft_consensus.cc:359] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.655068 16653 raft_consensus.cc:385] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.655334 16653 raft_consensus.cc:740] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.655303 16654 raft_consensus.cc:359] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.656101 16654 raft_consensus.cc:385] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.656390 16654 raft_consensus.cc:740] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.656203 16653 consensus_queue.cc:260] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.657127 16654 consensus_queue.cc:260] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.658560 16653 ts_tablet_manager.cc:1434] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:19.659170 16654 ts_tablet_manager.cc:1434] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:18:19.659458 16653 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.660488 16654 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.661976 16691 consensus_queue.cc:1048] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.666564 16654 tablet_bootstrap.cc:654] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.671891 16652 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.672478 16652 ts_tablet_manager.cc:1403] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:18:19.676029 16691 raft_consensus.cc:493] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.675946 16652 raft_consensus.cc:359] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.676867 16652 raft_consensus.cc:385] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.677372 16691 raft_consensus.cc:515] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.678961 16651 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.679530 16651 ts_tablet_manager.cc:1403] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 13:18:19.679741 16691 leader_election.cc:290] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.682265 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.682932 16455 raft_consensus.cc:2468] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:19.682971 16651 raft_consensus.cc:359] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.683941 16651 raft_consensus.cc:385] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.684326 16651 raft_consensus.cc:740] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.684562 16497 leader_election.cc:304] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:19.685364 16653 tablet_bootstrap.cc:654] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.685856 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:19.687672 16497 leader_election.cc:343] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.686463 16691 raft_consensus.cc:2804] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.688658 16691 raft_consensus.cc:493] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.685196 16651 consensus_queue.cc:260] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.689121 16691 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.691325 16651 ts_tablet_manager.cc:1434] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:18:19.692528 16651 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.677224 16652 raft_consensus.cc:740] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.694219 16652 consensus_queue.cc:260] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.695075 16653 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.695554 16653 ts_tablet_manager.cc:1403] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.001s
I20260709 13:18:19.696520 16652 ts_tablet_manager.cc:1434] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:18:19.697764 16691 raft_consensus.cc:515] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.698005 16653 raft_consensus.cc:359] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.700769 16653 raft_consensus.cc:385] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.701043 16653 raft_consensus.cc:740] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.701728 16653 consensus_queue.cc:260] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.702670 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:19.703915 16653 ts_tablet_manager.cc:1434] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 13:18:19.704169 16497 leader_election.cc:343] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.704805 16653 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.704903 16651 tablet_bootstrap.cc:654] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.700258 16652 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.715996 16653 tablet_bootstrap.cc:654] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.720288 16691 leader_election.cc:290] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.722126 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.722728 16455 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.725024 16652 tablet_bootstrap.cc:654] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.727469 16723 consensus_queue.cc:1048] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.729276 16755 consensus_queue.cc:1048] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.732028 16755 consensus_queue.cc:1048] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.733471 16729 consensus_queue.cc:1048] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.743924 16653 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.744239 16651 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.744376 16653 ts_tablet_manager.cc:1403] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:18:19.744678 16651 ts_tablet_manager.cc:1403] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:18:19.746548 16758 raft_consensus.cc:493] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.747124 16653 raft_consensus.cc:359] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.747884 16653 raft_consensus.cc:385] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.748163 16653 raft_consensus.cc:740] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.747536 16651 raft_consensus.cc:359] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.747195 16758 raft_consensus.cc:515] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.750784 16654 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.751245 16654 ts_tablet_manager.cc:1403] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.020s
I20260709 13:18:19.751871 16758 leader_election.cc:290] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.754061 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.753914 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1607c4cac14c5598baefa0a5a278a7" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.755146 16654 raft_consensus.cc:359] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.755856 16654 raft_consensus.cc:385] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.756137 16654 raft_consensus.cc:740] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.756222 16651 raft_consensus.cc:385] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.756531 16651 raft_consensus.cc:740] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.756917 16654 consensus_queue.cc:260] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.757148 16651 consensus_queue.cc:260] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.757531 16423 leader_election.cc:304] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:19.765509 16758 raft_consensus.cc:2749] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.757804 16653 consensus_queue.cc:260] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.766106 16651 ts_tablet_manager.cc:1434] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:18:19.767056 16651 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.768291 16653 ts_tablet_manager.cc:1434] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:18:19.771272 16653 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.773100 16651 tablet_bootstrap.cc:654] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.761727 16652 tablet_bootstrap.cc:492] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.771615 16723 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.777741 16723 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.760267 16654 ts_tablet_manager.cc:1434] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:18:19.779404 16654 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.780520 16723 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.781432 16652 ts_tablet_manager.cc:1403] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 13:18:19.782150 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.782884 16456 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:19.784289 16348 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:19.785883 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.786473 16530 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:19.787253 16652 raft_consensus.cc:359] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.788153 16652 raft_consensus.cc:385] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.788493 16652 raft_consensus.cc:740] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.793474 16652 consensus_queue.cc:260] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.796377 16654 tablet_bootstrap.cc:654] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.796957 16723 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.797897 16723 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.798286 16723 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.787267 16455 raft_consensus.cc:2468] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:19.799963 16758 raft_consensus.cc:493] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.800457 16758 raft_consensus.cc:515] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.802587 16652 ts_tablet_manager.cc:1434] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:18:19.802896 16758 leader_election.cc:290] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.799741 16497 leader_election.cc:304] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:19.804633 16755 raft_consensus.cc:2804] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.805269 16755 raft_consensus.cc:697] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:19.806430 16755 consensus_queue.cc:237] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.811120 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:19.814459 16424 leader_election.cc:343] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.812058 16723 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.816808 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.818660 16653 tablet_bootstrap.cc:654] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:19.818598 16423 leader_election.cc:343] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.821842 16423 leader_election.cc:304] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:19.823619 16758 raft_consensus.cc:2749] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.825488 16455 raft_consensus.cc:3060] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.803822 16652 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:19.830677 16651 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:19.831103 16651 ts_tablet_manager.cc:1403] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.030s
I20260709 13:18:19.833629 16651 raft_consensus.cc:359] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.834219 16651 raft_consensus.cc:385] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.834481 16651 raft_consensus.cc:740] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.835146 16651 consensus_queue.cc:260] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.836723 16666 raft_consensus.cc:493] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.837203 16666 raft_consensus.cc:515] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.839443 16666 leader_election.cc:290] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.841739 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.842569 16530 raft_consensus.cc:2468] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:19.844115 16571 leader_election.cc:304] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.845209 16696 raft_consensus.cc:2804] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.845733 16696 raft_consensus.cc:493] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.846163 16696 raft_consensus.cc:3060] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.845224 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.854319 16696 raft_consensus.cc:515] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.856317 16652 tablet_bootstrap.cc:654] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.857867 16750 consensus_queue.cc:1048] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.862413 16723 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.879815 16651 ts_tablet_manager.cc:1434] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.048s	user 0.029s	sys 0.009s
I20260709 13:18:19.881362 16651 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:19.883206 16654 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:19.883930 16654 ts_tablet_manager.cc:1403] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 13:18:19.883424 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.879045 16458 raft_consensus.cc:2468] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:19.889626 16723 raft_consensus.cc:493] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.890153 16723 raft_consensus.cc:515] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.891773 16723 leader_election.cc:290] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.891665 16654 raft_consensus.cc:359] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.892366 16654 raft_consensus.cc:385] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.892643 16654 raft_consensus.cc:740] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.893278 16654 consensus_queue.cc:260] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.893296 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8d57fe9a14ea5b84b25239c03b674" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:19.895212 16654 ts_tablet_manager.cc:1434] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 13:18:19.895416 16532 raft_consensus.cc:3060] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.896466 16654 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:19.887578 16696 leader_election.cc:290] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:19.907905 16278 catalog_manager.cc:5697] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.911249 16532 raft_consensus.cc:2468] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:19.913353 16723 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.913833 16723 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.916050 16723 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.916608 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:19.917188 16455 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.917284 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.918664 16571 leader_election.cc:304] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:19.919931 16696 raft_consensus.cc:2804] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.920414 16696 raft_consensus.cc:697] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:19.921231 16696 consensus_queue.cc:237] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.923436 16651 tablet_bootstrap.cc:654] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.926075 16740 raft_consensus.cc:493] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.933871 16740 raft_consensus.cc:515] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.934753 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.935523 16458 raft_consensus.cc:2393] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:19.935786 16740 leader_election.cc:290] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:19.937027 16758 raft_consensus.cc:493] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.937181 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.937331 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:19.937000 16348 leader_election.cc:304] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:19.938179 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.942153 16654 tablet_bootstrap.cc:654] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.945657 16653 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:19.938022 16605 raft_consensus.cc:2393] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:19.937726 16758 raft_consensus.cc:515] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:19.946523 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.947119 16383 raft_consensus.cc:2468] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:19.947121 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.948227 16758 leader_election.cc:290] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.948397 16457 raft_consensus.cc:2468] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:19.937913 16532 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.949757 16571 leader_election.cc:304] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.950487 16691 raft_consensus.cc:493] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.951128 16691 raft_consensus.cc:515] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:19.946118 16653 ts_tablet_manager.cc:1403] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.175s	user 0.008s	sys 0.011s
I20260709 13:18:19.958734 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.959196 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.959581 16691 leader_election.cc:290] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:19.959854 16383 raft_consensus.cc:2468] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:19.961470 16423 leader_election.cc:304] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:19.961622 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:19.963290 16786 consensus_queue.cc:1048] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.963600 16455 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:19.954804 16696 raft_consensus.cc:2804] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:19.964068 16498 leader_election.cc:343] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.960892 16458 raft_consensus.cc:2393] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:19.964083 16785 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.967085 16696 raft_consensus.cc:493] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.966339 16758 raft_consensus.cc:2804] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.973714 16652 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:19.974030 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:19.976054 16348 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:19.987257 16652 ts_tablet_manager.cc:1403] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.001s
I20260709 13:18:19.977028 16740 raft_consensus.cc:493] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.988827 16740 raft_consensus.cc:515] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.990381 16652 raft_consensus.cc:359] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:19.990989 16740 leader_election.cc:290] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:19.991374 16348 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:19.992704 16723 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.992830 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e72e3aaa572413bb34bccd2652bed01" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:19.993209 16723 raft_consensus.cc:697] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:19.993531 16383 raft_consensus.cc:2468] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:19.994252 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e72e3aaa572413bb34bccd2652bed01" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:19.994122 16723 consensus_queue.cc:237] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:19.994966 16786 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.994743 16571 leader_election.cc:304] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:19.997545 16758 raft_consensus.cc:493] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.986449 16696 raft_consensus.cc:3060] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.994743 16278 catalog_manager.cc:5697] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.003837 16653 raft_consensus.cc:359] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.004081 16750 consensus_queue.cc:1048] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.004535 16653 raft_consensus.cc:385] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.004876 16653 raft_consensus.cc:740] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
W20260709 13:18:20.005966 16497 leader_election.cc:343] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.006431 16497 leader_election.cc:304] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:20.007403 16696 raft_consensus.cc:515] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.008786 16605 raft_consensus.cc:2393] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:20.009398 16750 raft_consensus.cc:2749] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.010043 16653 consensus_queue.cc:260] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.011658 16740 raft_consensus.cc:2804] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.012040 16740 raft_consensus.cc:493] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.012373 16740 raft_consensus.cc:3060] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.012430 16653 ts_tablet_manager.cc:1434] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.059s	user 0.001s	sys 0.004s
I20260709 13:18:20.012615 16758 raft_consensus.cc:3060] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.007794 16785 raft_consensus.cc:2749] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.017578 16653 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:19.991046 16652 raft_consensus.cc:385] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.021946 16652 raft_consensus.cc:740] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.023900 16532 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:20.024158 16654 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.024806 16654 ts_tablet_manager.cc:1403] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.017s
I20260709 13:18:20.025759 16653 tablet_bootstrap.cc:654] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.026010 16652 consensus_queue.cc:260] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.026927 16530 raft_consensus.cc:2468] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:20.027861 16654 raft_consensus.cc:359] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.037461 16651 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.042316 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.061910 16381 raft_consensus.cc:3060] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.039304 16653 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:20.052050 16785 consensus_queue.cc:1048] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:20.061498 16651 ts_tablet_manager.cc:1403] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.007s
I20260709 13:18:20.041872 16652 ts_tablet_manager.cc:1434] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:18:20.080587 16653 ts_tablet_manager.cc:1403] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.010s
I20260709 13:18:20.078193 16278 catalog_manager.cc:5697] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.081408 16652 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.083664 16381 raft_consensus.cc:2468] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.055579 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:20.059465 16696 leader_election.cc:290] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.085762 16654 raft_consensus.cc:385] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.085902 16571 leader_election.cc:304] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.086073 16654 raft_consensus.cc:740] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.086932 16696 raft_consensus.cc:2804] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.087610 16654 consensus_queue.cc:260] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.088636 16696 raft_consensus.cc:697] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.089551 16696 consensus_queue.cc:237] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.066896 16748 consensus_queue.cc:1048] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:18:20.092666 16654 ts_tablet_manager.cc:1434] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.005s
I20260709 13:18:20.093600 16654 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.039824 16758 raft_consensus.cc:515] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.095968 16604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:20.096266 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18a2e264c34f4291b3bb9965abf150" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.039438 16740 raft_consensus.cc:515] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.097543 16383 raft_consensus.cc:2393] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:20.098584 16423 leader_election.cc:304] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:20.099390 16661 raft_consensus.cc:2749] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.099651 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e72e3aaa572413bb34bccd2652bed01" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.100436 16532 raft_consensus.cc:3060] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.100529 16758 leader_election.cc:290] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.045706 16786 raft_consensus.cc:2749] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.105273 16652 tablet_bootstrap.cc:654] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.108740 16532 raft_consensus.cc:2468] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.110009 16653 raft_consensus.cc:359] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.110662 16653 raft_consensus.cc:385] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.110976 16653 raft_consensus.cc:740] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.111971 16740 leader_election.cc:290] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.100451 16455 raft_consensus.cc:2393] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:20.112712 16652 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.113233 16652 ts_tablet_manager.cc:1403] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
I20260709 13:18:20.116182 16652 raft_consensus.cc:359] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.116861 16652 raft_consensus.cc:385] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.117599 16652 raft_consensus.cc:740] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.116882 16740 raft_consensus.cc:493] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.118314 16571 leader_election.cc:304] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.118567 16740 raft_consensus.cc:515] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.119455 16651 raft_consensus.cc:359] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.120180 16666 raft_consensus.cc:2804] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.120828 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e72e3aaa572413bb34bccd2652bed01" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.122036 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.123003 16652 consensus_queue.cc:260] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.125578 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:20.127096 16571 leader_election.cc:343] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.128482 16652 ts_tablet_manager.cc:1434] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:18:20.121624 16381 raft_consensus.cc:3060] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.125450 16740 leader_election.cc:290] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.129508 16652 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.124336 16654 tablet_bootstrap.cc:654] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.136102 16278 catalog_manager.cc:5697] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.137218 16381 raft_consensus.cc:2468] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.144563 16652 tablet_bootstrap.cc:654] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.149269 16666 raft_consensus.cc:697] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.150514 16666 consensus_queue.cc:237] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.120165 16651 raft_consensus.cc:385] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.154247 16651 raft_consensus.cc:740] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.156203 16651 consensus_queue.cc:260] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.157100 16383 raft_consensus.cc:2468] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:20.158926 16571 leader_election.cc:304] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:20.160017 16740 raft_consensus.cc:2804] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.160373 16740 raft_consensus.cc:493] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.160676 16740 raft_consensus.cc:3060] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.167717 16740 raft_consensus.cc:515] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.155448 16802 raft_consensus.cc:493] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.170042 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.170642 16383 raft_consensus.cc:3060] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.174288 16740 leader_election.cc:290] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.169626 16802 raft_consensus.cc:515] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.174957 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:20.176311 16383 raft_consensus.cc:2468] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
W20260709 13:18:20.177675 16571 leader_election.cc:343] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.179224 16651 ts_tablet_manager.cc:1434] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.002s
I20260709 13:18:20.177179 16802 leader_election.cc:290] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.179481 16571 leader_election.cc:304] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:20.181654 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.182628 16532 raft_consensus.cc:2468] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:20.184566 16666 raft_consensus.cc:2804] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.185124 16666 raft_consensus.cc:697] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.185039 16571 leader_election.cc:304] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.111636 16653 consensus_queue.cc:260] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.186285 16802 raft_consensus.cc:2804] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.187455 16652 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.186719 16802 raft_consensus.cc:493] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.188520 16652 ts_tablet_manager.cc:1403] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.027s
I20260709 13:18:20.188558 16802 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.188802 16278 catalog_manager.cc:5697] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.191674 16652 raft_consensus.cc:359] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.192432 16652 raft_consensus.cc:385] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.192739 16652 raft_consensus.cc:740] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.193444 16652 consensus_queue.cc:260] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.195489 16652 ts_tablet_manager.cc:1434] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:18:20.196391 16652 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.197870 16653 ts_tablet_manager.cc:1434] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.117s	user 0.003s	sys 0.003s
I20260709 13:18:20.198537 16751 raft_consensus.cc:493] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.186282 16666 consensus_queue.cc:237] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.200510 16654 tablet_bootstrap.cc:492] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.200971 16654 ts_tablet_manager.cc:1403] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.108s	user 0.026s	sys 0.017s
I20260709 13:18:20.199031 16751 raft_consensus.cc:515] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.204571 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:20.204716 16751 leader_election.cc:290] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.205190 16455 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:20.206580 16497 leader_election.cc:304] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.207975 16652 tablet_bootstrap.cc:654] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.208747 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.208887 16748 consensus_queue.cc:1048] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.208761 16751 raft_consensus.cc:2804] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.210332 16751 raft_consensus.cc:493] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.210402 16654 raft_consensus.cc:359] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.210901 16751 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.211109 16653 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:20.217948 16751 raft_consensus.cc:515] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
W20260709 13:18:20.218393 16571 leader_election.cc:343] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.220670 16651 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.220985 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.221889 16654 raft_consensus.cc:385] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.222201 16654 raft_consensus.cc:740] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.222857 16654 consensus_queue.cc:260] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.222980 16802 raft_consensus.cc:515] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.224534 16606 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:20.225291 16654 ts_tablet_manager.cc:1434] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:18:20.225554 16802 leader_election.cc:290] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.226280 16654 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.227253 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.227795 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.228514 16532 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:20.229386 16571 leader_election.cc:343] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.232038 16751 leader_election.cc:290] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.235489 16654 tablet_bootstrap.cc:654] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.236207 16653 tablet_bootstrap.cc:654] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.240017 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:20.240911 16455 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.244755 16651 tablet_bootstrap.cc:654] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.255656 16278 catalog_manager.cc:5697] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.261837 16758 raft_consensus.cc:493] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.262459 16758 raft_consensus.cc:515] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.266029 16758 leader_election.cc:290] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.266669 16748 consensus_queue.cc:1048] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.268054 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.268682 16530 raft_consensus.cc:2468] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:20.269882 16423 leader_election.cc:304] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.270638 16661 raft_consensus.cc:2804] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.271013 16661 raft_consensus.cc:493] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.271322 16661 raft_consensus.cc:3060] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.273661 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:20.275279 16424 leader_election.cc:343] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:20.279172 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:20.281582 16661 raft_consensus.cc:515] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.284085 16532 raft_consensus.cc:2468] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.285658 16571 leader_election.cc:304] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:20.286082 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.286808 16530 raft_consensus.cc:3060] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.289522 16666 raft_consensus.cc:2804] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.289943 16455 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:20.290053 16666 raft_consensus.cc:697] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.291005 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:20.290956 16666 consensus_queue.cc:237] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.291198 16497 leader_election.cc:304] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.291649 16606 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.292200 16748 raft_consensus.cc:2804] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.293278 16748 raft_consensus.cc:697] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:20.294102 16748 consensus_queue.cc:237] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.296510 16530 raft_consensus.cc:2468] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:20.297710 16423 leader_election.cc:304] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.298614 16758 raft_consensus.cc:2804] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.302841 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
W20260709 13:18:20.304045 16424 leader_election.cc:343] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.304656 16654 tablet_bootstrap.cc:492] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.305202 16654 ts_tablet_manager.cc:1403] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.008s
I20260709 13:18:20.313772 16280 catalog_manager.cc:5697] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.320206 16651 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.320694 16651 ts_tablet_manager.cc:1403] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.009s
I20260709 13:18:20.326341 16651 raft_consensus.cc:359] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.327265 16651 raft_consensus.cc:385] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.327611 16651 raft_consensus.cc:740] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.312625 16661 leader_election.cc:290] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.329627 16651 consensus_queue.cc:260] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.335979 16653 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:20.336475 16653 ts_tablet_manager.cc:1403] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.013s
I20260709 13:18:20.337590 16654 raft_consensus.cc:359] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.338402 16654 raft_consensus.cc:385] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.338881 16654 raft_consensus.cc:740] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.339738 16654 consensus_queue.cc:260] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.328647 16758 raft_consensus.cc:697] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:20.342126 16758 consensus_queue.cc:237] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.343609 16653 raft_consensus.cc:359] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.344483 16653 raft_consensus.cc:385] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.344782 16653 raft_consensus.cc:740] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.343669 16654 ts_tablet_manager.cc:1434] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:18:20.345499 16653 consensus_queue.cc:260] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.347088 16653 ts_tablet_manager.cc:1434] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:20.348084 16653 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:20.354597 16654 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.355914 16653 tablet_bootstrap.cc:654] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.357101 16606 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:20.359318 16651 ts_tablet_manager.cc:1434] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:18:20.360265 16651 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.363430 16654 tablet_bootstrap.cc:654] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.366843 16652 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.367338 16652 ts_tablet_manager.cc:1403] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.043s
I20260709 13:18:20.367489 16281 catalog_manager.cc:5697] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.365342 16815 raft_consensus.cc:493] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.369098 16815 raft_consensus.cc:515] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.369895 16652 raft_consensus.cc:359] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.370538 16652 raft_consensus.cc:385] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.370800 16652 raft_consensus.cc:740] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.371433 16652 consensus_queue.cc:260] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.371892 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.372252 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b61bde285854aadb8c899675630d767" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.373018 16381 raft_consensus.cc:2393] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:20.373576 16652 ts_tablet_manager.cc:1434] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:20.374687 16651 tablet_bootstrap.cc:654] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.374336 16423 leader_election.cc:304] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:20.375502 16661 raft_consensus.cc:3060] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.384778 16652 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.386008 16815 leader_election.cc:290] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.387451 16661 raft_consensus.cc:2749] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.389492 16651 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.389955 16651 ts_tablet_manager.cc:1403] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260709 13:18:20.392616 16652 tablet_bootstrap.cc:654] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.398519 16661 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.398994 16661 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.400940 16661 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.393476 16651 raft_consensus.cc:359] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.401489 16651 raft_consensus.cc:385] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.401762 16651 raft_consensus.cc:740] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.402673 16651 consensus_queue.cc:260] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.404953 16651 ts_tablet_manager.cc:1434] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:18:20.405500 16666 raft_consensus.cc:493] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.405965 16651 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.406126 16666 raft_consensus.cc:515] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.408237 16666 leader_election.cc:290] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:20.410281 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:20.411543 16651 tablet_bootstrap.cc:654] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.412856 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a7dab472244946b139542a19c2e9a6" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.413657 16530 raft_consensus.cc:2393] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:20.415614 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.416189 16606 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:20.417412 16424 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.417547 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.418380 16383 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:20.418372 16661 raft_consensus.cc:2804] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:20.419718 16661 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.420147 16661 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.423825 16571 leader_election.cc:304] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:20.426095 16802 raft_consensus.cc:3060] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.429129 16651 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.429600 16651 ts_tablet_manager.cc:1403] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:18:20.431974 16666 consensus_queue.cc:1048] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.432116 16651 raft_consensus.cc:359] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.432747 16651 raft_consensus.cc:385] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.433032 16651 raft_consensus.cc:740] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.433813 16651 consensus_queue.cc:260] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.441814 16651 ts_tablet_manager.cc:1434] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:18:20.442837 16651 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.443432 16455 raft_consensus.cc:3060] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.441191 16279 catalog_manager.cc:5697] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.450177 16651 tablet_bootstrap.cc:654] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.456311 16661 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.461786 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:20.462500 16606 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.470085 16785 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.471905 16606 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:20.473387 16424 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.475286 16815 raft_consensus.cc:2804] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:20.475731 16815 raft_consensus.cc:697] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:20.476382 16651 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.476890 16651 ts_tablet_manager.cc:1403] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.010s
I20260709 13:18:20.476501 16815 consensus_queue.cc:237] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.479988 16651 raft_consensus.cc:359] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.486678 16651 raft_consensus.cc:385] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.487036 16666 consensus_queue.cc:1048] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.487035 16651 raft_consensus.cc:740] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.491173 16651 consensus_queue.cc:260] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.493691 16651 ts_tablet_manager.cc:1434] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:18:20.494751 16651 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.494742 16824 raft_consensus.cc:493] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.495500 16824 raft_consensus.cc:515] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.497260 16729 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.498961 16824 leader_election.cc:290] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:20.499571 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcd8b1fff044727b789cd91ac9a4e80" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.500357 16383 raft_consensus.cc:2468] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:20.502400 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcd8b1fff044727b789cd91ac9a4e80" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.503208 16651 tablet_bootstrap.cc:654] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.503150 16532 raft_consensus.cc:2468] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:20.504947 16423 leader_election.cc:304] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.514815 16758 raft_consensus.cc:2804] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.515280 16758 raft_consensus.cc:493] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.515671 16758 raft_consensus.cc:3060] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.458771 16802 raft_consensus.cc:2749] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.524813 16653 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:20.525291 16653 ts_tablet_manager.cc:1403] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.177s	user 0.040s	sys 0.036s
I20260709 13:18:20.527904 16653 raft_consensus.cc:359] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.528558 16653 raft_consensus.cc:385] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.528826 16653 raft_consensus.cc:740] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.530462 16654 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.530987 16654 ts_tablet_manager.cc:1403] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.177s	user 0.005s	sys 0.009s
I20260709 13:18:20.533813 16652 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.534299 16652 ts_tablet_manager.cc:1403] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.049s
I20260709 13:18:20.536538 16802 consensus_queue.cc:1048] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.537515 16652 raft_consensus.cc:359] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.538182 16652 raft_consensus.cc:385] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.538437 16652 raft_consensus.cc:740] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.539062 16652 consensus_queue.cc:260] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.539981 16653 consensus_queue.cc:260] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.541427 16651 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.541854 16651 ts_tablet_manager.cc:1403] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.004s
I20260709 13:18:20.544116 16652 ts_tablet_manager.cc:1434] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:20.544792 16652 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.546658 16280 catalog_manager.cc:5697] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 2, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.548822 16654 raft_consensus.cc:359] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.552223 16654 raft_consensus.cc:385] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.552510 16654 raft_consensus.cc:740] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.553113 16654 consensus_queue.cc:260] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.552942 16651 raft_consensus.cc:359] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.554044 16651 raft_consensus.cc:385] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.554340 16651 raft_consensus.cc:740] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.554685 16654 ts_tablet_manager.cc:1434] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:20.555553 16654 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.562068 16654 tablet_bootstrap.cc:654] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.562178 16653 ts_tablet_manager.cc:1434] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:18:20.564208 16653 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:20.565106 16661 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.555102 16651 consensus_queue.cc:260] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.567196 16651 ts_tablet_manager.cc:1434] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:18:20.570641 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.571228 16382 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.574685 16740 consensus_queue.cc:1048] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.575982 16666 consensus_queue.cc:1048] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.578472 16652 tablet_bootstrap.cc:654] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.583155 16382 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:20.592007 16758 raft_consensus.cc:515] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.594786 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcd8b1fff044727b789cd91ac9a4e80" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.595359 16382 raft_consensus.cc:3060] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.598631 16651 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.606309 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fcd8b1fff044727b789cd91ac9a4e80" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.607105 16530 raft_consensus.cc:3060] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.628532 16653 tablet_bootstrap.cc:654] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.631260 16652 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.631873 16652 ts_tablet_manager.cc:1403] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.000s
I20260709 13:18:20.603739 16758 leader_election.cc:290] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:20.617698 16382 raft_consensus.cc:2468] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:20.639039 16423 leader_election.cc:304] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:20.640348 16758 raft_consensus.cc:2804] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.643021 16652 raft_consensus.cc:359] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.643657 16652 raft_consensus.cc:385] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.643870 16652 raft_consensus.cc:740] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.641543 16758 raft_consensus.cc:697] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:20.644996 16758 consensus_queue.cc:237] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.647022 16652 consensus_queue.cc:260] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.651253 16652 ts_tablet_manager.cc:1434] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:18:20.656684 16652 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.663414 16530 raft_consensus.cc:2468] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:20.667481 16654 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.668188 16654 ts_tablet_manager.cc:1403] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.113s	user 0.037s	sys 0.011s
I20260709 13:18:20.671252 16652 tablet_bootstrap.cc:654] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.681783 16696 consensus_queue.cc:1048] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.682078 16755 raft_consensus.cc:493] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.682579 16755 raft_consensus.cc:515] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.684492 16755 leader_election.cc:290] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.685202 16651 tablet_bootstrap.cc:654] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.684526 16666 consensus_queue.cc:1048] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.685998 16802 raft_consensus.cc:493] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.686457 16802 raft_consensus.cc:515] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.684156 16654 raft_consensus.cc:359] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.688058 16654 raft_consensus.cc:385] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.686364 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.688431 16654 raft_consensus.cc:740] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
W20260709 13:18:20.689373 16497 leader_election.cc:343] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.691570 16654 consensus_queue.cc:260] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.699456 16654 ts_tablet_manager.cc:1434] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:18:20.699858 16802 leader_election.cc:290] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:20.700436 16654 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.700120 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:20.702750 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.702896 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:20.703394 16532 raft_consensus.cc:2468] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
W20260709 13:18:20.708164 16571 leader_election.cc:343] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.711486 16571 leader_election.cc:304] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:20.711848 16653 tablet_bootstrap.cc:492] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:20.712134 16802 raft_consensus.cc:2804] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.712374 16653 ts_tablet_manager.cc:1403] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.013s
I20260709 13:18:20.712533 16802 raft_consensus.cc:493] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.712975 16802 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.713452 16383 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:20.709015 16497 leader_election.cc:343] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.714082 16497 leader_election.cc:304] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:20.715175 16654 tablet_bootstrap.cc:654] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.717344 16755 raft_consensus.cc:2749] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.718116 16783 raft_consensus.cc:493] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.718631 16653 raft_consensus.cc:359] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.718647 16783 raft_consensus.cc:515] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.719564 16653 raft_consensus.cc:385] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.719967 16653 raft_consensus.cc:740] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.721815 16802 raft_consensus.cc:515] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.722391 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.723021 16532 raft_consensus.cc:2468] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:20.724212 16348 leader_election.cc:304] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:20.725032 16729 raft_consensus.cc:2804] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.721176 16653 consensus_queue.cc:260] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.728053 16280 catalog_manager.cc:5697] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.735226 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:20.735847 16457 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.735945 16653 ts_tablet_manager.cc:1434] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:18:20.737262 16653 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:20.731350 16729 raft_consensus.cc:493] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.739357 16729 raft_consensus.cc:3060] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.741628 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.742180 16532 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.745246 16696 raft_consensus.cc:493] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.745939 16783 leader_election.cc:290] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.745803 16696 raft_consensus.cc:515] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.747741 16696 leader_election.cc:290] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.725181 16802 leader_election.cc:290] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:20.752990 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:20.753625 16531 raft_consensus.cc:2468] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:20.753918 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.755205 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.756218 16653 tablet_bootstrap.cc:654] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.756072 16606 raft_consensus.cc:2468] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:20.755071 16802 consensus_queue.cc:1048] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:20.765758 16571 leader_election.cc:304] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.768194 16802 consensus_queue.cc:1048] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.769466 16802 raft_consensus.cc:2804] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.769806 16802 raft_consensus.cc:493] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.770103 16802 raft_consensus.cc:3060] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.770619 16532 raft_consensus.cc:2468] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.776796 16457 raft_consensus.cc:2468] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.781394 16654 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.782145 16654 ts_tablet_manager.cc:1403] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.036s
I20260709 13:18:20.783887 16802 raft_consensus.cc:515] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.784935 16654 raft_consensus.cc:359] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.785751 16654 raft_consensus.cc:385] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.785928 16802 leader_election.cc:290] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:20.786098 16654 raft_consensus.cc:740] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.786890 16654 consensus_queue.cc:260] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.777030 16571 leader_election.cc:304] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.789395 16696 raft_consensus.cc:2804] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.790009 16696 raft_consensus.cc:697] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.790757 16696 consensus_queue.cc:237] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:20.792112 16654 ts_tablet_manager.cc:1434] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:20.793390 16654 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.800961 16651 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:20.801477 16651 ts_tablet_manager.cc:1403] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.000s
I20260709 13:18:20.776106 16729 raft_consensus.cc:515] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.806921 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:20.818101 16654 tablet_bootstrap.cc:654] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.823127 16783 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.823601 16783 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.826037 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.826633 16606 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:20.827749 16783 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.827834 16349 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:20.828783 16783 raft_consensus.cc:2804] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.829841 16783 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.830287 16783 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.830474 16382 raft_consensus.cc:2393] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:20.831496 16729 leader_election.cc:290] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:20.833137 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:20.833940 16606 raft_consensus.cc:2393] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:20.835312 16651 raft_consensus.cc:359] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.836774 16651 raft_consensus.cc:385] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.818785 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.838388 16532 raft_consensus.cc:3060] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.843252 16783 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.828781 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:20.844353 16457 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:20.846035 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:20.846617 16606 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.849174 16666 consensus_queue.cc:1048] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.846553 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec45191582145d2a68d3146fb5008e5" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:20.837358 16651 raft_consensus.cc:740] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.864800 16653 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:20.865293 16653 ts_tablet_manager.cc:1403] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.006s
I20260709 13:18:20.864204 16651 consensus_queue.cc:260] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.882884 16532 raft_consensus.cc:2468] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:20.885816 16653 raft_consensus.cc:359] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.886569 16653 raft_consensus.cc:385] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.886833 16653 raft_consensus.cc:740] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.887544 16653 consensus_queue.cc:260] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:20.888346 16651 ts_tablet_manager.cc:1434] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:18:20.889609 16652 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:20.890120 16652 ts_tablet_manager.cc:1403] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.016s
I20260709 13:18:20.890885 16651 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:20.892901 16652 raft_consensus.cc:359] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.896356 16652 raft_consensus.cc:385] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.896438 16723 raft_consensus.cc:493] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.896785 16652 raft_consensus.cc:740] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.894403 16571 leader_election.cc:304] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:20.897845 16802 raft_consensus.cc:2804] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.897778 16652 consensus_queue.cc:260] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.861702 16348 leader_election.cc:304] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
W20260709 13:18:20.904417 16348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:39149, user_credentials={real_user=slave}} blocked reactor thread for 48228.6us
I20260709 13:18:20.905740 16652 ts_tablet_manager.cc:1434] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:20.898389 16802 raft_consensus.cc:697] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:20.906473 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:20.907017 16457 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.907241 16802 consensus_queue.cc:237] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:20.895727 16783 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.897024 16723 raft_consensus.cc:515] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.900717 16651 tablet_bootstrap.cc:654] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.901417 16755 consensus_queue.cc:1048] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.899765 16758 consensus_queue.cc:1048] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.911113 16723 leader_election.cc:290] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.912053 16652 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:20.894721 16653 ts_tablet_manager.cc:1434] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:18:20.913450 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:20.914182 16653 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
W20260709 13:18:20.915112 16349 leader_election.cc:343] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.905900 16729 raft_consensus.cc:2749] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.921056 16755 consensus_queue.cc:1048] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.924631 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:20.927871 16348 leader_election.cc:343] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.928339 16348 leader_election.cc:304] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:20.929286 16729 raft_consensus.cc:2749] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.930024 16652 tablet_bootstrap.cc:654] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.933352 16653 tablet_bootstrap.cc:654] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.936179 16654 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:20.943322 16758 consensus_queue.cc:1048] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.944175 16654 ts_tablet_manager.cc:1403] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.034s
I20260709 13:18:20.946990 16654 raft_consensus.cc:359] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.947681 16654 raft_consensus.cc:385] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.947957 16654 raft_consensus.cc:740] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.948606 16654 consensus_queue.cc:260] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.950902 16654 ts_tablet_manager.cc:1434] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:20.952003 16654 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:20.952708 16605 raft_consensus.cc:1275] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:20.956221 16758 consensus_queue.cc:1048] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.963104 16606 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:20.966075 16654 tablet_bootstrap.cc:654] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.995548 16802 raft_consensus.cc:493] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.996249 16802 raft_consensus.cc:515] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:20.998729 16802 leader_election.cc:290] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:20.999747 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:20.999878 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.000377 16381 raft_consensus.cc:2468] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
W20260709 13:18:21.001773 16571 leader_election.cc:343] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.003050 16571 leader_election.cc:304] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:21.003607 16651 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.004185 16651 ts_tablet_manager.cc:1403] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.000s
I20260709 13:18:21.004369 16349 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.005235 16729 raft_consensus.cc:2804] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.005748 16729 raft_consensus.cc:697] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:21.006518 16729 consensus_queue.cc:237] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.007589 16651 raft_consensus.cc:359] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.008445 16651 raft_consensus.cc:385] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.008772 16651 raft_consensus.cc:740] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.009727 16740 raft_consensus.cc:2804] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.010102 16740 raft_consensus.cc:493] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.010430 16740 raft_consensus.cc:3060] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.024178 16278 catalog_manager.cc:5697] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.022310 16651 consensus_queue.cc:260] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.039592 16652 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.040071 16652 ts_tablet_manager.cc:1403] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.128s	user 0.041s	sys 0.027s
I20260709 13:18:21.044355 16651 ts_tablet_manager.cc:1434] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:18:21.045282 16651 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.020115 16740 raft_consensus.cc:515] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.036010 16457 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:21.058153 16653 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:21.058490 16654 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.058632 16653 ts_tablet_manager.cc:1403] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.145s	user 0.037s	sys 0.015s
I20260709 13:18:21.058926 16654 ts_tablet_manager.cc:1403] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.019s
I20260709 13:18:21.068393 16651 tablet_bootstrap.cc:654] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.067610 16280 catalog_manager.cc:5697] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.072732 16654 raft_consensus.cc:359] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.073496 16654 raft_consensus.cc:385] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.073798 16654 raft_consensus.cc:740] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.074481 16654 consensus_queue.cc:260] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.076846 16654 ts_tablet_manager.cc:1434] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 13:18:21.072144 16652 raft_consensus.cc:359] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.078342 16652 raft_consensus.cc:385] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.078722 16652 raft_consensus.cc:740] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.078652 16653 raft_consensus.cc:359] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.079414 16653 raft_consensus.cc:385] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.079602 16653 raft_consensus.cc:740] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.080726 16654 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.086165 16653 consensus_queue.cc:260] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.090209 16653 ts_tablet_manager.cc:1434] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:18:21.091152 16653 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:21.094733 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.095331 16383 raft_consensus.cc:3060] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.100571 16653 tablet_bootstrap.cc:654] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.092410 16740 leader_election.cc:290] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.102293 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc279b02590c4d1d8bb12e237d2b6879" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.095434 16652 consensus_queue.cc:260] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.093544 16381 raft_consensus.cc:1275] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:18:21.103524 16571 leader_election.cc:343] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.105162 16652 ts_tablet_manager.cc:1434] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:18:21.105764 16661 consensus_queue.cc:1048] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.106701 16652 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.112746 16652 tablet_bootstrap.cc:654] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.127202 16654 tablet_bootstrap.cc:654] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.130430 16651 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.130945 16651 ts_tablet_manager.cc:1403] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.021s
I20260709 13:18:21.136900 16651 raft_consensus.cc:359] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.137589 16651 raft_consensus.cc:385] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.137980 16651 raft_consensus.cc:740] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.137478 16278 catalog_manager.cc:5697] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.138640 16651 consensus_queue.cc:260] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.140672 16651 ts_tablet_manager.cc:1434] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:21.141567 16651 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.141934 16383 raft_consensus.cc:2468] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:21.145458 16661 raft_consensus.cc:493] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.145932 16661 raft_consensus.cc:515] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.146217 16758 consensus_queue.cc:1048] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.147943 16661 leader_election.cc:290] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.143123 16571 leader_election.cc:304] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:21.150302 16802 raft_consensus.cc:2804] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.150946 16802 raft_consensus.cc:697] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:21.155300 16651 tablet_bootstrap.cc:654] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.151819 16802 consensus_queue.cc:237] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.155959 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.156602 16531 raft_consensus.cc:2468] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:21.157913 16423 leader_election.cc:304] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.158852 16661 raft_consensus.cc:2804] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.159338 16661 raft_consensus.cc:493] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.159780 16661 raft_consensus.cc:3060] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.165082 16653 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:21.165614 16653 ts_tablet_manager.cc:1403] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.004s
I20260709 13:18:21.164695 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.178128 16383 raft_consensus.cc:2468] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:21.196853 16653 raft_consensus.cc:359] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.198864 16653 raft_consensus.cc:385] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.199304 16653 raft_consensus.cc:740] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.204670 16653 consensus_queue.cc:260] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.206892 16653 ts_tablet_manager.cc:1434] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:18:21.207087 16758 consensus_queue.cc:1048] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.209738 16661 raft_consensus.cc:515] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.213496 16653 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:21.218011 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.218590 16531 raft_consensus.cc:3060] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.225811 16531 raft_consensus.cc:2468] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:21.226872 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904a0b2b8c6b4ce6aa8e271a91ca8268" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.226900 16423 leader_election.cc:304] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.227986 16383 raft_consensus.cc:3060] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.228610 16758 raft_consensus.cc:2804] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.229142 16758 raft_consensus.cc:697] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:21.230086 16758 consensus_queue.cc:237] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.232474 16652 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.233021 16652 ts_tablet_manager.cc:1403] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.020s
I20260709 13:18:21.236974 16652 raft_consensus.cc:359] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.237638 16652 raft_consensus.cc:385] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.237891 16652 raft_consensus.cc:740] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.238125 16661 leader_election.cc:290] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.238523 16652 consensus_queue.cc:260] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.246913 16654 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.247592 16654 ts_tablet_manager.cc:1403] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.170s	user 0.024s	sys 0.006s
I20260709 13:18:21.248170 16652 ts_tablet_manager.cc:1434] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:18:21.249128 16652 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.250720 16654 raft_consensus.cc:359] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.251551 16654 raft_consensus.cc:385] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.251845 16654 raft_consensus.cc:740] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.252581 16654 consensus_queue.cc:260] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.253993 16653 tablet_bootstrap.cc:654] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.255285 16654 ts_tablet_manager.cc:1434] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:21.255967 16383 raft_consensus.cc:2468] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:21.256317 16654 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.259913 16651 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.260452 16651 ts_tablet_manager.cc:1403] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.019s
I20260709 13:18:21.260601 16652 tablet_bootstrap.cc:654] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.263375 16651 raft_consensus.cc:359] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.264020 16651 raft_consensus.cc:385] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.264286 16651 raft_consensus.cc:740] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.264959 16651 consensus_queue.cc:260] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.267424 16651 ts_tablet_manager.cc:1434] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:18:21.270105 16278 catalog_manager.cc:5697] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.271790 16280 catalog_manager.cc:5697] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.276715 16652 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.277066 16653 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:21.277242 16652 ts_tablet_manager.cc:1403] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 13:18:21.277539 16653 ts_tablet_manager.cc:1403] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.018s
I20260709 13:18:21.280055 16653 raft_consensus.cc:359] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.280654 16653 raft_consensus.cc:385] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.280921 16653 raft_consensus.cc:740] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.281531 16653 consensus_queue.cc:260] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.283921 16653 ts_tablet_manager.cc:1434] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:18:21.284766 16653 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:21.287861 16651 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.290633 16653 tablet_bootstrap.cc:654] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.313141 16802 consensus_queue.cc:1048] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.316946 16783 raft_consensus.cc:493] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.317483 16783 raft_consensus.cc:515] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.319540 16783 leader_election.cc:290] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.320990 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.322268 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
W20260709 13:18:21.323056 16349 leader_election.cc:343] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.326028 16654 tablet_bootstrap.cc:654] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:21.325915 16348 leader_election.cc:343] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.328846 16348 leader_election.cc:304] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:21.330088 16783 raft_consensus.cc:2749] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.330735 16755 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.342139 16783 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.343202 16783 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.345284 16783 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.345438 16691 raft_consensus.cc:493] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.333000 16802 consensus_queue.cc:1048] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:21.346113 16691 raft_consensus.cc:515] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.348630 16755 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.351958 16755 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.352686 16651 tablet_bootstrap.cc:654] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:21.354251 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:21.341220 16652 raft_consensus.cc:359] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.355997 16652 raft_consensus.cc:385] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.356287 16652 raft_consensus.cc:740] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.356890 16652 consensus_queue.cc:260] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.357792 16654 tablet_bootstrap.cc:492] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.358223 16654 ts_tablet_manager.cc:1403] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.002s
I20260709 13:18:21.360069 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.360473 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.360960 16383 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.360877 16654 raft_consensus.cc:359] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.361644 16654 raft_consensus.cc:385] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.361967 16654 raft_consensus.cc:740] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.362599 16654 consensus_queue.cc:260] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.364948 16654 ts_tablet_manager.cc:1434] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:21.361486 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.365908 16654 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.370047 16652 ts_tablet_manager.cc:1434] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:18:21.370451 16382 raft_consensus.cc:2468] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.371219 16723 raft_consensus.cc:493] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.372164 16654 tablet_bootstrap.cc:654] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.371778 16723 raft_consensus.cc:515] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.374089 16723 leader_election.cc:290] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.365778 16457 raft_consensus.cc:2468] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.376385 16497 leader_election.cc:304] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.377496 16497 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.378639 16751 raft_consensus.cc:2804] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.378764 16755 raft_consensus.cc:2804] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.379132 16751 raft_consensus.cc:493] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.379432 16755 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.379606 16751 raft_consensus.cc:3060] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.380316 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.381101 16606 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.390033 16802 raft_consensus.cc:493] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.390465 16802 raft_consensus.cc:515] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.348701 16691 leader_election.cc:290] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.392756 16661 raft_consensus.cc:493] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.393442 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.393362 16661 raft_consensus.cc:515] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.394282 16606 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:21.395607 16349 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.396224 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f262d583f3a445c68bd8196d351fee97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.397253 16661 leader_election.cc:290] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.393080 16802 leader_election.cc:290] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.397502 16783 raft_consensus.cc:2804] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.397979 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.398439 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.398769 16783 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.398988 16606 raft_consensus.cc:2468] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:21.399169 16783 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.399948 16423 leader_election.cc:343] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.400558 16424 leader_election.cc:304] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:21.396893 16457 raft_consensus.cc:2468] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:21.405181 16571 leader_election.cc:304] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.406001 16783 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.408519 16783 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.414085 16661 raft_consensus.cc:2804] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.414530 16661 raft_consensus.cc:493] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.414911 16661 raft_consensus.cc:3060] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.415316 16652 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.417795 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.417732 16751 raft_consensus.cc:515] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.418463 16606 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.419831 16751 leader_election.cc:290] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.425516 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.432978 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.434000 16528 raft_consensus.cc:2393] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:21.431735 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.435788 16652 tablet_bootstrap.cc:654] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.437816 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f262d583f3a445c68bd8196d351fee97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.438483 16531 raft_consensus.cc:2468] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:21.444015 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.444777 16457 raft_consensus.cc:2468] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:21.446535 16348 leader_election.cc:304] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:21.447141 16740 raft_consensus.cc:2804] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.447624 16740 raft_consensus.cc:493] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.448047 16740 raft_consensus.cc:3060] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.448485 16783 raft_consensus.cc:2804] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.448971 16783 raft_consensus.cc:493] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.449785 16783 raft_consensus.cc:3060] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.453563 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 48489.4us
W20260709 13:18:21.460521 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44563, user_credentials={real_user=slave}} blocked reactor thread for 83114.5us
I20260709 13:18:21.462594 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.463691 16606 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:21.464241 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.464865 16457 raft_consensus.cc:3060] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.465265 16349 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:21.466504 16723 raft_consensus.cc:2804] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.467075 16723 raft_consensus.cc:697] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:21.468096 16723 consensus_queue.cc:237] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.471050 16661 raft_consensus.cc:515] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.472818 16783 raft_consensus.cc:515] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.480436 16654 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.460827 16740 raft_consensus.cc:515] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.474347 16755 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.481523 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.481575 16802 consensus_queue.cc:1048] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.482102 16740 leader_election.cc:290] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.482273 16606 raft_consensus.cc:3060] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.483744 16654 ts_tablet_manager.cc:1403] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.118s	user 0.031s	sys 0.028s
I20260709 13:18:21.484710 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f262d583f3a445c68bd8196d351fee97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.485270 16532 raft_consensus.cc:3060] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.486577 16654 raft_consensus.cc:359] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.487200 16654 raft_consensus.cc:385] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.487461 16654 raft_consensus.cc:740] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.487573 16382 raft_consensus.cc:2393] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:21.488127 16654 consensus_queue.cc:260] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.489799 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.490581 16654 ts_tablet_manager.cc:1434] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:21.491556 16723 consensus_queue.cc:1048] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.492333 16651 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.492776 16651 ts_tablet_manager.cc:1403] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.020s
I20260709 13:18:21.495460 16651 raft_consensus.cc:359] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.496029 16651 raft_consensus.cc:385] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.496263 16651 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.497646 16755 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.498768 16529 raft_consensus.cc:2393] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:21.498816 16532 raft_consensus.cc:2468] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:21.501082 16571 leader_election.cc:304] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.502502 16654 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.502658 16802 raft_consensus.cc:2804] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.503110 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f262d583f3a445c68bd8196d351fee97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.503901 16456 raft_consensus.cc:3060] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.504266 16875 log.cc:927] Time spent T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:21.503188 16802 raft_consensus.cc:697] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:21.506309 16802 consensus_queue.cc:237] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.506613 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a639be7534d3881309e65107f6276" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.507433 16531 raft_consensus.cc:2393] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:21.508906 16654 tablet_bootstrap.cc:654] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.509711 16651 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.510536 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.511439 16729 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.511842 16651 ts_tablet_manager.cc:1434] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 13:18:21.511906 16729 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.512835 16651 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.508862 16755 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.514174 16661 leader_election.cc:290] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.512850 16652 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.517338 16603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.517524 16652 ts_tablet_manager.cc:1403] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.000s
W20260709 13:18:21.518725 16349 leader_election.cc:343] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.520452 16652 raft_consensus.cc:359] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.521939 16652 raft_consensus.cc:385] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.522193 16652 raft_consensus.cc:740] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.522871 16652 consensus_queue.cc:260] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.523257 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.524009 16783 leader_election.cc:290] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.525430 16652 ts_tablet_manager.cc:1434] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:18:21.526321 16348 leader_election.cc:343] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.526515 16652 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.526800 16348 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:21.527709 16723 raft_consensus.cc:2749] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.529479 16457 raft_consensus.cc:2468] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:21.531563 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.535938 16653 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:21.536062 16348 leader_election.cc:304] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:21.536441 16653 ts_tablet_manager.cc:1403] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.252s	user 0.032s	sys 0.069s
I20260709 13:18:21.537289 16723 raft_consensus.cc:2749] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.538142 16603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.538898 16603 raft_consensus.cc:2393] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:21.539566 16651 tablet_bootstrap.cc:654] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.542208 16666 consensus_queue.cc:1048] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:21.543505 16423 leader_election.cc:343] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.518796 16729 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.539238 16653 raft_consensus.cc:359] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.552994 16651 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.559998 16653 raft_consensus.cc:385] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.562031 16653 raft_consensus.cc:740] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.562726 16653 consensus_queue.cc:260] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.560446 16651 ts_tablet_manager.cc:1403] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
I20260709 13:18:21.564713 16653 ts_tablet_manager.cc:1434] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:18:21.565644 16653 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:21.565310 16652 tablet_bootstrap.cc:654] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.567010 16651 raft_consensus.cc:359] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.567682 16651 raft_consensus.cc:385] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.567953 16651 raft_consensus.cc:740] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.568720 16651 consensus_queue.cc:260] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.554450 16497 leader_election.cc:304] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:21.568055 16654 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.570209 16654 ts_tablet_manager.cc:1403] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.003s
I20260709 13:18:21.570842 16651 ts_tablet_manager.cc:1434] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:21.571792 16651 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.572759 16654 raft_consensus.cc:359] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.573413 16654 raft_consensus.cc:385] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.573653 16654 raft_consensus.cc:740] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.574095 16751 raft_consensus.cc:2804] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.574651 16751 raft_consensus.cc:697] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:21.575488 16751 consensus_queue.cc:237] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.574257 16654 consensus_queue.cc:260] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.578209 16651 tablet_bootstrap.cc:654] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.578883 16497 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:21.579669 16755 raft_consensus.cc:2749] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.579064 16654 ts_tablet_manager.cc:1434] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:18:21.581620 16654 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.587864 16654 tablet_bootstrap.cc:654] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.588263 16783 consensus_queue.cc:1048] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.591296 16652 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.591882 16652 ts_tablet_manager.cc:1403] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.004s
I20260709 13:18:21.595227 16652 raft_consensus.cc:359] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.596125 16652 raft_consensus.cc:385] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.596457 16652 raft_consensus.cc:740] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.597435 16652 consensus_queue.cc:260] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.596566 16751 raft_consensus.cc:493] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.588222 16873 log.cc:927] Time spent T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:18:21.603324 16651 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.601928 16606 raft_consensus.cc:2468] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:21.603890 16651 ts_tablet_manager.cc:1403] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.002s
I20260709 13:18:21.611963 16651 raft_consensus.cc:359] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.612670 16651 raft_consensus.cc:385] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.612051 16424 leader_election.cc:304] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:21.613085 16651 raft_consensus.cc:740] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.616400 16654 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.616979 16654 ts_tablet_manager.cc:1403] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.013s
I20260709 13:18:21.620806 16654 raft_consensus.cc:359] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.621506 16654 raft_consensus.cc:385] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.621833 16654 raft_consensus.cc:740] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.622527 16654 consensus_queue.cc:260] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.624567 16654 ts_tablet_manager.cc:1434] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:21.625401 16666 consensus_queue.cc:1048] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.625550 16654 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.627697 16652 ts_tablet_manager.cc:1434] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:18:21.628345 16696 raft_consensus.cc:493] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.628541 16652 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.613979 16651 consensus_queue.cc:260] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.631824 16783 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.631348 16280 catalog_manager.cc:5697] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.632252 16783 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.609625 16751 raft_consensus.cc:515] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.629019 16696 raft_consensus.cc:515] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.634910 16783 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.635887 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.626796 16661 raft_consensus.cc:2804] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.640715 16696 leader_election.cc:290] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.648162 16532 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:21.648384 16661 raft_consensus.cc:697] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:21.647835 16653 tablet_bootstrap.cc:654] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.638459 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.630596 16278 catalog_manager.cc:5697] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.643473 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.637579 16456 raft_consensus.cc:2468] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:21.650056 16696 raft_consensus.cc:493] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.649991 16348 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.642409 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.657294 16382 raft_consensus.cc:2468] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:21.655109 16606 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:21.655289 16651 ts_tablet_manager.cc:1434] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:18:21.658388 16751 leader_election.cc:290] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.661003 16651 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.661109 16571 leader_election.cc:304] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.661907 16783 raft_consensus.cc:2804] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.662465 16604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.654595 16531 raft_consensus.cc:2468] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:21.659806 16696 raft_consensus.cc:515] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.668869 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.673111 16382 raft_consensus.cc:2468] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.673920 16696 leader_election.cc:290] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.674512 16497 leader_election.cc:304] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.675604 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.676199 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:21.676810 16571 leader_election.cc:343] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.669736 16604 raft_consensus.cc:2468] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:21.677663 16666 raft_consensus.cc:2804] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.667411 16661 consensus_queue.cc:237] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.678503 16877 raft_consensus.cc:2804] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.681083 16666 raft_consensus.cc:493] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.682109 16666 raft_consensus.cc:3060] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.666679 16783 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.683589 16783 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.672268 16654 tablet_bootstrap.cc:654] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:21.685531 16571 leader_election.cc:343] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.685350 16877 raft_consensus.cc:493] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.688126 16281 catalog_manager.cc:5697] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.690600 16877 raft_consensus.cc:3060] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.687359 16571 leader_election.cc:304] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:21.702421 16696 raft_consensus.cc:2749] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.706938 16783 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.730023 16661 consensus_queue.cc:1048] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.735626 16666 raft_consensus.cc:515] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.744923 16654 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.745400 16654 ts_tablet_manager.cc:1403] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.120s	user 0.023s	sys 0.017s
I20260709 13:18:21.742676 16651 tablet_bootstrap.cc:654] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.748028 16654 raft_consensus.cc:359] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.747843 16278 catalog_manager.cc:5697] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.748684 16654 raft_consensus.cc:385] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.749832 16654 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.749982 16652 tablet_bootstrap.cc:654] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.750476 16654 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.752702 16654 ts_tablet_manager.cc:1434] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:18:21.753605 16654 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.755587 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.756210 16531 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.756328 16783 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.758968 16654 tablet_bootstrap.cc:654] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.759145 16652 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.759615 16652 ts_tablet_manager.cc:1403] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.001s
I20260709 13:18:21.762295 16652 raft_consensus.cc:359] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.762460 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.762939 16652 raft_consensus.cc:385] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.763082 16606 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.763257 16652 raft_consensus.cc:740] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.764058 16877 raft_consensus.cc:515] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.771350 16531 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:21.774624 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.775178 16381 raft_consensus.cc:3060] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.776577 16729 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.777051 16729 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.778991 16729 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.779413 16877 leader_election.cc:290] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.779938 16666 leader_election.cc:290] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:21.785772 16348 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.786618 16654 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.787115 16654 ts_tablet_manager.cc:1403] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.006s
I20260709 13:18:21.780160 16652 consensus_queue.cc:260] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.781605 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.782270 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.783643 16381 raft_consensus.cc:2468] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:21.789110 16532 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:21.790359 16497 leader_election.cc:304] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:21.791507 16877 raft_consensus.cc:2804] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:21.791785 16348 leader_election.cc:343] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.791610 16654 raft_consensus.cc:359] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.792194 16877 raft_consensus.cc:697] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:21.792495 16654 raft_consensus.cc:385] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.792600 16348 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:21.792939 16654 raft_consensus.cc:740] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.784669 16606 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:21.793706 16654 consensus_queue.cc:260] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.794497 16729 raft_consensus.cc:2804] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.795228 16882 raft_consensus.cc:2804] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.795399 16652 ts_tablet_manager.cc:1434] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:18:21.795637 16882 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.795876 16654 ts_tablet_manager.cc:1434] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:21.796013 16882 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.796368 16652 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.796802 16654 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.797248 16651 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.797400 16729 raft_consensus.cc:697] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:21.797832 16651 ts_tablet_manager.cc:1403] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.003s
I20260709 13:18:21.798259 16729 consensus_queue.cc:237] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.793123 16877 consensus_queue.cc:237] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:21.802183 16651 raft_consensus.cc:359] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.803102 16651 raft_consensus.cc:385] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.803416 16651 raft_consensus.cc:740] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.804054 16651 consensus_queue.cc:260] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
W20260709 13:18:21.820487 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 97407.6us
I20260709 13:18:21.843564 16651 ts_tablet_manager.cc:1434] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.006s
I20260709 13:18:21.845463 16653 tablet_bootstrap.cc:492] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:21.847114 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.849049 16456 raft_consensus.cc:3060] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.849123 16758 consensus_queue.cc:1048] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.851753 16381 raft_consensus.cc:2393] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:21.851759 16651 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.853180 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.856149 16654 tablet_bootstrap.cc:654] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.852852 16882 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.859561 16653 ts_tablet_manager.cc:1403] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.002s
I20260709 13:18:21.860103 16651 tablet_bootstrap.cc:654] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.860778 16882 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:21.862211 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.863157 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.863744 16532 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.863853 16348 leader_election.cc:343] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.866338 16652 tablet_bootstrap.cc:654] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.869473 16654 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.867061 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76a2947ae845cab4136ccd212eb71f" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.879451 16654 ts_tablet_manager.cc:1403] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.005s
I20260709 13:18:21.879786 16606 raft_consensus.cc:2393] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:21.875451 16651 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:21.875847 16666 consensus_queue.cc:1048] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.880944 16651 ts_tablet_manager.cc:1403] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.012s
I20260709 13:18:21.871959 16532 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:21.882277 16348 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:21.883312 16882 raft_consensus.cc:2804] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.878763 16571 leader_election.cc:304] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:21.876900 16653 raft_consensus.cc:359] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.883787 16651 raft_consensus.cc:359] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.885941 16651 raft_consensus.cc:385] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.884476 16654 raft_consensus.cc:359] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.884176 16666 raft_consensus.cc:2749] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.884267 16653 raft_consensus.cc:385] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.886615 16653 raft_consensus.cc:740] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.886824 16654 raft_consensus.cc:385] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.887159 16654 raft_consensus.cc:740] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.887585 16653 consensus_queue.cc:260] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.887897 16654 consensus_queue.cc:260] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.889849 16653 ts_tablet_manager.cc:1434] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:18:21.890681 16654 ts_tablet_manager.cc:1434] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:18:21.886281 16651 raft_consensus.cc:740] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.891795 16651 consensus_queue.cc:260] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.890787 16653 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:21.893790 16654 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:21.894619 16661 raft_consensus.cc:493] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.883780 16882 raft_consensus.cc:697] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:21.895087 16661 raft_consensus.cc:515] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.896040 16882 consensus_queue.cc:237] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:21.897931 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:21.898070 16661 leader_election.cc:290] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.898741 16532 raft_consensus.cc:2468] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:21.899065 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:21.899686 16606 raft_consensus.cc:2468] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:21.900916 16424 leader_election.cc:304] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.902711 16654 tablet_bootstrap.cc:654] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.904511 16661 raft_consensus.cc:2804] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.904956 16661 raft_consensus.cc:493] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.905388 16661 raft_consensus.cc:3060] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.916532 16651 ts_tablet_manager.cc:1434] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:18:21.917688 16651 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:21.923107 16652 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:21.912923 16661 raft_consensus.cc:515] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.923614 16652 ts_tablet_manager.cc:1403] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.011s
I20260709 13:18:21.925798 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:21.926438 16532 raft_consensus.cc:3060] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.926177 16280 catalog_manager.cc:5697] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.933408 16652 raft_consensus.cc:359] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.934084 16652 raft_consensus.cc:385] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.934343 16652 raft_consensus.cc:740] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.935060 16652 consensus_queue.cc:260] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.936467 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e871d54ea7e74517a5f6baa2a0e3d96c" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:21.937062 16606 raft_consensus.cc:3060] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.937062 16652 ts_tablet_manager.cc:1434] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:18:21.938987 16652 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:21.944370 16606 raft_consensus.cc:2468] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:21.945327 16666 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.945577 16424 leader_election.cc:304] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.945847 16666 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.946511 16758 raft_consensus.cc:2804] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.946758 16652 tablet_bootstrap.cc:654] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.947013 16758 raft_consensus.cc:697] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:21.947816 16666 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.949173 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:21.951859 16382 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:21.951990 16758 consensus_queue.cc:237] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:21.953105 16571 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:21.953919 16666 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.954267 16666 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.954581 16666 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.958683 16532 raft_consensus.cc:2468] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:21.966217 16666 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.950387 16278 catalog_manager.cc:5697] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.960412 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:21.950693 16653 tablet_bootstrap.cc:654] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:21.969749 16571 leader_election.cc:343] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.950928 16661 leader_election.cc:290] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:21.971899 16651 tablet_bootstrap.cc:654] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.972606 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:21.974097 16382 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.974846 16654 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:21.975296 16654 ts_tablet_manager.cc:1403] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.082s	user 0.036s	sys 0.026s
I20260709 13:18:21.977807 16654 raft_consensus.cc:359] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.981499 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:21.981976 16654 raft_consensus.cc:385] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.982291 16654 raft_consensus.cc:740] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
W20260709 13:18:21.982882 16571 leader_election.cc:343] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.985270 16382 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:21.986054 16666 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:21.982920 16654 consensus_queue.cc:260] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.991312 16654 ts_tablet_manager.cc:1434] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:18:21.994987 16571 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:21.997900 16896 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.997385 16281 catalog_manager.cc:5697] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.998391 16896 raft_consensus.cc:697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:21.999233 16896 consensus_queue.cc:237] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:21.992156 16654 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:22.009128 16654 tablet_bootstrap.cc:654] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.029397 16751 consensus_queue.cc:1048] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.038070 16278 catalog_manager.cc:5697] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.046209 16896 consensus_queue.cc:1048] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.048543 16653 tablet_bootstrap.cc:492] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.049842 16653 ts_tablet_manager.cc:1403] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.008s
I20260709 13:18:22.054066 16652 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:22.054737 16652 ts_tablet_manager.cc:1403] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.001s
I20260709 13:18:22.058823 16652 raft_consensus.cc:359] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.060312 16652 raft_consensus.cc:385] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.060783 16652 raft_consensus.cc:740] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.070914 16896 consensus_queue.cc:1048] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.074458 16653 raft_consensus.cc:359] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.075106 16653 raft_consensus.cc:385] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.075348 16653 raft_consensus.cc:740] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.075500 16882 consensus_queue.cc:1048] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.075999 16653 consensus_queue.cc:260] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.077824 16281 catalog_manager.cc:5697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.080859 16652 consensus_queue.cc:260] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.081773 16654 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:22.082247 16654 ts_tablet_manager.cc:1403] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.090s	user 0.027s	sys 0.023s
I20260709 13:18:22.082471 16653 ts_tablet_manager.cc:1434] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:18:22.085245 16651 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:22.085852 16651 ts_tablet_manager.cc:1403] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.019s
I20260709 13:18:22.089038 16651 raft_consensus.cc:359] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.089834 16651 raft_consensus.cc:385] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.090144 16651 raft_consensus.cc:740] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.090921 16651 consensus_queue.cc:260] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.098450 16653 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:22.084874 16654 raft_consensus.cc:359] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.100528 16654 raft_consensus.cc:385] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.100816 16654 raft_consensus.cc:740] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.101471 16654 consensus_queue.cc:260] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.104772 16654 ts_tablet_manager.cc:1434] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:18:22.105542 16652 ts_tablet_manager.cc:1434] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:18:22.106467 16652 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:22.112375 16652 tablet_bootstrap.cc:654] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.117486 16654 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:22.123703 16654 tablet_bootstrap.cc:654] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.126780 16691 consensus_queue.cc:1048] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.127228 16653 tablet_bootstrap.cc:654] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.143157 16653 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.143592 16653 ts_tablet_manager.cc:1403] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.005s
I20260709 13:18:22.143774 16740 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.144269 16740 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.145736 16723 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.146425 16740 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.146240 16723 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.146279 16653 raft_consensus.cc:359] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.147125 16653 raft_consensus.cc:385] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.147388 16653 raft_consensus.cc:740] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.148001 16653 consensus_queue.cc:260] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.148221 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:22.149555 16571 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.151912 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.152370 16654 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:22.152267 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.152900 16654 ts_tablet_manager.cc:1403] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.001s
W20260709 13:18:22.153573 16571 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:22.153918 16348 leader_election.cc:343] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.154959 16571 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.159159 16652 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:22.159888 16740 raft_consensus.cc:2749] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.160382 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.161191 16531 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:22.162241 16653 ts_tablet_manager.cc:1434] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:18:22.148326 16723 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.163527 16653 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:22.163074 16723 consensus_queue.cc:1048] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.169054 16348 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.172040 16723 raft_consensus.cc:2804] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.172523 16723 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.172708 16651 ts_tablet_manager.cc:1434] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 13:18:22.172933 16723 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.173791 16651 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:22.177564 16729 raft_consensus.cc:493] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.178145 16729 raft_consensus.cc:515] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.179811 16729 leader_election.cc:290] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.162351 16652 ts_tablet_manager.cc:1403] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.006s
I20260709 13:18:22.182435 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:22.183097 16606 raft_consensus.cc:2393] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:22.184389 16651 tablet_bootstrap.cc:654] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.185035 16652 raft_consensus.cc:359] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.185762 16652 raft_consensus.cc:385] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.186018 16652 raft_consensus.cc:740] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.160410 16654 raft_consensus.cc:359] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.187182 16654 raft_consensus.cc:385] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.187482 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6597b6be11d44863bb49b53494f07b3b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.187866 16654 raft_consensus.cc:740] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.188555 16654 consensus_queue.cc:260] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.189399 16348 leader_election.cc:304] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:22.190718 16783 raft_consensus.cc:3060] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.193133 16653 tablet_bootstrap.cc:654] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.196244 16654 ts_tablet_manager.cc:1434] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.005s
I20260709 13:18:22.196938 16652 consensus_queue.cc:260] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.199191 16654 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:22.199836 16652 ts_tablet_manager.cc:1434] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:18:22.200919 16652 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:22.201458 16740 raft_consensus.cc:493] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.201933 16740 raft_consensus.cc:515] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.202405 16723 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.204443 16740 leader_election.cc:290] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.206490 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85bd059c93407bad570daec3df678f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.219210 16532 raft_consensus.cc:2468] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:22.220535 16571 leader_election.cc:304] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:22.221380 16740 raft_consensus.cc:2804] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.221763 16740 raft_consensus.cc:493] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.222121 16740 raft_consensus.cc:3060] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.222719 16723 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.207152 16652 tablet_bootstrap.cc:654] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.207043 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85bd059c93407bad570daec3df678f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.215451 16651 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:22.224148 16651 ts_tablet_manager.cc:1403] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.004s
I20260709 13:18:22.226361 16456 raft_consensus.cc:2468] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:22.230592 16740 raft_consensus.cc:515] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.218467 16653 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.231437 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:22.231819 16653 ts_tablet_manager.cc:1403] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.009s
I20260709 13:18:22.233040 16783 raft_consensus.cc:2749] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.234534 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:22.235191 16532 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.235733 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85bd059c93407bad570daec3df678f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:22.236305 16456 raft_consensus.cc:3060] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.239091 16654 tablet_bootstrap.cc:654] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.239001 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85bd059c93407bad570daec3df678f" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:22.239987 16531 raft_consensus.cc:3060] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.243115 16740 leader_election.cc:290] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.243470 16532 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
W20260709 13:18:22.234697 16348 leader_election.cc:343] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.245867 16653 raft_consensus.cc:359] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.246737 16653 raft_consensus.cc:385] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.246888 16348 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.248875 16651 raft_consensus.cc:359] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.249521 16651 raft_consensus.cc:385] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.249775 16651 raft_consensus.cc:740] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.250938 16882 raft_consensus.cc:2804] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.251472 16882 raft_consensus.cc:697] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:22.253137 16882 consensus_queue.cc:237] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.252005 16651 consensus_queue.cc:260] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.247068 16653 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.258555 16651 ts_tablet_manager.cc:1434] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:18:22.262060 16651 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:22.259714 16531 raft_consensus.cc:2468] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:22.264331 16571 leader_election.cc:304] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:22.265532 16740 raft_consensus.cc:2804] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.266089 16740 raft_consensus.cc:697] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:22.267051 16740 consensus_queue.cc:237] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.269042 16758 consensus_queue.cc:1048] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.258184 16653 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.272365 16661 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.272461 16653 ts_tablet_manager.cc:1434] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:18:22.272814 16661 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.274613 16661 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.274855 16653 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:22.280381 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:22.290002 16653 tablet_bootstrap.cc:654] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.294425 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.295243 16531 raft_consensus.cc:2393] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:22.296283 16423 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:22.297365 16758 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.301095 16456 raft_consensus.cc:2468] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:22.305552 16653 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.306118 16653 ts_tablet_manager.cc:1403] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.003s
I20260709 13:18:22.309432 16653 raft_consensus.cc:359] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.310398 16653 raft_consensus.cc:385] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.320999 16653 raft_consensus.cc:740] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.321879 16653 consensus_queue.cc:260] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.310222 16758 raft_consensus.cc:2749] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:22.320112 16348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:39149, user_credentials={real_user=slave}} blocked reactor thread for 73506.2us
I20260709 13:18:22.317817 16654 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:22.331244 16654 ts_tablet_manager.cc:1403] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.023s
I20260709 13:18:22.332793 16696 raft_consensus.cc:493] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.333456 16696 raft_consensus.cc:515] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.335800 16696 leader_election.cc:290] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.338294 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.339906 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:22.340590 16382 raft_consensus.cc:2468] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
W20260709 13:18:22.342456 16571 leader_election.cc:343] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.348133 16571 leader_election.cc:304] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.349224 16654 raft_consensus.cc:359] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.349367 16696 raft_consensus.cc:2804] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.354991 16696 raft_consensus.cc:493] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.355422 16696 raft_consensus.cc:3060] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.359961 16651 tablet_bootstrap.cc:654] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.361255 16930 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.352722 16652 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:22.368228 16652 ts_tablet_manager.cc:1403] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.167s	user 0.007s	sys 0.064s
I20260709 13:18:22.350204 16654 raft_consensus.cc:385] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.369151 16654 raft_consensus.cc:740] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.370123 16654 consensus_queue.cc:260] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.354406 16691 raft_consensus.cc:493] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.375702 16691 raft_consensus.cc:515] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.377271 16652 raft_consensus.cc:359] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.377751 16691 leader_election.cc:290] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:22.378001 16652 raft_consensus.cc:385] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.378315 16652 raft_consensus.cc:740] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.378803 16652 consensus_queue.cc:260] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.380633 16652 ts_tablet_manager.cc:1434] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.003s
I20260709 13:18:22.380646 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56b22b1a54c4c578938b845034bf989" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:22.381430 16605 raft_consensus.cc:2468] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:22.382252 16653 ts_tablet_manager.cc:1434] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.076s	user 0.017s	sys 0.011s
I20260709 13:18:22.385134 16652 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:22.387174 16653 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:22.387496 16661 consensus_queue.cc:1048] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.393667 16281 catalog_manager.cc:5697] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.373224 16740 raft_consensus.cc:493] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.401023 16498 leader_election.cc:304] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:22.401816 16653 tablet_bootstrap.cc:654] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.393159 16280 catalog_manager.cc:5697] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.408214 16654 ts_tablet_manager.cc:1434] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:18:22.409503 16654 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:22.403951 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56b22b1a54c4c578938b845034bf989" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:22.412735 16920 raft_consensus.cc:2804] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.412518 16740 raft_consensus.cc:515] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.413141 16920 raft_consensus.cc:493] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.413554 16920 raft_consensus.cc:3060] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.415226 16740 leader_election.cc:290] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
W20260709 13:18:22.418351 16497 leader_election.cc:343] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.418403 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.419375 16691 consensus_queue.cc:1048] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.419402 16654 tablet_bootstrap.cc:654] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:22.420857 16571 leader_election.cc:343] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.423745 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.424342 16532 raft_consensus.cc:2468] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 0.
I20260709 13:18:22.367029 16696 raft_consensus.cc:515] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.429438 16571 leader_election.cc:304] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.436522 16896 raft_consensus.cc:2804] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.439572 16896 raft_consensus.cc:493] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.439908 16896 raft_consensus.cc:3060] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.441254 16882 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:22.443102 16456 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.446470 16651 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:22.446894 16651 ts_tablet_manager.cc:1403] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.005s
W20260709 13:18:22.446199 16424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.68:45619, user_credentials={real_user=slave}} blocked reactor thread for 121840us
I20260709 13:18:22.470854 16696 leader_election.cc:290] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.472265 16383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:22.478330 16383 raft_consensus.cc:3060] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.480782 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
W20260709 13:18:22.482023 16571 leader_election.cc:343] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.485376 16896 raft_consensus.cc:515] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.485671 16651 raft_consensus.cc:359] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.485440 16882 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.486822 16882 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.488315 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:22.488852 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:22.473134 16930 consensus_queue.cc:1048] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.474526 16691 consensus_queue.cc:1048] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.489392 16532 raft_consensus.cc:3060] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.490876 16729 consensus_queue.cc:1048] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.494726 16882 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.495743 16603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:22.495738 16571 leader_election.cc:343] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.496583 16603 raft_consensus.cc:2468] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:22.495561 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:22.486315 16651 raft_consensus.cc:385] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.472813 16653 tablet_bootstrap.cc:492] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.502048 16653 ts_tablet_manager.cc:1403] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.014s
I20260709 13:18:22.500828 16532 raft_consensus.cc:2468] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:22.501761 16651 raft_consensus.cc:740] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.503981 16571 leader_election.cc:304] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.505790 16802 raft_consensus.cc:2804] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.501492 16920 raft_consensus.cc:515] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.510378 16383 raft_consensus.cc:2468] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:22.511514 16653 raft_consensus.cc:359] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.513885 16815 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.523644 16815 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.524564 16653 raft_consensus.cc:385] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.524976 16653 raft_consensus.cc:740] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.503166 16896 leader_election.cc:290] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.515862 16666 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.517138 16652 tablet_bootstrap.cc:654] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.498277 16349 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:22.504513 16651 consensus_queue.cc:260] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.525648 16653 consensus_queue.cc:260] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.530525 16723 raft_consensus.cc:2804] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.530798 16653 ts_tablet_manager.cc:1434] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:18:22.530910 16723 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.531455 16723 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.531976 16653 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:22.537824 16571 leader_election.cc:304] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:22.538990 16666 raft_consensus.cc:2804] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.539587 16666 raft_consensus.cc:697] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:22.540544 16666 consensus_queue.cc:237] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
W20260709 13:18:22.543712 16348 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.562976 16651 ts_tablet_manager.cc:1434] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.001s
I20260709 13:18:22.564446 16920 leader_election.cc:290] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:22.565773 16653 tablet_bootstrap.cc:654] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.566699 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56b22b1a54c4c578938b845034bf989" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:22.567319 16381 raft_consensus.cc:3060] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.571758 16651 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:22.572583 16802 raft_consensus.cc:697] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:22.606963 16723 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.609642 16654 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:22.614578 16654 ts_tablet_manager.cc:1403] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.006s
I20260709 13:18:22.589496 16604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56b22b1a54c4c578938b845034bf989" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
W20260709 13:18:22.631700 16348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 116097us
I20260709 13:18:22.621048 16604 raft_consensus.cc:3060] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:22.638437 16943 log.cc:927] Time spent T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: Append to log took a long time: real 0.122s	user 0.004s	sys 0.000s
I20260709 13:18:22.629105 16758 consensus_queue.cc:1048] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:18:22.647912 16815 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:22.652380 16381 raft_consensus.cc:2468] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:22.660650 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:22.667251 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:22.668936 16651 tablet_bootstrap.cc:654] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.670843 16815 consensus_queue.cc:1048] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.682969 16723 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:22.683390 16802 consensus_queue.cc:237] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.684042 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:22.687072 16654 raft_consensus.cc:359] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.695988 16654 raft_consensus.cc:385] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.696355 16654 raft_consensus.cc:740] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.688330 16951 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.707631 16654 consensus_queue.cc:260] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.697144 16378 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:22.711062 16497 leader_election.cc:304] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:22.741456 16758 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.731900 16604 raft_consensus.cc:2468] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:22.709532 16951 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
W20260709 13:18:22.759093 16348 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.767731 16920 raft_consensus.cc:2804] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:22.766760 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44563, user_credentials={real_user=slave}} blocked reactor thread for 66961.7us
I20260709 13:18:22.798614 16653 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:22.799118 16653 ts_tablet_manager.cc:1403] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.267s	user 0.015s	sys 0.005s
I20260709 13:18:22.764354 16758 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.807600 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:22.782284 16423 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:22.809211 16935 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:22.809747 16935 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b1fa0b853a943c5bf98a7834dfd8c7c)
I20260709 13:18:22.810202 16935 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:22.811124 16652 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:22.811602 16652 ts_tablet_manager.cc:1403] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.427s	user 0.020s	sys 0.013s
I20260709 13:18:22.815140 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:22.815785 16599 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.818459 16802 consensus_queue.cc:1048] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.800537 16920 raft_consensus.cc:697] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:22.822296 16951 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:22.827386 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.843267 16920 consensus_queue.cc:237] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.831732 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:22.848905 16815 raft_consensus.cc:493] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.849534 16815 raft_consensus.cc:515] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.852973 16815 leader_election.cc:290] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:22.854604 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.854547 16652 raft_consensus.cc:359] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.854976 16600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16ffbf47354393b50c7d429e157a85" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:22.855371 16652 raft_consensus.cc:385] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.855513 16529 raft_consensus.cc:2393] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:22.855712 16652 raft_consensus.cc:740] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.856348 16652 consensus_queue.cc:260] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:22.856829 16423 leader_election.cc:304] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:22.858022 16938 raft_consensus.cc:3060] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:22.862393 16571 leader_election.cc:343] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.865363 16758 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:22.867005 16652 ts_tablet_manager.cc:1434] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:18:22.868046 16652 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:22.867683 16653 raft_consensus.cc:359] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.868495 16653 raft_consensus.cc:385] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.868834 16653 raft_consensus.cc:740] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.872188 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:22.874195 16652 tablet_bootstrap.cc:654] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.875211 16951 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.883517 16729 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:22.887583 16571 leader_election.cc:343] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.888079 16571 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:22.889686 16960 raft_consensus.cc:2749] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.893661 16653 consensus_queue.cc:260] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.908617 16653 ts_tablet_manager.cc:1434] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:18:22.909669 16654 ts_tablet_manager.cc:1434] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.295s	user 0.029s	sys 0.026s
I20260709 13:18:22.912901 16651 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:22.913552 16651 ts_tablet_manager.cc:1403] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.350s	user 0.011s	sys 0.008s
I20260709 13:18:22.914085 16654 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:22.919555 16802 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.920336 16802 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:22.923849 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.924050 16802 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
W20260709 13:18:22.925611 16571 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.928829 16938 raft_consensus.cc:2749] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.931151 16458 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.875204 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:22.935120 16654 tablet_bootstrap.cc:654] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.945811 16423 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:22.960486 16651 raft_consensus.cc:359] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.961081 16651 raft_consensus.cc:385] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.961310 16651 raft_consensus.cc:740] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.961803 16758 raft_consensus.cc:493] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.962281 16758 raft_consensus.cc:515] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:22.962819 16651 consensus_queue.cc:260] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:22.974702 16651 ts_tablet_manager.cc:1434] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:18:22.984552 16956 consensus_queue.cc:1048] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:18:22.991815 16652 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:22.992295 16652 ts_tablet_manager.cc:1403] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.017s
I20260709 13:18:22.997875 16758 leader_election.cc:290] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:22.998234 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.003644 16652 raft_consensus.cc:359] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.004344 16652 raft_consensus.cc:385] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.004606 16652 raft_consensus.cc:740] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.005283 16652 consensus_queue.cc:260] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.006449 16653 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:23.007432 16652 ts_tablet_manager.cc:1434] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:23.009374 16455 raft_consensus.cc:3060] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.990592 16935 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.024927 16654 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.025473 16654 ts_tablet_manager.cc:1403] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.115s	user 0.008s	sys 0.018s
I20260709 13:18:23.027559 16651 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.043184 16651 tablet_bootstrap.cc:654] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.031064 16454 raft_consensus.cc:1240] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Rejecting Update request from peer 9b1fa0b853a943c5bf98a7834dfd8c7c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:23.043774 16652 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:23.065308 16938 raft_consensus.cc:2749] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.047704 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.066077 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572881c47e5e493a8a45f1bb34f4d7e5" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.066798 16382 raft_consensus.cc:2393] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:23.067667 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:23.049252 16935 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.069337 16723 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.070822 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:23.066812 16783 raft_consensus.cc:493] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.071594 16783 raft_consensus.cc:515] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.073437 16783 leader_election.cc:290] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.076352 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:23.077034 16571 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.077425 16423 leader_election.cc:304] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:23.078778 16423 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:23.080457 16758 raft_consensus.cc:2749] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.080880 16935 raft_consensus.cc:2749] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:23.083179 16348 leader_election.cc:343] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.041074 16599 raft_consensus.cc:2468] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:23.085197 16349 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.085754 16652 tablet_bootstrap.cc:654] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.086642 16729 raft_consensus.cc:2804] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.086812 16653 tablet_bootstrap.cc:654] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.087206 16729 raft_consensus.cc:697] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:23.077500 16571 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:23.088094 16729 consensus_queue.cc:237] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.090729 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.091403 16527 raft_consensus.cc:2468] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:23.092825 16958 raft_consensus.cc:2749] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.097527 16964 consensus_queue.cc:1059] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:23.098515 16958 raft_consensus.cc:3055] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:23.095594 16956 consensus_queue.cc:1048] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:23.098855 16958 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:23.100981 16958 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.102517 16958 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:23.108501 16654 raft_consensus.cc:359] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.109162 16654 raft_consensus.cc:385] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.109448 16654 raft_consensus.cc:740] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.110105 16654 consensus_queue.cc:260] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.106227 16348 leader_election.cc:304] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.112175 16723 raft_consensus.cc:2804] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.112670 16723 raft_consensus.cc:493] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.113071 16723 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.146626 16971 raft_consensus.cc:493] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.147429 16971 raft_consensus.cc:515] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
W20260709 13:18:23.175696 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.67:39149, user_credentials={real_user=slave}} blocked reactor thread for 64749.5us
I20260709 13:18:23.240506 16654 ts_tablet_manager.cc:1434] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.215s	user 0.025s	sys 0.020s
I20260709 13:18:23.241540 16654 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.241380 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:23.242633 16497 leader_election.cc:343] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.245390 16651 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:23.245883 16651 ts_tablet_manager.cc:1403] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.219s	user 0.027s	sys 0.042s
I20260709 13:18:23.248641 16971 leader_election.cc:290] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:23.248492 16281 catalog_manager.cc:5697] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.251356 16281 catalog_manager.cc:5697] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 1 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.248523 16651 raft_consensus.cc:359] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.255625 16651 raft_consensus.cc:385] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.255906 16651 raft_consensus.cc:740] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.256640 16651 consensus_queue.cc:260] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
W20260709 13:18:23.248776 16348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:39149, user_credentials={real_user=slave}} blocked reactor thread for 152834us
I20260709 13:18:23.268703 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.269336 16601 raft_consensus.cc:2468] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:23.270860 16882 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.271335 16882 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.272694 16652 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:23.273161 16652 ts_tablet_manager.cc:1403] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.230s	user 0.025s	sys 0.038s
I20260709 13:18:23.273304 16882 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:23.276307 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.276083 16652 raft_consensus.cc:359] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.276949 16599 raft_consensus.cc:2468] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:23.276991 16652 raft_consensus.cc:385] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.277647 16652 raft_consensus.cc:740] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.278488 16652 consensus_queue.cc:260] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.280861 16349 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:23.281302 16652 ts_tablet_manager.cc:1434] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:23.281999 16882 raft_consensus.cc:2804] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.282374 16652 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:23.282362 16882 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.282867 16882 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.285107 16654 tablet_bootstrap.cc:654] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.285825 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.290846 16950 consensus_queue.cc:1048] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:23.293906 16348 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.298079 16652 tablet_bootstrap.cc:654] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.291417 16882 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.304759 16651 ts_tablet_manager.cc:1434] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:18:23.305748 16651 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.305658 16498 leader_election.cc:304] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.303128 16882 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:23.311398 16751 raft_consensus.cc:2804] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.325776 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:23.327553 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:23.329344 16606 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.317734 16751 raft_consensus.cc:493] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.314406 16958 consensus_queue.cc:1048] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:18:23.333762 16751 raft_consensus.cc:3060] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.343488 16691 consensus_queue.cc:1048] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.354462 16653 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.355332 16653 ts_tablet_manager.cc:1403] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.349s	user 0.003s	sys 0.026s
I20260709 13:18:23.357810 16606 raft_consensus.cc:2468] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:23.361459 16654 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.361971 16654 ts_tablet_manager.cc:1403] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.121s	user 0.033s	sys 0.007s
I20260709 13:18:23.362186 16920 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.362658 16920 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.374320 16950 consensus_queue.cc:1048] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:23.377431 16920 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:23.379237 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.380407 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:23.382189 16497 leader_election.cc:343] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.382790 16497 leader_election.cc:343] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.383159 16497 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.383963 16920 raft_consensus.cc:2749] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.357280 16691 consensus_queue.cc:1048] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:18:23.363467 16723 raft_consensus.cc:515] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.389425 16653 raft_consensus.cc:359] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.390072 16653 raft_consensus.cc:385] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.390324 16653 raft_consensus.cc:740] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.391733 16653 consensus_queue.cc:260] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.393904 16653 ts_tablet_manager.cc:1434] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 13:18:23.394795 16653 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
W20260709 13:18:23.386476 16348 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.395704 16654 raft_consensus.cc:359] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.398100 16654 raft_consensus.cc:385] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.398478 16654 raft_consensus.cc:740] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.407343 16654 consensus_queue.cc:260] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.411616 16654 ts_tablet_manager.cc:1434] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:18:23.412797 16654 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.425273 16349 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:23.426290 16783 raft_consensus.cc:2804] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:23.426409 16349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:45619, user_credentials={real_user=slave}} blocked reactor thread for 51162.2us
I20260709 13:18:23.427232 16652 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:23.427027 16783 raft_consensus.cc:697] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:23.430701 16652 ts_tablet_manager.cc:1403] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.149s	user 0.031s	sys 0.032s
I20260709 13:18:23.431243 16783 consensus_queue.cc:237] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.440888 16652 raft_consensus.cc:359] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.443043 16652 raft_consensus.cc:385] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.443398 16652 raft_consensus.cc:740] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.444190 16652 consensus_queue.cc:260] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.445719 16751 raft_consensus.cc:515] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.448702 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:23.449260 16599 raft_consensus.cc:3060] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.425275 16654 tablet_bootstrap.cc:654] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.450775 16751 leader_election.cc:290] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:23.453867 16723 leader_election.cc:290] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.456593 16652 ts_tablet_manager.cc:1434] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:18:23.457405 16652 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:23.462738 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:23.463847 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:23.464387 16532 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:23.464682 16497 leader_election.cc:343] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.465605 16651 tablet_bootstrap.cc:654] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.467870 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
W20260709 13:18:23.471073 16348 leader_election.cc:343] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.475312 16652 tablet_bootstrap.cc:654] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.481056 16532 raft_consensus.cc:2468] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:23.482020 16653 tablet_bootstrap.cc:654] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.482357 16348 leader_election.cc:304] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.486013 16729 raft_consensus.cc:2804] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.486632 16729 raft_consensus.cc:697] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:23.487814 16729 consensus_queue.cc:237] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.499069 16454 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.496985 16599 raft_consensus.cc:2468] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:23.500926 16498 leader_election.cc:304] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.502102 16971 raft_consensus.cc:2804] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.502939 16971 raft_consensus.cc:697] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:23.508421 16971 consensus_queue.cc:237] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.512388 16651 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:23.512965 16651 ts_tablet_manager.cc:1403] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.000s
I20260709 13:18:23.507597 16654 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.522082 16654 ts_tablet_manager.cc:1403] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.012s
I20260709 13:18:23.526948 16651 raft_consensus.cc:359] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.531776 16937 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.532531 16937 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.534413 16654 raft_consensus.cc:359] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.535326 16654 raft_consensus.cc:385] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.535658 16654 raft_consensus.cc:740] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.536494 16654 consensus_queue.cc:260] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.538241 16279 catalog_manager.cc:5697] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.539433 16783 consensus_queue.cc:1048] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.540441 16654 ts_tablet_manager.cc:1434] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:23.541798 16654 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.544168 16937 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.544917 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.545080 16882 consensus_queue.cc:1048] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.552114 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.554072 16423 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:23.531533 16651 raft_consensus.cc:385] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.567479 16651 raft_consensus.cc:740] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.572263 16652 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:23.572782 16652 ts_tablet_manager.cc:1403] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.028s
I20260709 13:18:23.575150 16654 tablet_bootstrap.cc:654] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.576738 16950 raft_consensus.cc:493] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.577205 16950 raft_consensus.cc:515] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.580637 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:23.582154 16571 leader_election.cc:343] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.572660 16651 consensus_queue.cc:260] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.588393 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:23.589879 16571 leader_election.cc:343] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.590257 16571 leader_election.cc:304] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.590900 16958 raft_consensus.cc:2749] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.590989 16950 leader_election.cc:290] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:23.590694 16280 catalog_manager.cc:5697] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.598452 16651 ts_tablet_manager.cc:1434] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:18:23.599728 16651 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.611953 16653 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.612574 16653 ts_tablet_manager.cc:1403] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.016s
I20260709 13:18:23.617431 16938 raft_consensus.cc:2749] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:23.617183 16653 raft_consensus.cc:359] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.621388 16653 raft_consensus.cc:385] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.621726 16653 raft_consensus.cc:740] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.622686 16653 consensus_queue.cc:260] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.624974 16653 ts_tablet_manager.cc:1434] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:23.625955 16653 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:23.634389 16653 tablet_bootstrap.cc:654] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.638855 16651 tablet_bootstrap.cc:654] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.646201 16729 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.646672 16729 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.652156 16653 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.652671 16653 ts_tablet_manager.cc:1403] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 13:18:23.653291 16652 raft_consensus.cc:359] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.654246 16652 raft_consensus.cc:385] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.654580 16652 raft_consensus.cc:740] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.661796 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:23.663033 16348 leader_election.cc:343] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.664458 16729 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.665974 16652 consensus_queue.cc:260] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.670001 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.670907 16527 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:23.673038 16348 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.674065 16729 raft_consensus.cc:2804] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.674422 16729 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.674723 16729 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.676400 16653 raft_consensus.cc:359] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.677107 16653 raft_consensus.cc:385] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.677443 16653 raft_consensus.cc:740] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.678174 16653 consensus_queue.cc:260] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.681288 16653 ts_tablet_manager.cc:1434] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260709 13:18:23.682264 16653 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:23.682971 16729 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.685688 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
W20260709 13:18:23.686990 16348 leader_election.cc:343] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.688802 16653 tablet_bootstrap.cc:654] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.689122 16729 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.692862 16651 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:23.693306 16651 ts_tablet_manager.cc:1403] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.094s	user 0.006s	sys 0.013s
I20260709 13:18:23.695911 16651 raft_consensus.cc:359] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.700380 16651 raft_consensus.cc:385] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.700636 16651 raft_consensus.cc:740] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.701352 16652 ts_tablet_manager.cc:1434] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.003s
I20260709 13:18:23.701349 16651 consensus_queue.cc:260] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.703291 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:23.703881 16527 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.704452 16651 ts_tablet_manager.cc:1434] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:23.705422 16651 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.705864 16279 catalog_manager.cc:5697] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.715976 16654 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.716470 16654 ts_tablet_manager.cc:1403] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.175s	user 0.060s	sys 0.062s
I20260709 13:18:23.722312 16652 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:23.727195 16654 raft_consensus.cc:359] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.727873 16654 raft_consensus.cc:385] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.728128 16654 raft_consensus.cc:740] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.728878 16654 consensus_queue.cc:260] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.731345 16654 ts_tablet_manager.cc:1434] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:18:23.732216 16654 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.736732 16527 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:23.738101 16348 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.738857 16654 tablet_bootstrap.cc:654] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.739387 16729 raft_consensus.cc:2804] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.740365 16729 raft_consensus.cc:697] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:23.741287 16729 consensus_queue.cc:237] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.742498 16280 catalog_manager.cc:5697] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.744743 16280 catalog_manager.cc:5697] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.749502 16653 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.750032 16653 ts_tablet_manager.cc:1403] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.005s
I20260709 13:18:23.756397 16653 raft_consensus.cc:359] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.758097 16653 raft_consensus.cc:385] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.758728 16653 raft_consensus.cc:740] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.760367 16653 consensus_queue.cc:260] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.763116 16651 tablet_bootstrap.cc:654] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.766556 16654 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.766993 16654 ts_tablet_manager.cc:1403] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.021s
I20260709 13:18:23.768859 16653 ts_tablet_manager.cc:1434] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:18:23.769666 16654 raft_consensus.cc:359] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
W20260709 13:18:23.770818 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:23.771154 16654 raft_consensus.cc:385] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.771518 16654 raft_consensus.cc:740] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.772405 16654 consensus_queue.cc:260] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.777479 16653 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:23.779556 16654 ts_tablet_manager.cc:1434] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:18:23.780694 16654 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.781893 16652 tablet_bootstrap.cc:654] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.783947 16653 tablet_bootstrap.cc:654] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.787043 16938 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.787569 16938 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.789541 16938 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.793766 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.789669 16654 tablet_bootstrap.cc:654] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.795300 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.796110 16527 raft_consensus.cc:2393] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:23.798205 16423 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:23.799880 16937 raft_consensus.cc:493] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.800434 16937 raft_consensus.cc:515] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.802845 16937 leader_election.cc:290] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:23.803412 16937 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.807041 16975 raft_consensus.cc:493] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.807638 16975 raft_consensus.cc:515] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.810844 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.812547 16975 leader_election.cc:290] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.815485 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.815747 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.816236 16527 raft_consensus.cc:2393] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:23.816310 16606 raft_consensus.cc:2468] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:23.817989 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.818707 16424 leader_election.cc:304] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:23.819902 16938 raft_consensus.cc:2804] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.820289 16938 raft_consensus.cc:493] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.820654 16938 raft_consensus.cc:3060] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.820124 16423 leader_election.cc:304] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:23.825552 16975 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.828115 16950 raft_consensus.cc:493] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.827970 16938 raft_consensus.cc:515] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.828605 16950 raft_consensus.cc:515] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.830091 16651 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:23.830708 16651 ts_tablet_manager.cc:1403] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.002s
I20260709 13:18:23.831733 16950 leader_election.cc:290] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:23.832163 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:23.832212 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:23.832615 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.832957 16599 raft_consensus.cc:3060] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:23.825062 16423 leader_election.cc:343] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.834412 16938 leader_election.cc:290] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.835505 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
W20260709 13:18:23.837674 16571 leader_election.cc:343] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.843483 16423 leader_election.cc:343] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.850805 16571 leader_election.cc:343] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.851377 16571 leader_election.cc:304] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.852633 16950 raft_consensus.cc:2749] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.854049 16651 raft_consensus.cc:359] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.854871 16651 raft_consensus.cc:385] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.855213 16651 raft_consensus.cc:740] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.860772 16599 raft_consensus.cc:2468] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:23.863813 16937 raft_consensus.cc:2749] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.864349 16729 consensus_queue.cc:1048] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:23.868032 16975 raft_consensus.cc:2749] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.877761 16424 leader_election.cc:304] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:23.868762 16651 consensus_queue.cc:260] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.872748 16654 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.878664 16654 ts_tablet_manager.cc:1403] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.014s
I20260709 13:18:23.873131 16652 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:23.879813 16651 ts_tablet_manager.cc:1434] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:18:23.875437 16653 tablet_bootstrap.cc:492] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.880569 16975 raft_consensus.cc:2804] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.875962 16278 catalog_manager.cc:5697] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.881119 16975 raft_consensus.cc:697] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:23.881347 16654 raft_consensus.cc:359] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.881994 16975 consensus_queue.cc:237] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.880716 16653 ts_tablet_manager.cc:1403] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.103s	user 0.040s	sys 0.044s
I20260709 13:18:23.880220 16652 ts_tablet_manager.cc:1403] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.158s	user 0.007s	sys 0.004s
I20260709 13:18:23.886116 16652 raft_consensus.cc:359] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.886731 16652 raft_consensus.cc:385] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.887012 16652 raft_consensus.cc:740] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.882040 16654 raft_consensus.cc:385] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.887601 16652 consensus_queue.cc:260] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.887895 16654 raft_consensus.cc:740] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.887734 16653 raft_consensus.cc:359] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.888774 16653 raft_consensus.cc:385] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.888705 16654 consensus_queue.cc:260] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.889199 16653 raft_consensus.cc:740] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.889707 16652 ts_tablet_manager.cc:1434] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:23.890301 16653 consensus_queue.cc:260] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.890842 16654 ts_tablet_manager.cc:1434] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:18:23.892630 16654 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:23.894061 16653 ts_tablet_manager.cc:1434] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:23.894176 16651 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.895238 16937 raft_consensus.cc:493] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.898201 16937 raft_consensus.cc:515] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.898854 16653 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:23.899227 16691 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.899675 16691 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.900223 16937 leader_election.cc:290] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:23.902153 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.903172 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:23.904965 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958f3c6c84a24c3e9a6a13aa83ea11c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.905349 16691 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.905790 16606 raft_consensus.cc:2393] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:23.907100 16424 leader_election.cc:304] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:23.908550 16653 tablet_bootstrap.cc:654] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.910992 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:23.911729 16937 raft_consensus.cc:3060] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.916321 16651 tablet_bootstrap.cc:654] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.917369 16498 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:23.921949 16654 tablet_bootstrap.cc:654] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.928580 16691 raft_consensus.cc:2749] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.895932 16652 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:23.933765 16527 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.937968 16653 tablet_bootstrap.cc:492] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:23.942070 16950 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.939103 16937 raft_consensus.cc:2749] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.942544 16950 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:23.939134 16653 ts_tablet_manager.cc:1403] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 13:18:23.945399 16651 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:23.946525 16653 raft_consensus.cc:359] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:23.947230 16653 raft_consensus.cc:385] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.947556 16653 raft_consensus.cc:740] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.949064 16950 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:23.949276 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:23.950449 16571 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.943841 16652 tablet_bootstrap.cc:654] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.953709 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:23.955423 16882 consensus_queue.cc:1048] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:18:23.958567 16571 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.958968 16571 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:23.959841 16950 raft_consensus.cc:2749] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.954411 16651 ts_tablet_manager.cc:1403] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.006s
I20260709 13:18:23.962051 16930 consensus_queue.cc:1048] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.961720 16278 catalog_manager.cc:5697] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.963852 16651 raft_consensus.cc:359] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.964740 16651 raft_consensus.cc:385] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.965016 16651 raft_consensus.cc:740] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.965763 16651 consensus_queue.cc:260] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:23.951534 16691 consensus_queue.cc:1048] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:18:23.980295 16651 ts_tablet_manager.cc:1434] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:23.982033 16950 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.982527 16950 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:23.982448 16651 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:23.984530 16950 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:23.986375 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:23.986490 16382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:23.987577 16571 leader_election.cc:343] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.988180 16571 leader_election.cc:343] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.988543 16571 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:23.989609 16950 raft_consensus.cc:2749] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.991169 16654 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:23.991658 16654 ts_tablet_manager.cc:1403] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.023s
I20260709 13:18:23.999666 16654 raft_consensus.cc:359] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.001590 16654 raft_consensus.cc:385] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.001873 16654 raft_consensus.cc:740] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.003219 16751 raft_consensus.cc:493] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.002908 16654 consensus_queue.cc:260] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.003739 16751 raft_consensus.cc:515] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.004896 16654 ts_tablet_manager.cc:1434] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:18:24.006763 16751 leader_election.cc:290] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.007212 16458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.008562 16651 tablet_bootstrap.cc:654] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.950582 16653 consensus_queue.cc:260] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.009491 16458 raft_consensus.cc:2468] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:24.011497 16937 raft_consensus.cc:493] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.011680 16654 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:24.011915 16497 leader_election.cc:304] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:24.011960 16937 raft_consensus.cc:515] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.013242 16691 raft_consensus.cc:2804] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.014087 16691 raft_consensus.cc:493] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.014575 16691 raft_consensus.cc:3060] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.016655 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.017537 16937 leader_election.cc:290] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.016170 16930 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.018088 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.018791 16601 raft_consensus.cc:2468] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:24.018733 16930 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.019490 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.020138 16599 raft_consensus.cc:2468] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:24.020211 16424 leader_election.cc:304] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.021121 16937 raft_consensus.cc:2804] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.021504 16937 raft_consensus.cc:493] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.021823 16930 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.021946 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.022608 16532 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.022897 16654 tablet_bootstrap.cc:654] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.021854 16937 raft_consensus.cc:3060] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.026557 16348 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:24.027588 16882 raft_consensus.cc:2804] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.027966 16882 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.028358 16882 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.030339 16653 ts_tablet_manager.cc:1434] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:18:24.022917 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.034122 16599 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.034643 16653 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:24.037349 16937 raft_consensus.cc:515] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.041342 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:24.043380 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.043926 16599 raft_consensus.cc:3060] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.050877 16599 raft_consensus.cc:2468] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:24.051941 16424 leader_election.cc:304] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:24.052772 17014 raft_consensus.cc:2804] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.053252 17014 raft_consensus.cc:697] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:24.054037 17014 consensus_queue.cc:237] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.052280 16691 raft_consensus.cc:515] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.055749 16529 raft_consensus.cc:2393] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:24.055846 16882 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.075783 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.076530 16601 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.079319 16937 leader_election.cc:290] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.082795 16654 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:24.083253 16654 ts_tablet_manager.cc:1403] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.003s
I20260709 13:18:24.085103 16654 raft_consensus.cc:359] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.085690 16654 raft_consensus.cc:385] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.085947 16654 raft_consensus.cc:740] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.086668 16654 consensus_queue.cc:260] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.087320 16651 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:24.087817 16651 ts_tablet_manager.cc:1403] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.106s	user 0.005s	sys 0.026s
I20260709 13:18:24.088969 16654 ts_tablet_manager.cc:1434] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:24.090548 16654 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:24.091198 16651 raft_consensus.cc:359] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.091843 16651 raft_consensus.cc:385] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.092098 16651 raft_consensus.cc:740] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.092679 16651 consensus_queue.cc:260] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.094901 16654 tablet_bootstrap.cc:654] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.095297 16882 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.097216 16651 ts_tablet_manager.cc:1434] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:24.098177 16601 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.099434 16349 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.100342 16882 raft_consensus.cc:2804] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.101272 16882 raft_consensus.cc:697] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:24.102128 16652 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.102681 16652 ts_tablet_manager.cc:1403] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.010s
I20260709 13:18:24.104835 16651 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:24.107684 16652 raft_consensus.cc:359] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.108317 16652 raft_consensus.cc:385] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.108587 16652 raft_consensus.cc:740] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.109160 16652 consensus_queue.cc:260] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.113418 16691 leader_election.cc:290] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.120042 16652 ts_tablet_manager.cc:1434] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:18:24.120260 16281 catalog_manager.cc:5697] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.121678 16652 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.126555 16654 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:24.127039 16654 ts_tablet_manager.cc:1403] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 13:18:24.129819 16654 raft_consensus.cc:359] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.130584 16654 raft_consensus.cc:385] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.130882 16654 raft_consensus.cc:740] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.131505 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.131691 16654 consensus_queue.cc:260] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.132501 16605 raft_consensus.cc:2393] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:24.138365 16654 ts_tablet_manager.cc:1434] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:18:24.140136 16654 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:24.153688 16653 tablet_bootstrap.cc:654] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.102125 16882 consensus_queue.cc:237] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.176332 16930 consensus_queue.cc:1048] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.180575 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:24.193430 16527 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.181875 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70f92685aef44de910d2e3645e4ed91" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:24.212927 16652 tablet_bootstrap.cc:654] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.214046 16653 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:24.214488 16654 tablet_bootstrap.cc:654] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.214509 16653 ts_tablet_manager.cc:1403] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.180s	user 0.026s	sys 0.013s
I20260709 13:18:24.225725 16723 raft_consensus.cc:493] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.226403 16723 raft_consensus.cc:515] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.288743 17033 consensus_queue.cc:1048] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.341481 16938 consensus_queue.cc:1048] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.344208 16882 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.347078 16651 tablet_bootstrap.cc:654] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.358547 16652 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.358983 16652 ts_tablet_manager.cc:1403] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.002s
I20260709 13:18:24.353230 16723 leader_election.cc:290] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.354539 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.349102 16653 raft_consensus.cc:359] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.364485 16653 raft_consensus.cc:385] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.364833 16653 raft_consensus.cc:740] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.365586 16653 consensus_queue.cc:260] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.366886 16654 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:24.348402 16527 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.367360 16654 ts_tablet_manager.cc:1403] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.014s
I20260709 13:18:24.367918 16652 raft_consensus.cc:359] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.373446 16652 raft_consensus.cc:385] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.375028 16652 raft_consensus.cc:740] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.375726 16652 consensus_queue.cc:260] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.376238 16378 raft_consensus.cc:3060] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.369880 16950 raft_consensus.cc:493] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.377679 16652 ts_tablet_manager.cc:1434] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:18:24.377424 16950 raft_consensus.cc:515] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.379347 16950 leader_election.cc:290] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:24.380999 16652 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.381783 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.374406 16653 ts_tablet_manager.cc:1434] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.159s	user 0.012s	sys 0.011s
I20260709 13:18:24.383654 16653 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:24.385561 16937 consensus_queue.cc:1048] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:24.386148 16571 leader_election.cc:343] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.386786 16652 tablet_bootstrap.cc:654] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.376868 16281 catalog_manager.cc:5697] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.365669 16783 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:18:24.389298 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.398239 16652 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.398707 16652 ts_tablet_manager.cc:1403] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
W20260709 13:18:24.399525 16571 leader_election.cc:343] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.400638 16571 leader_election.cc:304] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:24.401443 16652 raft_consensus.cc:359] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.402094 16652 raft_consensus.cc:385] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.402346 16652 raft_consensus.cc:740] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.403084 16652 consensus_queue.cc:260] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.404757 16652 ts_tablet_manager.cc:1434] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:24.405633 16652 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.407157 16958 raft_consensus.cc:2749] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.411172 16652 tablet_bootstrap.cc:654] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.412523 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a1ccad75124fc1836b2ebf138c18b1" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.414995 16651 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:24.414866 16349 leader_election.cc:304] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:24.416010 16651 ts_tablet_manager.cc:1403] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.311s	user 0.019s	sys 0.013s
W20260709 13:18:24.417302 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 210709us
I20260709 13:18:24.417992 16751 raft_consensus.cc:493] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.418579 16751 raft_consensus.cc:515] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.418658 16651 raft_consensus.cc:359] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.419731 16651 raft_consensus.cc:385] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.420010 16651 raft_consensus.cc:740] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.420575 16751 leader_election.cc:290] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.420961 16651 consensus_queue.cc:260] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.421401 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.422353 16606 raft_consensus.cc:2468] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:24.418013 16497 leader_election.cc:304] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:24.423209 16651 ts_tablet_manager.cc:1434] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:24.423838 17036 raft_consensus.cc:2749] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.424299 16651 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:24.424558 16498 leader_election.cc:304] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.425482 17036 raft_consensus.cc:2804] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.426015 17036 raft_consensus.cc:493] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.426342 17036 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.430994 16930 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.431576 16930 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.435303 16652 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.370560 16654 raft_consensus.cc:359] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.435760 16652 ts_tablet_manager.cc:1403] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:18:24.435941 16654 raft_consensus.cc:385] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.436335 16930 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:24.436303 16654 raft_consensus.cc:740] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.436826 16653 tablet_bootstrap.cc:654] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.438357 16882 raft_consensus.cc:2749] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.442111 16652 raft_consensus.cc:359] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.442816 16652 raft_consensus.cc:385] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.443089 16652 raft_consensus.cc:740] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.443109 16654 consensus_queue.cc:260] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.443820 16652 consensus_queue.cc:260] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.445180 16654 ts_tablet_manager.cc:1434] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:18:24.445329 16652 ts_tablet_manager.cc:1434] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:18:24.446132 16654 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Bootstrap starting.
I20260709 13:18:24.446247 16652 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.447805 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.449785 16454 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.451555 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.452144 16531 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.456588 16348 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:24.457293 16930 raft_consensus.cc:2804] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.457504 16651 tablet_bootstrap.cc:654] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.457832 16930 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.458175 16958 raft_consensus.cc:493] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.458256 16930 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.462234 17036 raft_consensus.cc:515] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.468546 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:24.458763 16958 raft_consensus.cc:515] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.473727 16958 leader_election.cc:290] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:24.474924 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.475162 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
W20260709 13:18:24.476052 16571 leader_election.cc:343] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:24.476752 16571 leader_election.cc:343] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.477120 16571 leader_election.cc:304] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532
W20260709 13:18:24.480327 16497 leader_election.cc:343] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.480158 16740 raft_consensus.cc:2749] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.489590 16652 tablet_bootstrap.cc:654] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.494868 16723 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b1fa0b853a943c5bf98a7834dfd8c7c)
I20260709 13:18:24.495411 16723 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.497401 16723 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.498169 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.498973 16606 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:24.499945 16349 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.501492 16723 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:24.501892 16723 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9b1fa0b853a943c5bf98a7834dfd8c7c)
I20260709 13:18:24.502321 16723 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.504164 16654 tablet_bootstrap.cc:654] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.505443 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.506516 16457 raft_consensus.cc:2393] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:24.507855 17036 leader_election.cc:290] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.510274 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.510875 16606 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.515807 16930 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.518503 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:24.519160 16455 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.531883 16606 raft_consensus.cc:2468] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:24.533557 16498 leader_election.cc:304] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.534583 17033 raft_consensus.cc:2804] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.537367 16651 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:24.535058 17033 raft_consensus.cc:697] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:24.537861 16651 ts_tablet_manager.cc:1403] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.114s	user 0.003s	sys 0.012s
I20260709 13:18:24.539383 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:24.536062 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:24.541653 16531 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.543552 16455 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.544835 16348 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:24.545755 16882 raft_consensus.cc:2804] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.546187 16882 raft_consensus.cc:697] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
W20260709 13:18:24.546253 16497 leader_election.cc:343] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.547015 16882 consensus_queue.cc:237] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.549539 16531 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.549891 16783 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.550547 16783 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.551602 16652 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.552063 16652 ts_tablet_manager.cc:1403] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.011s
I20260709 13:18:24.552878 16783 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.556430 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.557049 16605 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.543355 16723 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.560418 16653 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:24.560901 16653 ts_tablet_manager.cc:1403] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.001s
I20260709 13:18:24.535461 16930 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:24.562076 16349 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.560916 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:24.567082 16531 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:24.568878 17014 consensus_queue.cc:1048] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.569828 16938 consensus_queue.cc:1048] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.565593 16783 raft_consensus.cc:2804] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.564229 17033 consensus_queue.cc:237] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.570900 16783 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.571154 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:24.571408 16783 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.571918 16455 raft_consensus.cc:2393] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:24.565343 16723 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.573768 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.573942 16652 raft_consensus.cc:359] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.574882 16652 raft_consensus.cc:385] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.575212 16652 raft_consensus.cc:740] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.578244 16652 consensus_queue.cc:260] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.579843 16654 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: No bootstrap required, opened a new log
I20260709 13:18:24.580287 16654 ts_tablet_manager.cc:1403] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.013s
I20260709 13:18:24.580494 16606 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:24.581966 16349 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:24.587337 16652 ts_tablet_manager.cc:1434] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:18:24.588478 16652 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.587349 16651 raft_consensus.cc:359] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.596421 16652 tablet_bootstrap.cc:654] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.596521 16651 raft_consensus.cc:385] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.597124 16651 raft_consensus.cc:740] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.597993 16651 consensus_queue.cc:260] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.600240 16651 ts_tablet_manager.cc:1434] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:18:24.586169 16723 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:24.601380 16651 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:24.600245 16280 catalog_manager.cc:5697] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.611896 16654 raft_consensus.cc:359] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.612586 16654 raft_consensus.cc:385] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.618040 16654 raft_consensus.cc:740] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.618985 16654 consensus_queue.cc:260] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.619886 16958 raft_consensus.cc:493] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.621541 16958 raft_consensus.cc:515] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.623771 16958 leader_election.cc:290] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.625921 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:24.629735 16571 leader_election.cc:343] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.631211 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.636166 16654 ts_tablet_manager.cc:1434] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:18:24.611441 16723 raft_consensus.cc:697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:24.637837 16723 consensus_queue.cc:237] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.640403 16651 tablet_bootstrap.cc:654] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:24.642980 16571 leader_election.cc:343] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.643481 16571 leader_election.cc:304] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:24.649911 16740 raft_consensus.cc:2749] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.663906 16729 consensus_queue.cc:1048] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.676036 16653 raft_consensus.cc:359] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.676962 16653 raft_consensus.cc:385] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.677304 16653 raft_consensus.cc:740] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.678936 16280 catalog_manager.cc:5697] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.683521 16652 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.684157 16652 ts_tablet_manager.cc:1403] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.009s
I20260709 13:18:24.685040 16653 consensus_queue.cc:260] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.687619 16652 raft_consensus.cc:359] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.688602 16652 raft_consensus.cc:385] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.688956 16652 raft_consensus.cc:740] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.712781 16653 ts_tablet_manager.cc:1434] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.002s
I20260709 13:18:24.715492 16653 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:24.714084 16652 consensus_queue.cc:260] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.726800 16652 ts_tablet_manager.cc:1434] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:18:24.734788 16740 raft_consensus.cc:493] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.735281 16740 raft_consensus.cc:515] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.736974 16740 leader_election.cc:290] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.737687 16783 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.739547 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:24.740248 16937 raft_consensus.cc:493] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.740752 16937 raft_consensus.cc:515] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
W20260709 13:18:24.742393 16571 leader_election.cc:343] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.743868 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
W20260709 13:18:24.745209 16571 leader_election.cc:343] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.745920 16571 leader_election.cc:304] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:24.746649 16950 raft_consensus.cc:2749] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.747064 16937 leader_election.cc:290] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.748728 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.749310 16606 raft_consensus.cc:2468] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:24.749607 16652 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.754755 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:24.758307 16378 raft_consensus.cc:2468] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:24.757061 16424 leader_election.cc:304] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.760107 17014 raft_consensus.cc:2804] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.760460 17014 raft_consensus.cc:493] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.760769 17014 raft_consensus.cc:3060] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.762902 16783 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.757400 16938 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.757119 16531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:24.768322 16938 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.770627 16938 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.772182 16531 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.772382 16278 catalog_manager.cc:5697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 1 to 2, leader changed from 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.778288 17036 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.778782 17036 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.780849 17036 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.782546 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.782845 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:24.783840 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:24.784251 16497 leader_election.cc:343] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.781921 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.784567 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
W20260709 13:18:24.785750 16497 leader_election.cc:343] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.786170 16497 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:24.788405 16691 raft_consensus.cc:2749] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.783069 16606 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.794891 16651 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:24.795336 16651 ts_tablet_manager.cc:1403] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.003s
I20260709 13:18:24.785208 16605 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:24.800602 16531 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.801676 16348 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:24.802265 17014 raft_consensus.cc:515] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.803326 16723 raft_consensus.cc:2804] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.803851 16723 raft_consensus.cc:697] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:24.804538 17014 leader_election.cc:290] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.805789 16424 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:24.807447 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.808079 16653 tablet_bootstrap.cc:654] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.808071 16601 raft_consensus.cc:3060] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.810070 16882 consensus_queue.cc:1048] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.811648 16651 raft_consensus.cc:359] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.812310 16651 raft_consensus.cc:385] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.812556 16651 raft_consensus.cc:740] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.804664 16723 consensus_queue.cc:237] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:24.809998 16606 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:24.821959 16601 raft_consensus.cc:2468] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:24.825711 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4f3010d6a401980cde5692a80f092" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:24.825748 16424 leader_election.cc:304] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.826504 16378 raft_consensus.cc:3060] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.827361 16652 tablet_bootstrap.cc:654] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.827769 17061 raft_consensus.cc:2804] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.828389 17061 raft_consensus.cc:697] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
W20260709 13:18:24.829300 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:24.829511 17061 consensus_queue.cc:237] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.813169 16651 consensus_queue.cc:260] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.824409 17014 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:24.835702 17014 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.836138 17014 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.850912 16651 ts_tablet_manager.cc:1434] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:18:24.851854 16651 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:24.894543 17025 raft_consensus.cc:493] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.895087 17025 raft_consensus.cc:515] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:24.897070 17025 leader_election.cc:290] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.898849 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:24.906780 16381 raft_consensus.cc:2468] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:24.908393 16279 catalog_manager.cc:5697] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.909512 16497 leader_election.cc:304] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:24.912673 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.911661 17036 raft_consensus.cc:2804] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.913759 17036 raft_consensus.cc:493] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.914219 17036 raft_consensus.cc:3060] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:24.916332 16497 leader_election.cc:343] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.918365 17033 raft_consensus.cc:493] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.918828 17033 raft_consensus.cc:515] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.910458 17014 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:24.930770 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:24.929148 17014 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:24.946497 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:24.946897 16652 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:24.947065 16605 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:24.947402 16652 ts_tablet_manager.cc:1403] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.198s	user 0.012s	sys 0.006s
I20260709 13:18:24.950655 16652 raft_consensus.cc:359] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.951292 16652 raft_consensus.cc:385] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.951581 16652 raft_consensus.cc:740] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.950806 16278 catalog_manager.cc:5697] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.952268 16652 consensus_queue.cc:260] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:24.954618 16652 ts_tablet_manager.cc:1434] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:18:24.956704 16652 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: Bootstrap starting.
I20260709 13:18:24.959586 17033 leader_election.cc:290] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:24.954378 16378 raft_consensus.cc:2468] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:24.964955 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:24.966930 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:24.967496 16606 raft_consensus.cc:2468] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:24.968649 16498 leader_election.cc:304] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:24.970563 16653 tablet_bootstrap.cc:492] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:24.971225 16653 ts_tablet_manager.cc:1403] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.256s	user 0.009s	sys 0.010s
I20260709 13:18:24.970278 17025 raft_consensus.cc:2804] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.973016 17025 raft_consensus.cc:493] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.973361 17025 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.977015 16652 tablet_bootstrap.cc:654] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.979866 16651 tablet_bootstrap.cc:654] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.964823 17036 raft_consensus.cc:515] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
W20260709 13:18:24.981703 16497 leader_election.cc:343] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.983960 17036 leader_election.cc:290] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:24.984920 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
W20260709 13:18:24.999444 16497 leader_election.cc:343] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.001765 16381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:25.007483 16381 raft_consensus.cc:3060] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.023914 16653 raft_consensus.cc:359] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.024909 16653 raft_consensus.cc:385] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.025264 16653 raft_consensus.cc:740] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.026162 16653 consensus_queue.cc:260] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.021256 16381 raft_consensus.cc:2468] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:25.033787 16497 leader_election.cc:304] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:25.036517 17027 raft_consensus.cc:2804] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.027309 16691 raft_consensus.cc:493] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.030711 16605 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 3.
I20260709 13:18:25.042188 16653 ts_tablet_manager.cc:1434] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:18:25.037017 17027 raft_consensus.cc:697] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:25.023027 17025 raft_consensus.cc:515] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.048709 16652 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: No bootstrap required, opened a new log
I20260709 13:18:25.053545 17025 leader_election.cc:290] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
W20260709 13:18:25.056507 16497 consensus_peers.cc:597] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:25.057624 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:25.058223 16456 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.058388 16783 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.058954 16783 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.059871 16651 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:25.060775 16651 ts_tablet_manager.cc:1403] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.006s
I20260709 13:18:25.060922 16783 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:25.063683 16652 ts_tablet_manager.cc:1403] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.018s
I20260709 13:18:25.066666 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:25.066766 16652 raft_consensus.cc:359] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.067401 16606 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.067505 16652 raft_consensus.cc:385] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.067845 16652 raft_consensus.cc:740] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.068212 16456 raft_consensus.cc:2468] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:25.068547 16652 consensus_queue.cc:260] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.073307 16651 raft_consensus.cc:359] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.074568 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:25.074016 16651 raft_consensus.cc:385] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:25.076121 16348 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.076434 16651 raft_consensus.cc:740] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.073982 16653 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:25.039836 16691 raft_consensus.cc:515] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.078104 16497 leader_election.cc:304] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:25.076866 17027 consensus_queue.cc:237] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.080950 16691 leader_election.cc:290] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:25.077456 16651 consensus_queue.cc:260] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.082893 16651 ts_tablet_manager.cc:1434] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:18:25.084022 16606 raft_consensus.cc:2468] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:25.085711 16651 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:25.086135 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.086733 16599 raft_consensus.cc:2468] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:25.087992 16349 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:25.088636 16783 raft_consensus.cc:2804] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.088948 16783 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.089226 16783 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.091926 16652 ts_tablet_manager.cc:1434] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:18:25.105157 16783 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.110786 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.111408 16599 raft_consensus.cc:2468] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:25.072757 16723 consensus_queue.cc:1048] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:18:25.096221 17033 consensus_queue.cc:1048] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:18:25.115525 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:25.096074 17025 raft_consensus.cc:2804] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.116674 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:25.111791 16783 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:25.120319 16651 tablet_bootstrap.cc:654] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.102121 16605 raft_consensus.cc:1240] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Rejecting Update request from peer 1135cc63751942c48da76d29e573b5b8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:25.122080 17036 raft_consensus.cc:493] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.122431 16653 tablet_bootstrap.cc:654] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.117039 17025 raft_consensus.cc:697] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:25.124701 16783 consensus_queue.cc:1059] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:25.121389 16348 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.122579 17036 raft_consensus.cc:515] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.103694 16424 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:25.127406 17061 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:25.128053 17061 raft_consensus.cc:697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:25.128137 17036 leader_election.cc:290] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:25.128407 17025 consensus_queue.cc:237] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.128882 17061 consensus_queue.cc:237] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.130553 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:25.132362 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
W20260709 13:18:25.132946 16497 leader_election.cc:343] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.133165 16599 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.133751 16498 leader_election.cc:304] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:25.136418 16723 raft_consensus.cc:3055] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:25.136829 16723 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:25.147408 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.148058 16601 raft_consensus.cc:2468] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 0.
I20260709 13:18:25.154058 16498 leader_election.cc:304] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:25.155120 16691 raft_consensus.cc:2804] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.156219 16691 raft_consensus.cc:493] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.156646 16691 raft_consensus.cc:3060] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:25.160498 16497 leader_election.cc:343] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.142529 17036 raft_consensus.cc:2804] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.172128 16783 consensus_queue.cc:1048] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.178249 16691 raft_consensus.cc:515] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.180131 16691 leader_election.cc:290] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:25.181795 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:25.165921 17036 raft_consensus.cc:493] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.185560 16497 leader_election.cc:343] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.185817 17036 raft_consensus.cc:3060] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.193100 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:25.194022 16601 raft_consensus.cc:3060] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.164009 16723 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.202569 16723 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:25.204097 16280 catalog_manager.cc:5697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 2 to 3, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 3 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.206032 16599 raft_consensus.cc:2468] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:25.209590 16349 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:25.210544 16783 raft_consensus.cc:2804] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.210961 16783 raft_consensus.cc:697] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:25.213304 16278 catalog_manager.cc:5697] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.211666 16783 consensus_queue.cc:237] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.267218 16729 consensus_queue.cc:1048] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.260111 17036 raft_consensus.cc:515] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.288833 16601 raft_consensus.cc:2468] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:25.289678 16651 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:25.290230 16651 ts_tablet_manager.cc:1403] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.205s	user 0.020s	sys 0.014s
I20260709 13:18:25.301188 16653 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:25.301748 16653 ts_tablet_manager.cc:1403] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.228s	user 0.010s	sys 0.004s
I20260709 13:18:25.302485 16498 leader_election.cc:304] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:25.309963 17033 raft_consensus.cc:2804] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.310765 17036 leader_election.cc:290] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:25.312176 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:25.311797 16280 catalog_manager.cc:5697] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:25.313977 16497 leader_election.cc:343] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:25.318387 17033 raft_consensus.cc:697] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:25.319262 17033 consensus_queue.cc:237] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.322315 16723 raft_consensus.cc:493] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.323805 16653 raft_consensus.cc:359] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.322778 16723 raft_consensus.cc:515] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.324643 16653 raft_consensus.cc:385] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.326094 16723 leader_election.cc:290] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:25.324923 16653 raft_consensus.cc:740] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.327145 16653 consensus_queue.cc:260] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.329676 16651 raft_consensus.cc:359] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.330298 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.334353 16653 ts_tablet_manager.cc:1434] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:18:25.335263 16653 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:25.330339 16651 raft_consensus.cc:385] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.339991 16651 raft_consensus.cc:740] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.341727 16651 consensus_queue.cc:260] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.353163 16651 ts_tablet_manager.cc:1434] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260709 13:18:25.354746 16651 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:25.366945 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:25.367575 16601 raft_consensus.cc:3060] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.373943 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:25.370471 16279 catalog_manager.cc:5697] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.380254 16651 tablet_bootstrap.cc:654] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.382158 16280 catalog_manager.cc:5697] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.388087 16601 raft_consensus.cc:2468] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:25.398375 16348 leader_election.cc:304] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:25.398496 16498 leader_election.cc:304] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:25.404649 17048 raft_consensus.cc:2749] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:25.404052 17033 raft_consensus.cc:2804] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.413151 16882 consensus_queue.cc:1048] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.424965 17067 consensus_queue.cc:1048] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.427215 16653 tablet_bootstrap.cc:654] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.422235 17033 raft_consensus.cc:697] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:25.433535 17033 consensus_queue.cc:237] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.460062 17067 consensus_queue.cc:1048] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.462459 16381 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.473735 16651 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:25.474171 16651 ts_tablet_manager.cc:1403] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.010s
I20260709 13:18:25.486403 16278 catalog_manager.cc:5697] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.498160 16651 raft_consensus.cc:359] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.504498 16651 raft_consensus.cc:385] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.504863 16651 raft_consensus.cc:740] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.525651 16651 consensus_queue.cc:260] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.534691 16653 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:25.535205 16653 ts_tablet_manager.cc:1403] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.200s	user 0.041s	sys 0.044s
I20260709 13:18:25.538669 16653 raft_consensus.cc:359] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.539474 16653 raft_consensus.cc:385] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.541193 16653 raft_consensus.cc:740] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.541808 16653 consensus_queue.cc:260] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.543423 16653 ts_tablet_manager.cc:1434] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:25.544727 16653 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:25.549199 16651 ts_tablet_manager.cc:1434] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 13:18:25.550177 16653 tablet_bootstrap.cc:654] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.550232 16651 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:25.567878 16651 tablet_bootstrap.cc:654] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.571509 17036 consensus_queue.cc:1048] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.569819 16937 raft_consensus.cc:493] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.573580 16937 raft_consensus.cc:515] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.575362 16937 leader_election.cc:290] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:25.576960 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:25.578087 16653 tablet_bootstrap.cc:492] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:25.578596 16653 ts_tablet_manager.cc:1403] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.004s
I20260709 13:18:25.580163 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d0fd0cc28d7407a94234bdc87b0d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:25.580915 16378 raft_consensus.cc:2393] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:25.581297 16653 raft_consensus.cc:359] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.582019 16653 raft_consensus.cc:385] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.582330 16653 raft_consensus.cc:740] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.585386 16423 leader_election.cc:304] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:25.585750 16653 consensus_queue.cc:260] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.586796 17067 raft_consensus.cc:3060] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.588781 16378 raft_consensus.cc:1275] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:25.589134 16378 pending_rounds.cc:85] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Aborting all ops after (but not including) 1
I20260709 13:18:25.595728 16378 pending_rounds.cc:107] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:25.596019 16378 raft_consensus.cc:2889] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.595852 17067 raft_consensus.cc:2749] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:25.598307 17067 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.601814 16653 ts_tablet_manager.cc:1434] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:18:25.603269 16653 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:25.609505 16653 tablet_bootstrap.cc:654] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.622148 17036 consensus_queue.cc:1048] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.625126 16882 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.626551 16651 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: No bootstrap required, opened a new log
I20260709 13:18:25.627077 16651 ts_tablet_manager.cc:1403] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.006s
I20260709 13:18:25.630225 16651 raft_consensus.cc:359] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.630836 16651 raft_consensus.cc:385] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.631084 16651 raft_consensus.cc:740] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.631796 16651 consensus_queue.cc:260] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.625847 16882 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.634052 16651 ts_tablet_manager.cc:1434] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:25.642576 16882 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:25.648279 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:25.649066 16529 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:25.655616 16653 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:25.660652 16653 ts_tablet_manager.cc:1403] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.005s
I20260709 13:18:25.663784 16653 raft_consensus.cc:359] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.658051 17033 consensus_queue.cc:1048] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.668926 16653 raft_consensus.cc:385] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.669279 16653 raft_consensus.cc:740] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.667073 16605 raft_consensus.cc:1275] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:25.670157 16653 consensus_queue.cc:260] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.655965 16348 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:25.667302 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:25.672945 16457 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:25.673748 17048 raft_consensus.cc:2804] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.674325 17048 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.672593 16653 ts_tablet_manager.cc:1434] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:18:25.674896 17048 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.675652 16653 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Bootstrap starting.
I20260709 13:18:25.686200 17096 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:25.690423 17098 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.690821 17098 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.692649 17098 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:25.696201 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.697005 16606 raft_consensus.cc:2393] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:25.698835 16653 tablet_bootstrap.cc:654] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.706847 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:25.708479 17048 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.710767 17048 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:25.712006 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:25.712736 16457 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.713222 17098 raft_consensus.cc:493] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.713721 17098 raft_consensus.cc:515] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:25.715619 17098 leader_election.cc:290] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:25.717552 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.718441 16606 raft_consensus.cc:2393] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:25.724884 17036 consensus_queue.cc:1048] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.738265 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:25.738941 16527 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.759042 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91bf6c338842e8b2042525dff782ec" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:25.760702 16457 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:25.783703 16882 raft_consensus.cc:493] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.784413 16882 raft_consensus.cc:515] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:25.787056 16882 leader_election.cc:290] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:25.789984 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.790802 16601 raft_consensus.cc:2393] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:25.791628 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628e387b7d7546b2a4c4f4e476304b97" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:25.793639 16348 leader_election.cc:304] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:25.794591 17048 raft_consensus.cc:3060] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.798763 16882 consensus_queue.cc:1048] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.763374 16423 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:25.806208 17098 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.808113 17048 raft_consensus.cc:2749] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:25.813608 16423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44563, user_credentials={real_user=slave}} blocked reactor thread for 50342.9us
I20260709 13:18:25.813087 17098 raft_consensus.cc:2749] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:25.814005 17027 consensus_queue.cc:1048] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.747862 16527 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 1.
I20260709 13:18:25.816581 16348 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:25.821512 16930 raft_consensus.cc:2804] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.822065 16930 raft_consensus.cc:697] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:25.822956 16930 consensus_queue.cc:237] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:25.834559 16423 leader_election.cc:304] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:25.840634 17098 raft_consensus.cc:3060] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.856698 17098 raft_consensus.cc:2749] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:25.859001 17048 consensus_queue.cc:1048] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:25.886596 17101 log.cc:927] Time spent T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:25.905144 16653 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: No bootstrap required, opened a new log
I20260709 13:18:25.905851 16653 ts_tablet_manager.cc:1403] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent bootstrapping tablet: real 0.230s	user 0.046s	sys 0.087s
I20260709 13:18:25.909159 16653 raft_consensus.cc:359] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.914139 16653 raft_consensus.cc:385] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.914481 16653 raft_consensus.cc:740] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.920141 16653 consensus_queue.cc:260] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.922382 16653 ts_tablet_manager.cc:1434] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:18:25.947345 17025 consensus_queue.cc:1048] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:25.960254 16938 raft_consensus.cc:493] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.960780 16938 raft_consensus.cc:515] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.968463 17048 raft_consensus.cc:493] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.968775 16378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:25.969156 17048 raft_consensus.cc:515] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:25.970903 16378 raft_consensus.cc:2468] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:25.971865 17048 leader_election.cc:290] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:25.975207 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:25.977790 16606 raft_consensus.cc:2468] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 0.
I20260709 13:18:25.962823 16938 leader_election.cc:290] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
W20260709 13:18:26.056648 16329 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:26.078028 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:26.079764 16455 raft_consensus.cc:2468] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:26.088977 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:26.090174 16599 raft_consensus.cc:2468] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 0.
I20260709 13:18:26.118923 16348 leader_election.cc:304] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:26.120018 16424 leader_election.cc:304] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:26.122128 16723 raft_consensus.cc:2804] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:26.122689 16723 raft_consensus.cc:493] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.123103 16723 raft_consensus.cc:3060] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:26.130131 17067 raft_consensus.cc:2804] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:26.130877 17067 raft_consensus.cc:493] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.131335 17067 raft_consensus.cc:3060] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:26.134964 16424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.68:45619, user_credentials={real_user=slave}} blocked reactor thread for 77959us
W20260709 13:18:26.175453 16348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 53993.1us
I20260709 13:18:26.214952 17076 consensus_queue.cc:1048] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:26.230494 16783 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:26.236989 17067 raft_consensus.cc:515] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:26.249701 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:26.250430 16605 raft_consensus.cc:3060] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:26.272683 17036 consensus_queue.cc:1048] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:26.273814 16279 catalog_manager.cc:5697] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.282274 16723 raft_consensus.cc:515] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:26.297197 16723 leader_election.cc:290] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:26.297699 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:26.300657 17067 leader_election.cc:290] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:26.306694 16380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:26.310950 16380 raft_consensus.cc:2393] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 1: Already voted for candidate 1135cc63751942c48da76d29e573b5b8 in this term.
I20260709 13:18:26.320546 16605 raft_consensus.cc:2468] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:26.329511 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1f497bdffb4230b18aaec54cb04de0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:26.330307 16457 raft_consensus.cc:2393] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1135cc63751942c48da76d29e573b5b8 in current term 1: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:26.346958 16424 leader_election.cc:304] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:26.351292 17067 raft_consensus.cc:2804] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:26.352046 17067 raft_consensus.cc:697] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:26.353353 17067 consensus_queue.cc:237] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:26.345919 16348 leader_election.cc:304] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:26.375512 16723 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:26.375528 16783 raft_consensus.cc:2749] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:26.498100 16281 catalog_manager.cc:5697] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 1 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.825542 17116 consensus_queue.cc:1048] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:26.848609 17129 consensus_queue.cc:1048] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:27.025384  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
W20260709 13:18:27.034924 16497 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:18:27.040941 16497 consensus_peers.cc:597] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.043120 16497 consensus_peers.cc:597] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.084383  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:27.085533  9489 tablet_replica.cc:333] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.086660  9489 raft_consensus.cc:2243] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.087298  9489 raft_consensus.cc:2272] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.090013  9489 tablet_replica.cc:333] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.090682  9489 raft_consensus.cc:2243] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.091090  9489 raft_consensus.cc:2272] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.094000  9489 tablet_replica.cc:333] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.094830  9489 raft_consensus.cc:2243] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.095842  9489 raft_consensus.cc:2272] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.098979  9489 tablet_replica.cc:333] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
W20260709 13:18:27.099637 16497 consensus_peers.cc:597] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.099799  9489 raft_consensus.cc:2243] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.100798  9489 raft_consensus.cc:2272] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.103899  9489 tablet_replica.cc:333] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.104780  9489 raft_consensus.cc:2243] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.105301  9489 raft_consensus.cc:2272] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.108434  9489 tablet_replica.cc:333] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.109521  9489 raft_consensus.cc:2243] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.110206  9489 raft_consensus.cc:2272] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.108397 16497 consensus_peers.cc:597] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.114002  9489 tablet_replica.cc:333] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.115304  9489 raft_consensus.cc:2243] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.116348  9489 raft_consensus.cc:2272] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.116902 16497 consensus_peers.cc:597] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.119340  9489 tablet_replica.cc:333] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.120366  9489 raft_consensus.cc:2243] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.120877  9489 raft_consensus.cc:2272] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.123796  9489 tablet_replica.cc:333] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.124660  9489 raft_consensus.cc:2243] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.125270  9489 raft_consensus.cc:2272] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.128176  9489 tablet_replica.cc:333] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.128918  9489 raft_consensus.cc:2243] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.129551  9489 raft_consensus.cc:2272] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.131896  9489 tablet_replica.cc:333] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.132529  9489 raft_consensus.cc:2243] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.133297  9489 raft_consensus.cc:2272] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.136299  9489 tablet_replica.cc:333] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.137254  9489 raft_consensus.cc:2243] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.137845  9489 raft_consensus.cc:2272] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.140285  9489 tablet_replica.cc:333] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.140930  9489 raft_consensus.cc:2243] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.142030  9489 raft_consensus.cc:2272] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.144227  9489 tablet_replica.cc:333] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.144806  9489 raft_consensus.cc:2243] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.145648  9489 raft_consensus.cc:2272] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.147624  9489 tablet_replica.cc:333] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.148186  9489 raft_consensus.cc:2243] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.148595  9489 raft_consensus.cc:2272] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.151391  9489 tablet_replica.cc:333] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.152359  9489 raft_consensus.cc:2243] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.152843  9489 raft_consensus.cc:2272] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.155821  9489 tablet_replica.cc:333] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.156494  9489 raft_consensus.cc:2243] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.157675  9489 raft_consensus.cc:2272] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.159777 16423 consensus_peers.cc:597] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.160578  9489 tablet_replica.cc:333] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.161381  9489 raft_consensus.cc:2243] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.161875  9489 raft_consensus.cc:2272] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.163115 16423 consensus_peers.cc:597] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.164181  9489 tablet_replica.cc:333] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.164762  9489 raft_consensus.cc:2243] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.165180  9489 raft_consensus.cc:2272] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.167155  9489 tablet_replica.cc:333] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.167692  9489 raft_consensus.cc:2243] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.168618  9489 raft_consensus.cc:2272] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.171183  9489 tablet_replica.cc:333] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.171963  9489 raft_consensus.cc:2243] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.172498  9489 raft_consensus.cc:2272] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.174284 16423 consensus_peers.cc:597] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.175398  9489 tablet_replica.cc:333] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.176002  9489 raft_consensus.cc:2243] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.176462  9489 raft_consensus.cc:2272] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.178683  9489 tablet_replica.cc:333] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.179198  9489 raft_consensus.cc:2243] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.179870  9489 raft_consensus.cc:2272] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.181883  9489 tablet_replica.cc:333] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.182343  9489 raft_consensus.cc:2243] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.183076  9489 raft_consensus.cc:2272] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.184985  9489 tablet_replica.cc:333] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.185559  9489 raft_consensus.cc:2243] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.185961  9489 raft_consensus.cc:2272] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.188228  9489 tablet_replica.cc:333] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.188725  9489 raft_consensus.cc:2243] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.189095  9489 raft_consensus.cc:2272] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.190891  9489 tablet_replica.cc:333] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.191332  9489 raft_consensus.cc:2243] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.191694  9489 raft_consensus.cc:2272] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.193639  9489 tablet_replica.cc:333] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.194164  9489 raft_consensus.cc:2243] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.194988  9489 raft_consensus.cc:2272] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.197110  9489 tablet_replica.cc:333] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.197736  9489 raft_consensus.cc:2243] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.198282  9489 raft_consensus.cc:2272] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.200572  9489 tablet_replica.cc:333] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.201037  9489 raft_consensus.cc:2243] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.201571  9489 raft_consensus.cc:2272] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.203995  9489 tablet_replica.cc:333] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
W20260709 13:18:27.204025 16423 consensus_peers.cc:597] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.204710  9489 raft_consensus.cc:2243] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.205608  9489 raft_consensus.cc:2272] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.208279  9489 tablet_replica.cc:333] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.208858  9489 raft_consensus.cc:2243] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.209400  9489 raft_consensus.cc:2272] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.212050  9489 tablet_replica.cc:333] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.212752  9489 raft_consensus.cc:2243] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.213296  9489 raft_consensus.cc:2272] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.215770  9489 tablet_replica.cc:333] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.216437  9489 raft_consensus.cc:2243] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.217000  9489 raft_consensus.cc:2272] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.219939  9489 tablet_replica.cc:333] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.220719  9489 raft_consensus.cc:2243] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.221278  9489 raft_consensus.cc:2272] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.223974  9489 tablet_replica.cc:333] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.224611  9489 raft_consensus.cc:2243] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.225385  9489 raft_consensus.cc:2272] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.227386  9489 tablet_replica.cc:333] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.227917  9489 raft_consensus.cc:2243] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.228693  9489 raft_consensus.cc:2272] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.231448  9489 tablet_replica.cc:333] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.232172  9489 raft_consensus.cc:2243] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.233194  9489 raft_consensus.cc:2272] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.236406  9489 tablet_replica.cc:333] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.237118  9489 raft_consensus.cc:2243] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.237825  9489 raft_consensus.cc:2272] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.241230  9489 tablet_replica.cc:333] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.242110  9489 raft_consensus.cc:2243] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.243353  9489 raft_consensus.cc:2272] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.246433  9489 tablet_replica.cc:333] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.247159  9489 raft_consensus.cc:2243] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.248320  9489 raft_consensus.cc:2272] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.251888  9489 tablet_replica.cc:333] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.252696  9489 raft_consensus.cc:2243] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:27.253736  9489 raft_consensus.cc:2272] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.255234 16571 consensus_peers.cc:597] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.256464  9489 tablet_replica.cc:333] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.257300  9489 raft_consensus.cc:2243] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.257879  9489 raft_consensus.cc:2272] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.260844  9489 tablet_replica.cc:333] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.261492  9489 raft_consensus.cc:2243] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:27.262099 16423 consensus_peers.cc:597] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.262465  9489 raft_consensus.cc:2272] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:27.265276  9489 tablet_replica.cc:333] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: stopping tablet replica
I20260709 13:18:27.265965  9489 raft_consensus.cc:2243] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:27.266511  9489 raft_consensus.cc:2272] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:27.266844 16571 consensus_peers.cc:597] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.267802 16571 consensus_peers.cc:597] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.284650 16497 consensus_peers.cc:597] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.285284 16497 consensus_peers.cc:597] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.302699 16423 consensus_peers.cc:597] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.304519 16423 consensus_peers.cc:597] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.357173  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
W20260709 13:18:27.373790 16571 consensus_peers.cc:597] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.407191 16423 consensus_peers.cc:597] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.434639 16497 consensus_peers.cc:597] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.441200 16571 consensus_peers.cc:597] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.447485  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:27.455262 17139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:27.455678 17140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:27.462037 17142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:27.465883 16571 consensus_peers.cc:597] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.473214  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:27.477032  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:27.477306  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:27.477548  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603107477529 us; error 0 us; skew 500 ppm
I20260709 13:18:27.478333  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:27.489993  9489 webserver.cc:533] Webserver started at http://127.9.68.65:45075/ using document root <none> and password file <none>
I20260709 13:18:27.490649  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:27.490851  9489 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:27.495306  9489 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:18:27.505857 17148 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:27.506675  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:18:27.507031  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "1135cc63751942c48da76d29e573b5b8"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-9s6w"
I20260709 13:18:27.507475  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:18:27.537031 16497 consensus_peers.cc:597] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.538522  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:27.539938  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:27.541711  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:27.547642 17155 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:18:27.554430 16571 consensus_peers.cc:597] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.597460 16423 consensus_peers.cc:597] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.598111 16497 consensus_peers.cc:597] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:27.618907 16497 consensus_peers.cc:597] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.796221  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:18:27.796559  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.251s	user 0.011s	sys 0.001s
I20260709 13:18:27.796875  9489 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:18:27.805414 17155 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.826850 17155 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.828038 17155 tablet_bootstrap.cc:492] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.828796 17155 ts_tablet_manager.cc:1403] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:18:27.831777 17155 raft_consensus.cc:359] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.832628 17155 raft_consensus.cc:740] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.833334 17155 consensus_queue.cc:260] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.836005 17155 ts_tablet_manager.cc:1434] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:27.836776 17155 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.851078 17155 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.851933 17155 tablet_bootstrap.cc:492] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.852510 17155 ts_tablet_manager.cc:1403] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:18:27.854832 17155 raft_consensus.cc:359] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:27.855491 17155 raft_consensus.cc:740] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.856138 17155 consensus_queue.cc:260] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:27.857887 17155 ts_tablet_manager.cc:1434] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:18:27.858597 17155 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.873219 17155 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.874166 17155 tablet_bootstrap.cc:492] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.874809 17155 ts_tablet_manager.cc:1403] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:18:27.877142 17155 raft_consensus.cc:359] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:27.877826 17155 raft_consensus.cc:740] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.878575 17155 consensus_queue.cc:260] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:27.880278 17155 ts_tablet_manager.cc:1434] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:18:27.881006 17155 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.895303 17155 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.896132 17155 tablet_bootstrap.cc:492] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.896704 17155 ts_tablet_manager.cc:1403] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:18:27.898876 17155 raft_consensus.cc:359] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:27.899492 17155 raft_consensus.cc:740] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.900126 17155 consensus_queue.cc:260] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:27.901952 17155 ts_tablet_manager.cc:1434] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:27.902664 17155 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.916144 17155 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.916963 17155 tablet_bootstrap.cc:492] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.917550 17155 ts_tablet_manager.cc:1403] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 13:18:27.919708 17155 raft_consensus.cc:359] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.920305 17155 raft_consensus.cc:740] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.920921 17155 consensus_queue.cc:260] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.922705 17155 ts_tablet_manager.cc:1434] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:18:27.923388 17155 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.938189 17155 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.939031 17155 tablet_bootstrap.cc:492] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.939606 17155 ts_tablet_manager.cc:1403] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:18:27.941790 17155 raft_consensus.cc:359] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.942389 17155 raft_consensus.cc:740] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.942998 17155 consensus_queue.cc:260] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:27.944765 17155 ts_tablet_manager.cc:1434] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:27.945497 17155 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.969902 17155 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.971132 17155 tablet_bootstrap.cc:492] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.971710 17155 ts_tablet_manager.cc:1403] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:18:27.974939 17155 raft_consensus.cc:359] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:27.975557 17155 raft_consensus.cc:740] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:27.976205 17155 consensus_queue.cc:260] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:27.978076 17155 ts_tablet_manager.cc:1434] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:27.978782 17155 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:27.997696 17155 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.998647 17155 tablet_bootstrap.cc:492] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:27.999445 17155 ts_tablet_manager.cc:1403] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:18:28.001945 17155 raft_consensus.cc:359] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.002589 17155 raft_consensus.cc:740] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.003198 17155 consensus_queue.cc:260] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.005206 17155 ts_tablet_manager.cc:1434] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:28.005811 17155 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.023864 17155 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.024739 17155 tablet_bootstrap.cc:492] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.025576 17155 ts_tablet_manager.cc:1403] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:18:28.028167 17155 raft_consensus.cc:359] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.028781 17155 raft_consensus.cc:740] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.029651 17155 consensus_queue.cc:260] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.033061 17155 ts_tablet_manager.cc:1434] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:28.033800 17155 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.046281 17155 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.046984 17155 tablet_bootstrap.cc:492] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.047465 17155 ts_tablet_manager.cc:1403] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:18:28.049296 17155 raft_consensus.cc:359] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.049861 17155 raft_consensus.cc:740] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.050375 17155 consensus_queue.cc:260] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.051661 17155 ts_tablet_manager.cc:1434] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:18:28.052219 17155 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.054335  9489 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:18:28.054613  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.258s	user 0.233s	sys 0.005s
I20260709 13:18:28.066133 17155 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.066824 17155 tablet_bootstrap.cc:492] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.067310 17155 ts_tablet_manager.cc:1403] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:18:28.069506 17155 raft_consensus.cc:359] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.070132 17155 raft_consensus.cc:740] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.070927 17155 consensus_queue.cc:260] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.072938 17155 ts_tablet_manager.cc:1434] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:28.073611 17155 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.104811 17155 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.105924 17155 tablet_bootstrap.cc:492] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.106638 17155 ts_tablet_manager.cc:1403] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.003s
I20260709 13:18:28.109721 17155 raft_consensus.cc:359] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.110524 17155 raft_consensus.cc:740] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.111433 17155 consensus_queue.cc:260] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.113850 17155 ts_tablet_manager.cc:1434] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:28.114719 17155 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.132200 17155 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.132905 17155 tablet_bootstrap.cc:492] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.133435 17155 ts_tablet_manager.cc:1403] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:18:28.135514 17155 raft_consensus.cc:359] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.136083 17155 raft_consensus.cc:740] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.136830 17155 consensus_queue.cc:260] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.138994 17155 ts_tablet_manager.cc:1434] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:28.139806 17155 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.170921 17155 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.171986 17155 tablet_bootstrap.cc:492] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.172793 17155 ts_tablet_manager.cc:1403] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 13:18:28.176064 17155 raft_consensus.cc:359] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.176923 17155 raft_consensus.cc:740] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.177723 17155 consensus_queue.cc:260] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.180298 17155 ts_tablet_manager.cc:1434] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:28.181262 17155 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.188109 17129 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.188598 17129 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.190863 17129 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.194733 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.196930 17135 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.198169 17135 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.198969 17124 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.199470 17124 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.200371 17135 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.201007 17135 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.201656 17124 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.201447 17135 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.205148 17231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:44563 every 8 connection(s)
I20260709 13:18:28.205866 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.206537 16527 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.210901 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.211477 16457 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.212347  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:44563
I20260709 13:18:28.222978 17124 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.223678 17124 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.225497 17155 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.225801 17124 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.226428 17155 tablet_bootstrap.cc:492] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.228080 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.228791 17155 ts_tablet_manager.cc:1403] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.048s	user 0.031s	sys 0.012s
I20260709 13:18:28.232084 17112 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.232586 17112 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.233044 17155 raft_consensus.cc:359] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.235574 17155 raft_consensus.cc:740] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.236521 17155 consensus_queue.cc:260] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.238772 17155 ts_tablet_manager.cc:1434] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:18:28.237877 17112 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.239547 17155 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.244725 17156 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.245253 17156 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.247269 17156 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.248762 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.249459 17124 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.249951 17124 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.251886 17124 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.253629 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.257972 17135 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.259235 17155 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.260182 17155 tablet_bootstrap.cc:492] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
W20260709 13:18:28.260639 16423 leader_election.cc:336] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111)
I20260709 13:18:28.260816 17155 ts_tablet_manager.cc:1403] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:18:28.261101 16423 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.263015 16497 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.263113 17129 raft_consensus.cc:2749] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.263746 17155 raft_consensus.cc:359] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.264513 17155 raft_consensus.cc:740] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.264606 17124 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.265390 17230 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.267951 17124 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.268468 17124 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.268237 17230 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.271169 17230 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.272617 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.265337 17155 consensus_queue.cc:260] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.266834 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.267127 16423 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.280066 17129 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.280483 17129 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.276754 17124 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.280843 17129 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.284089 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.290169 17067 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.290951 17067 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.294476 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.296557 17067 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.295320 16605 raft_consensus.cc:2468] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.301658 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:28.301959 16424 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.303258 17230 raft_consensus.cc:2804] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.303897 17230 raft_consensus.cc:493] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.304354 17230 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.305426 17124 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.308553 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.309458 17203 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.311159 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.312135 17124 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.312808 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.298887 17155 ts_tablet_manager.cc:1434] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:18:28.316861 17124 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.317672 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.318601 17202 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.317344 17155 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.330193 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.330870 17202 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.331738 17166 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.332341 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.332255 17166 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.332944 17124 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.320566 17230 raft_consensus.cc:515] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.315444 17129 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.337356 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.338482 16457 raft_consensus.cc:2393] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
W20260709 13:18:28.341105 16497 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.341521 17129 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.342058 16497 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.342500 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:28.342926 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.343031 16605 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.343720 16497 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.344830 17144 raft_consensus.cc:2804] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.345176 17144 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.345553 17144 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.346524 16571 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.347164 17112 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.347478 17111 raft_consensus.cc:2804] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:28.347683 16571 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.347913 17111 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.348165 16571 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.347847 17112 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.348587 17111 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.350009 17166 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.351023 17164 raft_consensus.cc:2804] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.351410 17164 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.351749 17164 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.354300 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.354331 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.352063 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:28.356567 17027 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.357415 16527 raft_consensus.cc:2393] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:28.357290 17027 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
W20260709 13:18:28.359498 16423 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.359535 17027 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.361370 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:28.362589 16497 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.362766 17112 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
W20260709 13:18:28.363222 16497 leader_election.cc:343] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.363732 17135 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.364246 17135 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.364598 16497 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.364892 17199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.366519 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.367199 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.363107 17201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:28.368054 16423 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.368343 17201 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.368515 16423 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.371954 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.370893 16605 raft_consensus.cc:2468] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:28.377135 17067 raft_consensus.cc:2749] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:28.389482 16423 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.390077 17156 raft_consensus.cc:2749] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.390389 17067 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
W20260709 13:18:28.390859 16423 leader_election.cc:343] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.391444 16423 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:28.392794 16423 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:28.372220 17233 heartbeater.cc:344] Connected to a master server at 127.9.68.126:35691
I20260709 13:18:28.384490 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.394471 17203 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.394582 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cabb8db6421b49da935435b9f4dd7afa" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.395437 17233 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:28.372416 17027 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.395840 17129 raft_consensus.cc:2749] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.390903 17067 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.396090 17027 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.396467 17233 heartbeater.cc:507] Master 127.9.68.126:35691 requested a full tablet report, sending...
I20260709 13:18:28.385478 17111 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
W20260709 13:18:28.403563 16571 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.405545 16571 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:28.382447 17230 leader_election.cc:290] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.371464 17135 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.385310 17124 raft_consensus.cc:2749] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.407446 16423 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:28.408218 17067 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.408355 17144 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.408793 17067 raft_consensus.cc:2804] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.376536 17164 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.409215 17067 raft_consensus.cc:493] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.409638 17067 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.410512 17144 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.410596 17111 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
W20260709 13:18:28.408810 16423 leader_election.cc:343] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:28.411767 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 47232.7us
I20260709 13:18:28.396713 17129 raft_consensus.cc:2804] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.412935 17129 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.413664 16497 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.414904 16601 raft_consensus.cc:2393] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:28.414709 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.413137 17111 raft_consensus.cc:2749] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.415921 17124 raft_consensus.cc:2749] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.424079 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:28.425374 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.426501 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.426931 17135 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
W20260709 13:18:28.427029 16423 leader_election.cc:343] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.427683 17135 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.428609 17124 raft_consensus.cc:493] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.428933 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.429632 16529 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.429293 17124 raft_consensus.cc:515] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.430403 17135 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.431325 16424 leader_election.cc:304] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:28.431442 17111 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.432031 17124 leader_election.cc:290] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.432006 17111 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.433458 16423 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:28.434479 17111 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.415956 17129 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.419345 17144 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.440410 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.441300 16527 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.441625 17244 raft_consensus.cc:2804] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.442025 17244 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.442368 17244 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.442476 16571 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.443248 17111 raft_consensus.cc:2804] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.443617 17111 raft_consensus.cc:493] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.443964 17111 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.446568 17201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.447144 17201 raft_consensus.cc:3060] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:28.448207 16497 leader_election.cc:343] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.448757 16497 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.449645 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.450227 17200 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.450840 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.451661 16454 raft_consensus.cc:2468] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.452775 17111 raft_consensus.cc:515] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.453176 17144 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.453696 17199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.450088 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.455984 17144 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.458422 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.462050 16601 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.464633 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:28.466822 16571 leader_election.cc:343] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.457257 17144 raft_consensus.cc:2749] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.470659 16497 leader_election.cc:304] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.470657 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:28.467664 17166 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.468899 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.474045 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:28.480374 16529 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.481858 17067 raft_consensus.cc:515] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.483315 17199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.484123 17199 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.485904 16457 raft_consensus.cc:2393] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:28.478157 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.487049 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.487419 16454 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.488006 16601 raft_consensus.cc:2393] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 2: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:28.485692 17067 leader_election.cc:290] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.496896 16571 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.497679 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:28.499230 17112 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.499734 17112 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.500146 17112 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.500635 17243 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.501132 17243 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.503257 17243 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.500223 17027 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
W20260709 13:18:28.506091 16571 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.509863 17111 leader_election.cc:290] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.512239 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
W20260709 13:18:28.514302 16571 leader_election.cc:343] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.501236 17144 raft_consensus.cc:2804] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.518106 17144 raft_consensus.cc:493] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.518527 17144 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.514881 17129 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.478515 17166 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.515915 17201 raft_consensus.cc:2468] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 2.
I20260709 13:18:28.488646 17200 raft_consensus.cc:2468] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.528646 16601 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.528715 16424 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
W20260709 13:18:28.532246 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 61633.4us
W20260709 13:18:28.532831 16497 leader_election.cc:343] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.517282 17244 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.533668 16497 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.533720 17067 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.535519 17067 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.536101 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.537788 17244 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.538164 17200 raft_consensus.cc:2393] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:28.538499 17166 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.539537 17067 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.539654 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.540412 16527 raft_consensus.cc:2393] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 2: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
W20260709 13:18:28.536684 16423 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.536818 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.543612 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.545894 16571 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.546226 17155 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.543969 17144 raft_consensus.cc:515] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.547389 16601 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.548766 17249 raft_consensus.cc:2804] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.549170 17249 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.549556 17249 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.549755 17201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.550824 16529 raft_consensus.cc:2468] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 2.
I20260709 13:18:28.551494 17166 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.554929 17241 raft_consensus.cc:2804] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.555683 17166 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.556536 17249 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.557875 17166 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.553040 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8890c126d72a49d0a58319b296abe490" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:28.558130 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.558704 17249 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.559371 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a58fe97303471a81a4511d2bdc4933" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.552098 17111 raft_consensus.cc:493] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.558796 16605 raft_consensus.cc:2393] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:28.560746 17111 raft_consensus.cc:515] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.561412 17164 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.555841 17241 raft_consensus.cc:697] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:28.545521 17027 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.548377 16497 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.564754 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.555063 17129 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.561591 17200 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.565361 16457 raft_consensus.cc:2468] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.567369 17155 tablet_bootstrap.cc:492] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.568111 17155 ts_tablet_manager.cc:1403] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.251s	user 0.022s	sys 0.019s
I20260709 13:18:28.565260 16423 leader_election.cc:304] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
W20260709 13:18:28.569582 16423 leader_election.cc:343] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:28.570447 16423 leader_election.cc:343] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.570681 17111 leader_election.cc:290] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.571269 17155 raft_consensus.cc:359] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.571993 17155 raft_consensus.cc:740] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.564792 17156 raft_consensus.cc:2804] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.572412 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.572629 17156 raft_consensus.cc:697] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:28.573097 17200 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.572865 17155 consensus_queue.cc:260] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.573592 17156 consensus_queue.cc:237] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.575361 17155 ts_tablet_manager.cc:1434] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:28.576174 17155 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.575858 17241 consensus_queue.cc:237] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.569728 17243 raft_consensus.cc:2749] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.580523 17144 leader_election.cc:290] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.581542 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.582116 16280 ts_manager.cc:194] Re-registered known tserver with Master: 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.590667 16498 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.566277 17027 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.582515 16571 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.599908 16571 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:28.580506 17200 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:28.601929 16278 catalog_manager.cc:5697] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.603058 16423 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:28.603860 17241 raft_consensus.cc:2804] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.604208 17124 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.604315 17241 raft_consensus.cc:697] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:28.604805 17124 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.605425 17241 consensus_queue.cc:237] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.605626 17067 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.606885 17124 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.607632 17067 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.608960 17124 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.594026 17164 raft_consensus.cc:2804] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.609463 17166 raft_consensus.cc:2804] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.612880 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.613778 16605 raft_consensus.cc:2468] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.594695 17246 raft_consensus.cc:2804] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:28.619652 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44563, user_credentials={real_user=slave}} blocked reactor thread for 71319.5us
I20260709 13:18:28.622270 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.623085 16527 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.584586 17251 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.627061 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:28.588775 17250 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.630642 16571 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:28.616390 17111 raft_consensus.cc:2764] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:28.614956 17166 raft_consensus.cc:493] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.618067 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.616641 17027 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.619009 17164 raft_consensus.cc:697] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:28.635809 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:28.636045 16605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:28.636435 17164 consensus_queue.cc:237] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.629557 17243 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.638875 17111 raft_consensus.cc:2804] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.638670 17243 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.615706 17124 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.639391 17111 raft_consensus.cc:697] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:28.632629 17166 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.631843 17246 raft_consensus.cc:697] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:28.634167 16423 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:28.634915 16530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:28.636438 16532 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.642688 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:28.586324 17112 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.644013 16456 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.649971 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7b762eaf2849079198e3c617927974" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.650780 17203 raft_consensus.cc:2393] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 2: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:28.650777 17246 consensus_queue.cc:237] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.652724 17129 raft_consensus.cc:2804] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.653110 17129 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.653497 17129 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.654121 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.655766 17243 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.639856 17251 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.631826 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.665858 16605 raft_consensus.cc:2393] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in this term.
I20260709 13:18:28.640290 17250 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:28.705551 16530 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.625211 17067 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.712041 16456 raft_consensus.cc:2468] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.659708 17111 consensus_queue.cc:237] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
W20260709 13:18:28.714201 16497 leader_election.cc:343] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.718410 16532 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:28.735771 16497 leader_election.cc:304] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.738572 17124 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.738610 17242 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.739459 17242 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.736613 17067 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.742039 17242 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.742244 17067 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.742805 16457 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.753793 17155 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.755914 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.759544 16497 leader_election.cc:304] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
W20260709 13:18:28.760926 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:39149, user_credentials={real_user=slave}} blocked reactor thread for 130358us
I20260709 13:18:28.752344 17144 raft_consensus.cc:2749] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.781028 16457 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.773901 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.784519 16456 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.775949 17164 raft_consensus.cc:2804] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.782238 17155 tablet_bootstrap.cc:492] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:28.794615 17155 ts_tablet_manager.cc:1403] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.219s	user 0.025s	sys 0.016s
I20260709 13:18:28.796424 17155 raft_consensus.cc:359] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.796914 17155 raft_consensus.cc:740] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.797752 17155 consensus_queue.cc:260] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.804883 17155 ts_tablet_manager.cc:1434] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:28.799448 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:28.819618 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 58062.5us
W20260709 13:18:28.828045 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 67558.4us
I20260709 13:18:28.801476 17164 raft_consensus.cc:697] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:28.802026 17112 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.851564 16498 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.807286 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.861562 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:28.862530 16457 raft_consensus.cc:2393] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:28.832223 17200 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.853641 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.865447 17202 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.888777 17266 raft_consensus.cc:2804] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.890875 16530 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:28.891707 17250 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.885564 17129 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.892624 17198 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:28.866145 17199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62aa96fdb9e94536805e98e02a69f564" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.893873 17259 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.907920 17259 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.908802 17251 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:28.909943 17259 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:28.910362 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.911693 17200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.911917 17199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.912182 17196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:28.912495 17200 raft_consensus.cc:2393] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
W20260709 13:18:28.894213 17262 log.cc:927] Time spent T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:28.912844 17196 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
W20260709 13:18:28.895401 16571 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:28.899559 16423 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.915024 16423 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c
I20260709 13:18:28.915192 17203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.915764 17203 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.916347 16423 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:28.899685 17129 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:28.900386 16454 raft_consensus.cc:2393] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:28.883625 17166 raft_consensus.cc:515] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:28.897032 17266 raft_consensus.cc:493] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.900993 17164 consensus_queue.cc:237] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.918725 16601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:28.918937 17155 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:28.920346 16423 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:28.929337 16601 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:28.931423 17244 raft_consensus.cc:2764] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:28.931576 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.932210 16532 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.930255 17266 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.933363 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.934208 17247 raft_consensus.cc:2749] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:28.937621 16456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:28.938220 16456 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 1.
I20260709 13:18:28.943923 17230 raft_consensus.cc:2804] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.944321 17230 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.944675 17230 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.948038 17166 leader_election.cc:290] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
W20260709 13:18:28.949774 16497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 109222us
W20260709 13:18:28.951889 16423 leader_election.cc:343] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.952036 16497 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.954732 16497 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:28.956662 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.961694 16571 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.966099 17270 raft_consensus.cc:2804] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.966490 17270 raft_consensus.cc:493] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
W20260709 13:18:28.960208 16497 leader_election.cc:343] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.968695 17270 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.969098 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532" is_pre_election: true
I20260709 13:18:28.969851 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:28.974742 17202 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.977608 16527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:28.978159 16527 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:28.981021 16423 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:28.958230 17027 raft_consensus.cc:2804] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:28.969369 17255 raft_consensus.cc:2804] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.982904 17027 raft_consensus.cc:493] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:28.983078 17255 raft_consensus.cc:697] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:28.983134 17067 raft_consensus.cc:2804] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:28.984143 17255 consensus_queue.cc:237] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:28.984730 17067 raft_consensus.cc:697] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:28.985641 17067 consensus_queue.cc:237] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
W20260709 13:18:28.991308 16497 leader_election.cc:343] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.992069 16497 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:28.992213 16527 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:28.994717 16571 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:28.989490 17027 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.001600 17271 raft_consensus.cc:2749] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.003373 17266 raft_consensus.cc:515] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.003885 17269 raft_consensus.cc:2804] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.013734 17269 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:29.014271 17269 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.011010 17203 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:28.998272 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:29.018033 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
W20260709 13:18:29.019126 17274 log.cc:927] Time spent T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:29.023900 16423 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:29.026314 17129 raft_consensus.cc:2804] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.027051 17129 raft_consensus.cc:697] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:29.026221 17027 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.028365 16532 raft_consensus.cc:2393] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:29.028128 17129 consensus_queue.cc:237] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.031394 17027 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:29.008069 17230 raft_consensus.cc:515] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.046348 16599 raft_consensus.cc:1275] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.047209 17266 leader_election.cc:290] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:29.047529 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:29.048295 16454 raft_consensus.cc:2393] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b5db6fa2cd44206908172d50ddf3532 in current term 2: Already voted for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in this term.
I20260709 13:18:29.049121 17230 leader_election.cc:290] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:29.050498 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:29.053224 17135 consensus_queue.cc:1048] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:29.054625 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.055528 17269 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.056119 17270 raft_consensus.cc:515] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.055531 17197 raft_consensus.cc:3060] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:29.061168 16497 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.061229 16528 raft_consensus.cc:1275] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.061563 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.064350 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cb00929bfa4e8eb1eb9cbcbfd81575" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
W20260709 13:18:29.045077 16571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:34933, user_credentials={real_user=slave}} blocked reactor thread for 47701.8us
I20260709 13:18:29.064819 17270 leader_election.cc:290] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:29.064476 17197 raft_consensus.cc:2468] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:29.065299 16528 raft_consensus.cc:2393] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21b412f6f5fb4170b45dd85f95c1ce2f in current term 2: Already voted for candidate 6b5db6fa2cd44206908172d50ddf3532 in this term.
I20260709 13:18:29.014278 17155 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.062271 16497 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:29.066289 17230 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.066620 16423 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:29.067483 17027 raft_consensus.cc:2749] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.067622 17155 tablet_bootstrap.cc:492] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.068411 17155 ts_tablet_manager.cc:1403] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.004s
I20260709 13:18:29.069854 16498 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:29.070567 17027 raft_consensus.cc:2804] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:29.070886 17155 raft_consensus.cc:359] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.071642 17155 raft_consensus.cc:740] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.071905 16455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:29.072434 16455 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:29.073588 16571 leader_election.cc:343] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.073488 17135 raft_consensus.cc:2749] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.074153 16571 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:29.073748 16281 catalog_manager.cc:5697] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:29.076951 16571 leader_election.cc:343] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.077598 17240 raft_consensus.cc:2749] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.077734 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb6727c39d3449f9ec4674c95b36423" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.070935 17027 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:29.078984 17027 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.088420 17197 raft_consensus.cc:1275] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.091353 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
W20260709 13:18:29.093505 16423 consensus_peers.cc:597] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.093703 16279 catalog_manager.cc:5697] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 2 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:29.097596 16497 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.093227 16455 raft_consensus.cc:2468] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 2.
I20260709 13:18:29.100467 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112f015baf52408f865d1b5784545dfe" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:29.100998 16532 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.101033 17155 consensus_queue.cc:260] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.103287 17155 ts_tablet_manager.cc:1434] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:18:29.104091 17155 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.105695 16497 leader_election.cc:304] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:29.106806 17027 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.108719 17027 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
W20260709 13:18:29.077847 16571 leader_election.cc:343] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.109665 16532 raft_consensus.cc:2468] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 2.
W20260709 13:18:29.109980 16571 leader_election.cc:343] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.110850 17255 raft_consensus.cc:2804] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.117502 17255 raft_consensus.cc:697] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:29.118681 17269 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:29.118552 17255 consensus_queue.cc:237] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.119786 17202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.123246 17240 consensus_queue.cc:1048] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:29.125677 16571 leader_election.cc:343] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.129777 17197 raft_consensus.cc:1275] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.131836 16604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769cef901a274500b98b9322eab57bc4" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:29.132087 17197 raft_consensus.cc:1275] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.132766 16604 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.133476 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.134667 16603 raft_consensus.cc:3060] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.145308 16603 raft_consensus.cc:1275] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.145931 16604 raft_consensus.cc:2468] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:29.146130 17155 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.155462 16571 leader_election.cc:304] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
W20260709 13:18:29.154333 16497 leader_election.cc:343] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.155682 17155 tablet_bootstrap.cc:492] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.156297 17197 raft_consensus.cc:1275] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.156478 17155 ts_tablet_manager.cc:1403] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.000s
I20260709 13:18:29.158105 17240 raft_consensus.cc:2749] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:29.153146 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:29.158876 16606 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.159428 17155 raft_consensus.cc:359] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.160061 17155 raft_consensus.cc:740] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.160671 17155 consensus_queue.cc:260] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.162528 16571 leader_election.cc:304] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:29.165724 17027 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:29.164425 17255 consensus_queue.cc:1048] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.171576 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:29.172145 16454 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.171471 16281 catalog_manager.cc:5697] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 2 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.161900 17129 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:18:29.165375 16497 leader_election.cc:343] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.181492 16457 raft_consensus.cc:1275] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.183265 16454 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b1fa0b853a943c5bf98a7834dfd8c7c in term 2.
I20260709 13:18:29.184219 16498 leader_election.cc:304] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:29.167655 16279 catalog_manager.cc:5697] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.168568 17240 raft_consensus.cc:2804] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.162732 17155 ts_tablet_manager.cc:1434] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:29.170907 17197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:29.185268 17240 raft_consensus.cc:697] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:29.187446 17240 consensus_queue.cc:237] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.189069 17273 raft_consensus.cc:2804] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.189585 17273 raft_consensus.cc:697] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:29.190445 17273 consensus_queue.cc:237] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.187479 17255 consensus_queue.cc:1048] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:29.185722 17155 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.185804 16279 catalog_manager.cc:5697] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.219744 16278 catalog_manager.cc:5697] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.184746 16571 leader_election.cc:304] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:29.221572 16278 catalog_manager.cc:5697] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.222848 17270 raft_consensus.cc:2804] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.223335 17270 raft_consensus.cc:697] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:29.223711 16278 catalog_manager.cc:5697] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.224248 17270 consensus_queue.cc:237] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.238111 16606 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:29.241622 17269 consensus_queue.cc:1048] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:29.240348 16571 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:29.289458 16277 catalog_manager.cc:5697] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.290470 16606 raft_consensus.cc:1275] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.290769 16279 catalog_manager.cc:5697] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 2 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.292542 16279 catalog_manager.cc:5697] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 2 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.291352 16277 catalog_manager.cc:5697] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.296911 17269 raft_consensus.cc:2804] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.298094 17155 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.298998 17155 tablet_bootstrap.cc:492] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.299580 17155 ts_tablet_manager.cc:1403] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.114s	user 0.024s	sys 0.029s
I20260709 13:18:29.301359 17269 raft_consensus.cc:697] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Leader. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:29.302213 17155 raft_consensus.cc:359] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.302906 17155 raft_consensus.cc:740] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.303720 17155 consensus_queue.cc:260] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.305295 16498 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b5db6fa2cd44206908172d50ddf3532, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:29.306260 17155 ts_tablet_manager.cc:1434] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:29.306581 17266 raft_consensus.cc:2804] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.307080 17266 raft_consensus.cc:697] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:29.307904 17266 consensus_queue.cc:237] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.307102 17155 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.302259 17269 consensus_queue.cc:237] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.319496 16281 catalog_manager.cc:5697] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:29.321048 16571 leader_election.cc:343] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:29.299906 16280 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54068
I20260709 13:18:29.337937 17233 heartbeater.cc:499] Master 127.9.68.126:35691 was elected leader, sending a full tablet report...
I20260709 13:18:29.347882 17266 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.362609 16277 catalog_manager.cc:5697] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:29.415884 16571 consensus_peers.cc:597] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.427913 16528 raft_consensus.cc:1275] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.427241 16281 catalog_manager.cc:5697] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c reported cstate change: term changed from 1 to 2, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68). New cstate: current_term: 2 leader_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.431545 17155 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.432463 17155 tablet_bootstrap.cc:492] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.433079 17155 ts_tablet_manager.cc:1403] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.040s
I20260709 13:18:29.435472 17155 raft_consensus.cc:359] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.436110 17155 raft_consensus.cc:740] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.436774 17155 consensus_queue.cc:260] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.438820 17155 ts_tablet_manager.cc:1434] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:29.439574 17155 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.457247 17259 consensus_queue.cc:1048] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:29.462307 16423 consensus_peers.cc:597] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.471024 17155 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.471956 17155 tablet_bootstrap.cc:492] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.472779 17155 ts_tablet_manager.cc:1403] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:18:29.475358 17155 raft_consensus.cc:359] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.476007 17155 raft_consensus.cc:740] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.476939 17155 consensus_queue.cc:260] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.478971 17155 ts_tablet_manager.cc:1434] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:29.479717 17155 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.494431 17155 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:18:29.494568 16497 consensus_peers.cc:597] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.495261 17155 tablet_bootstrap.cc:492] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.495857 17155 ts_tablet_manager.cc:1403] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:18:29.498031 17155 raft_consensus.cc:359] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.498644 17155 raft_consensus.cc:740] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.499274 17155 consensus_queue.cc:260] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.501448 17155 ts_tablet_manager.cc:1434] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:29.502138 17155 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.515312 17155 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.516328 17155 tablet_bootstrap.cc:492] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.516856 17155 ts_tablet_manager.cc:1403] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:18:29.519904 17155 raft_consensus.cc:359] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.520383 17155 raft_consensus.cc:740] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.520942 17155 consensus_queue.cc:260] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.522629 17155 ts_tablet_manager.cc:1434] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:29.523217 17155 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.530911 16532 raft_consensus.cc:1275] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.532315 17067 consensus_queue.cc:1048] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.534268 16455 raft_consensus.cc:1275] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.535770 17265 consensus_queue.cc:1048] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.538678 17155 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.539546 17155 tablet_bootstrap.cc:492] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.540382 17155 ts_tablet_manager.cc:1403] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:18:29.543562 17155 raft_consensus.cc:359] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.544371 17155 raft_consensus.cc:740] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.545300 17155 consensus_queue.cc:260] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.547751 17155 ts_tablet_manager.cc:1434] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:29.551975 17155 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.578045 17202 raft_consensus.cc:1275] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.580756 16455 raft_consensus.cc:1275] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.583863 17266 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.582512 16528 raft_consensus.cc:1275] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.587507 17129 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.592489 17155 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.593425 17155 tablet_bootstrap.cc:492] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.594026 17155 ts_tablet_manager.cc:1403] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.016s
I20260709 13:18:29.595070 17265 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.596567 17155 raft_consensus.cc:359] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.597234 17155 raft_consensus.cc:740] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.597882 17155 consensus_queue.cc:260] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.599889 17155 ts_tablet_manager.cc:1434] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:18:29.603577 17155 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.604885 17194 raft_consensus.cc:3060] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.613689 17194 raft_consensus.cc:1275] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.620226 17266 consensus_queue.cc:1048] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.641768 16606 raft_consensus.cc:1275] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.644207 17255 consensus_queue.cc:1048] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.645419 17155 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.646358 17155 tablet_bootstrap.cc:492] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.646978 17155 ts_tablet_manager.cc:1403] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.015s
I20260709 13:18:29.649590 17155 raft_consensus.cc:359] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.650167 17155 raft_consensus.cc:740] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.650790 17155 consensus_queue.cc:260] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.652842 17155 ts_tablet_manager.cc:1434] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:29.653272 16455 raft_consensus.cc:1275] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.653637 17155 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.653272 17194 raft_consensus.cc:1275] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.655443 17255 consensus_queue.cc:1048] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.656713 17194 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.664294 17255 consensus_queue.cc:1048] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:29.666946 16423 consensus_peers.cc:597] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:29.670686 17194 raft_consensus.cc:1275] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:29.671882 16571 consensus_peers.cc:597] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.674408 17198 raft_consensus.cc:3060] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.674618 16455 raft_consensus.cc:1275] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.677462 17230 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.684003 17260 consensus_queue.cc:1048] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.686246 17197 raft_consensus.cc:3060] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:29.699784 16423 consensus_peers.cc:597] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:29.703161 16532 raft_consensus.cc:1275] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.710009 17259 consensus_queue.cc:1048] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:29.714030 17198 raft_consensus.cc:1275] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.724578 17259 consensus_queue.cc:1048] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.740293 17155 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.741204 17155 tablet_bootstrap.cc:492] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.741832 17155 ts_tablet_manager.cc:1403] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.088s	user 0.033s	sys 0.037s
I20260709 13:18:29.744592 17155 raft_consensus.cc:359] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.745424 17155 raft_consensus.cc:740] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.746742 17155 consensus_queue.cc:260] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.750413 17155 ts_tablet_manager.cc:1434] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:29.751422 17155 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
W20260709 13:18:29.781061 16497 consensus_peers.cc:597] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.793794 17155 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.794297 16606 raft_consensus.cc:1275] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.794685 17155 tablet_bootstrap.cc:492] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.795342 17155 ts_tablet_manager.cc:1403] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.017s
I20260709 13:18:29.797678 17155 raft_consensus.cc:359] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.798301 17155 raft_consensus.cc:740] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.798733 17266 consensus_queue.cc:1048] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.799068 17155 consensus_queue.cc:260] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.801142 17155 ts_tablet_manager.cc:1434] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:29.801941 17155 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
W20260709 13:18:29.841470 16423 consensus_peers.cc:597] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.842962 16497 consensus_peers.cc:597] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:29.859666 17155 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.860659 17155 tablet_bootstrap.cc:492] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.861330 17155 ts_tablet_manager.cc:1403] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.017s
I20260709 13:18:29.863837 17155 raft_consensus.cc:359] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.864459 17155 raft_consensus.cc:740] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.865094 17155 consensus_queue.cc:260] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.867245 17155 ts_tablet_manager.cc:1434] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:29.868263 17155 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.877036 16454 raft_consensus.cc:1275] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 9b1fa0b853a943c5bf98a7834dfd8c7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.879000 17260 consensus_queue.cc:1048] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.884891 17155 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.885926 17155 tablet_bootstrap.cc:492] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.887216 17155 ts_tablet_manager.cc:1403] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:18:29.890836 17155 raft_consensus.cc:359] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.891436 17155 raft_consensus.cc:740] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.892086 17155 consensus_queue.cc:260] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.894140 17155 ts_tablet_manager.cc:1434] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:29.894853 17155 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
W20260709 13:18:29.895823 16571 consensus_peers.cc:597] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.909832 17155 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.910742 17155 tablet_bootstrap.cc:492] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.911353 17155 ts_tablet_manager.cc:1403] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:18:29.913546 17155 raft_consensus.cc:359] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.913998 17155 raft_consensus.cc:740] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.914422 17155 consensus_queue.cc:260] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.916265 17155 ts_tablet_manager.cc:1434] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:29.917179 17155 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.934052 17155 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.934994 17155 tablet_bootstrap.cc:492] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.935655 17155 ts_tablet_manager.cc:1403] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:18:29.939112 17155 raft_consensus.cc:359] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.944752 17155 raft_consensus.cc:740] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.945387 17155 consensus_queue.cc:260] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:29.947360 17155 ts_tablet_manager.cc:1434] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:18:29.948118 17155 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.961243 17155 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.962119 17155 tablet_bootstrap.cc:492] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.962623 17155 ts_tablet_manager.cc:1403] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:18:29.964859 17155 raft_consensus.cc:359] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.965366 17155 raft_consensus.cc:740] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.966037 17155 consensus_queue.cc:260] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:29.967994 17155 ts_tablet_manager.cc:1434] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:29.968713 17155 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.981035 17155 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:29.981765 17155 tablet_bootstrap.cc:492] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:29.982262 17155 ts_tablet_manager.cc:1403] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:18:29.983896 17155 raft_consensus.cc:359] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.984387 17155 raft_consensus.cc:740] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:29.984865 17155 consensus_queue.cc:260] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:29.986634 17155 ts_tablet_manager.cc:1434] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:29.987736 17155 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:29.999734 17155 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.000453 17155 tablet_bootstrap.cc:492] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.000989 17155 ts_tablet_manager.cc:1403] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:18:30.003041 17155 raft_consensus.cc:359] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.003569 17155 raft_consensus.cc:740] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.004108 17155 consensus_queue.cc:260] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.005757 17155 ts_tablet_manager.cc:1434] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:30.006451 17155 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.019340 17155 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.020349 17155 tablet_bootstrap.cc:492] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.021037 17155 ts_tablet_manager.cc:1403] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:18:30.023499 17155 raft_consensus.cc:359] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.024066 17155 raft_consensus.cc:740] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.024755 17155 consensus_queue.cc:260] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.026263 17155 ts_tablet_manager.cc:1434] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:30.027029 17155 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.044713 17155 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.045866 17155 tablet_bootstrap.cc:492] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.046495 17155 ts_tablet_manager.cc:1403] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:18:30.048894 17155 raft_consensus.cc:359] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.049641 17155 raft_consensus.cc:740] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.050287 17155 consensus_queue.cc:260] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.052304 17155 ts_tablet_manager.cc:1434] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:30.053086 17155 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.070497 17155 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.071376 17155 tablet_bootstrap.cc:492] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.072000 17155 ts_tablet_manager.cc:1403] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:18:30.073976 17155 raft_consensus.cc:359] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.074438 17155 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.074944 17155 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.076409 17155 ts_tablet_manager.cc:1434] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:30.077204 17155 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.090966 17155 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.091815 17155 tablet_bootstrap.cc:492] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.092453 17155 ts_tablet_manager.cc:1403] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.015s	user 0.001s	sys 0.011s
I20260709 13:18:30.094261 17155 raft_consensus.cc:359] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.094744 17155 raft_consensus.cc:740] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.095347 17155 consensus_queue.cc:260] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.097364 17155 ts_tablet_manager.cc:1434] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:30.098268 17155 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.112907 17155 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.113761 17155 tablet_bootstrap.cc:492] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.114535 17155 ts_tablet_manager.cc:1403] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.009s
I20260709 13:18:30.116868 17155 raft_consensus.cc:359] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.117475 17155 raft_consensus.cc:740] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.118098 17155 consensus_queue.cc:260] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.120188 17155 ts_tablet_manager.cc:1434] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:30.128378 17155 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.150591 17155 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.151691 17155 tablet_bootstrap.cc:492] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.152300 17155 ts_tablet_manager.cc:1403] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
W20260709 13:18:30.152921 16571 consensus_peers.cc:597] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:30.154721 17155 raft_consensus.cc:359] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.155395 17155 raft_consensus.cc:740] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.155916 17155 consensus_queue.cc:260] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.157753 17155 ts_tablet_manager.cc:1434] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:18:30.159443 17155 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.174161 17155 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.175034 17155 tablet_bootstrap.cc:492] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.175572 17155 ts_tablet_manager.cc:1403] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:18:30.177059 17198 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.179302 17155 raft_consensus.cc:359] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.180214 17155 raft_consensus.cc:740] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.181911 17155 consensus_queue.cc:260] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.184880 17155 ts_tablet_manager.cc:1434] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:30.185619 17155 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap starting.
I20260709 13:18:30.188673 17266 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.189131 17266 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.191008 17266 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:30.192569 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" is_pre_election: true
I20260709 13:18:30.193081 16454 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 2.
I20260709 13:18:30.194871 16497 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:30.196483 17255 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:30.196856 17255 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.197162 17255 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.201400 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:30.202625 17198 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 1.
I20260709 13:18:30.208827 17255 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.212044 17255 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 3 election: Requested vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:30.212875 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:30.212810 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "6b5db6fa2cd44206908172d50ddf3532" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:30.213735 16454 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.213917 17198 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.221310 16454 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 3.
I20260709 13:18:30.223062 16497 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:30.223680 17027 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:30.224217 17027 raft_consensus.cc:697] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 LEADER]: Becoming Leader. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:30.225046 17027 consensus_queue.cc:237] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:30.226015 17198 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b5db6fa2cd44206908172d50ddf3532 in term 3.
I20260709 13:18:30.231611 17155 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.232579 17155 tablet_bootstrap.cc:492] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Bootstrap complete.
I20260709 13:18:30.233150 17155 ts_tablet_manager.cc:1403] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.018s
I20260709 13:18:30.234529 17198 raft_consensus.cc:3060] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.235898 17155 raft_consensus.cc:359] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.236759 17155 raft_consensus.cc:740] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Initialized, Role: FOLLOWER
I20260709 13:18:30.237716 17155 consensus_queue.cc:260] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:30.240784 17155 ts_tablet_manager.cc:1434] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:18:30.240238 16280 catalog_manager.cc:5697] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 reported cstate change: term changed from 1 to 3, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "6b5db6fa2cd44206908172d50ddf3532" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.284332 17198 raft_consensus.cc:3060] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.331274 17198 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.394327 17198 raft_consensus.cc:3060] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.509414 17241 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.509876 17241 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.511919 17241 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:30.512413 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" is_pre_election: true
I20260709 13:18:30.512917 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8" is_pre_election: true
I20260709 13:18:30.513058 16599 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:30.513592 17198 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 1.
I20260709 13:18:30.514231 16424 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:30.514879 17241 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:30.515262 17241 raft_consensus.cc:493] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.515559 17241 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.524180 17241 raft_consensus.cc:515] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.525925 17241 leader_election.cc:290] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:30.526816 17198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1135cc63751942c48da76d29e573b5b8"
I20260709 13:18:30.527343 17198 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.530447 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f209f9fb8b4c7c803d38dee43db5b9" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:30.531152 16599 raft_consensus.cc:3060] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.536223 17198 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 3.
I20260709 13:18:30.537374 16423 leader_election.cc:304] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:30.538017 17230 raft_consensus.cc:2804] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:30.538465 17230 raft_consensus.cc:697] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:30.539150 16599 raft_consensus.cc:2468] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 3.
I20260709 13:18:30.539182 17230 consensus_queue.cc:237] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:30.549484 16280 catalog_manager.cc:5697] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 3, leader changed from 1135cc63751942c48da76d29e573b5b8 (127.9.68.65) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 3 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.678968 17198 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:30.690469 16454 raft_consensus.cc:1275] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:30.692350 17266 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:30.714776 17198 raft_consensus.cc:1275] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Refusing update from remote peer 6b5db6fa2cd44206908172d50ddf3532: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:30.716689 17266 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.931620 16599 raft_consensus.cc:1275] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:30.932859 17357 consensus_queue.cc:1048] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.943581 17202 raft_consensus.cc:1275] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:30.946316 17230 consensus_queue.cc:1048] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:38.248607  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.308045 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:38.308878 16528 raft_consensus.cc:606] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:38.311436 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:38.311869 16528 raft_consensus.cc:606] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Received request to transfer leadership to TS 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:38.323151 16457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:42420
I20260709 13:18:38.323690 16457 raft_consensus.cc:606] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:38.326200 16457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:42420
I20260709 13:18:38.326620 16457 raft_consensus.cc:606] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:38.328874 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:38.329418 16528 raft_consensus.cc:606] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:38.348500 16599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195"
dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
mode: GRACEFUL
new_leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:18:38.349058 16599 raft_consensus.cc:606] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Received request to transfer leadership to TS 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:38.358434  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:38.360087  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:38.360863 17383 raft_consensus.cc:993] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.361442 17383 raft_consensus.cc:1081] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.363245 17198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36286
I20260709 13:18:38.363839 17198 raft_consensus.cc:493] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.364178 17198 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.370559 17198 raft_consensus.cc:515] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.373006 17198 leader_election.cc:290] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:38.383488 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:38.384301 16457 raft_consensus.cc:3055] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.384595 16457 raft_consensus.cc:740] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:38.385746 16457 consensus_queue.cc:260] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.387153 16457 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.387413 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1de4c82797410d855b09dc2152d6c3" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:38.388082 16528 raft_consensus.cc:3060] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.394377 16457 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:38.394922 16528 raft_consensus.cc:2468] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:38.395747 17151 leader_election.cc:304] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:38.397328 17393 raft_consensus.cc:2804] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.398401 17393 raft_consensus.cc:697] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:38.399374 17393 consensus_queue.cc:237] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.410549 16277 catalog_manager.cc:5697] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.475920 17374 raft_consensus.cc:993] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.476408 17383 raft_consensus.cc:1081] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.477998 17198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36286
I20260709 13:18:38.478636 17198 raft_consensus.cc:493] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.479039 17198 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.486323 17198 raft_consensus.cc:515] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:38.488066 17198 leader_election.cc:290] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 4 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:38.489662 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:38.490154 16457 raft_consensus.cc:3055] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.490473 16457 raft_consensus.cc:740] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:38.491364 16457 consensus_queue.cc:260] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:38.492345 16457 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.497575 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f3da48c10048b7b13cfa0b45d7ea8a" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:38.497732 16457 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 4.
I20260709 13:18:38.498147 16599 raft_consensus.cc:3060] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.498996 17151 leader_election.cc:304] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:38.499866 17393 raft_consensus.cc:2804] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:38.500380 17393 raft_consensus.cc:697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 4 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:38.501294 17393 consensus_queue.cc:237] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:38.505177 16599 raft_consensus.cc:2468] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 4.
I20260709 13:18:38.511833 16277 catalog_manager.cc:5697] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 3 to 4, leader changed from 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.561044 17384 raft_consensus.cc:993] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: : Instructing follower 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:38.562455 17270 raft_consensus.cc:1081] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Signalling peer 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:38.564069 16457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:38358
I20260709 13:18:38.564621 16457 raft_consensus.cc:493] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.564931 16457 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.569921 16457 raft_consensus.cc:515] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.572769 16457 leader_election.cc:290] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:38.572746 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:38.572980 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7424bbbce44e14bf037b51e9f86195" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:38.573454 16532 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.573592 16599 raft_consensus.cc:3055] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.574030 16599 raft_consensus.cc:740] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:38.575543 16599 consensus_queue.cc:260] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.576699 16599 raft_consensus.cc:3060] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.579320 16532 raft_consensus.cc:2468] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:38.580482 16423 leader_election.cc:304] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:38.581254 17383 raft_consensus.cc:2804] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.584687 17383 raft_consensus.cc:697] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:38.585817 17383 consensus_queue.cc:237] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.589681 16599 raft_consensus.cc:2468] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:38.595564 16277 catalog_manager.cc:5697] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.599547 17382 raft_consensus.cc:993] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.600121 17382 raft_consensus.cc:1081] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.601868 17198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:38.602504 17198 raft_consensus.cc:493] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.602937 17198 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.610436 17198 raft_consensus.cc:515] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.612180 17198 leader_election.cc:290] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:38.613205 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:38.614050 16532 raft_consensus.cc:3055] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.614485 16532 raft_consensus.cc:740] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:38.615307 16532 consensus_queue.cc:260] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.616544 16532 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.616446 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00291aa4a1be425a8dd5911f290c7fb2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:38.617456 16454 raft_consensus.cc:3060] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.624702 16454 raft_consensus.cc:2468] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:38.624702 16532 raft_consensus.cc:2468] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:38.626067 17151 leader_election.cc:304] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:38.627388 17393 raft_consensus.cc:2804] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.627907 17393 raft_consensus.cc:697] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:38.629009 17393 consensus_queue.cc:237] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.642278 16277 catalog_manager.cc:5697] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.644809 17378 raft_consensus.cc:993] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.645347 17378 raft_consensus.cc:1081] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:38.647365 17198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:38.647926 17198 raft_consensus.cc:493] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.648280 17198 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.654736 17198 raft_consensus.cc:515] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.656275 17198 leader_election.cc:290] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:38.657034 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:38.657219 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c54af7077b472491a17152358dfcd0" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:38.657704 16457 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.657819 16532 raft_consensus.cc:3055] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:38.658245 16532 raft_consensus.cc:740] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:38.658967 16532 consensus_queue.cc:260] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.659827 16532 raft_consensus.cc:3060] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.662247 16457 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:38.663322 17151 leader_election.cc:304] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:38.664127 17393 raft_consensus.cc:2804] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.664568 17393 raft_consensus.cc:697] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:38.665381 17393 consensus_queue.cc:237] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:38.667831 16532 raft_consensus.cc:2468] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:38.675552 16277 catalog_manager.cc:5697] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.755525 17382 raft_consensus.cc:993] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:38.756034 17378 raft_consensus.cc:1081] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Signalling peer 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:38.757501 16457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 13:18:38.758028 16457 raft_consensus.cc:493] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.758350 16457 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.762941 16457 raft_consensus.cc:515] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.764429 16457 leader_election.cc:290] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:38.764947 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:38.765538 16532 raft_consensus.cc:3055] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.765475 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2213423f89b4439f93a8692f6fcd5cf8" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:38.765996 16532 raft_consensus.cc:740] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:38.766199 16606 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.766912 16532 consensus_queue.cc:260] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.768028 16532 raft_consensus.cc:3060] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.772023 16606 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:38.772666 16532 raft_consensus.cc:2468] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:38.773108 16424 leader_election.cc:304] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:38.773919 17374 raft_consensus.cc:2804] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.774323 17374 raft_consensus.cc:697] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:38.774912 17374 consensus_queue.cc:237] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:38.784466 16277 catalog_manager.cc:5697] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.877561 16532 raft_consensus.cc:1275] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.878906 17393 consensus_queue.cc:1048] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.908967 16457 raft_consensus.cc:1275] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:38.910832 17394 consensus_queue.cc:1048] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.911386 16606 raft_consensus.cc:1275] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 4 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:38.913192 17394 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.967003 16457 raft_consensus.cc:1275] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:38.970364 17393 consensus_queue.cc:1048] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.979116 16599 raft_consensus.cc:1275] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.980618 17383 consensus_queue.cc:1048] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.006574 16532 raft_consensus.cc:1275] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.009413 17374 consensus_queue.cc:1048] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.042289 16457 raft_consensus.cc:1275] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.043437 17393 consensus_queue.cc:1048] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.056509 16532 raft_consensus.cc:1275] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.057711 17417 consensus_queue.cc:1048] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.072942 16528 raft_consensus.cc:1275] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:39.078203 17394 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:39.092815 16457 raft_consensus.cc:1275] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:39.094920 17393 consensus_queue.cc:1048] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:39.161896 16532 raft_consensus.cc:1275] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.163092 17401 consensus_queue.cc:1048] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.172485 16599 raft_consensus.cc:1275] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.174158 17374 consensus_queue.cc:1048] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.361766  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.394403  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.434490 16454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:42420
I20260709 13:18:39.435047 16454 raft_consensus.cc:606] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:39.437601 16532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:39.438112 16532 raft_consensus.cc:606] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:39.440508 16532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:39.440948 16532 raft_consensus.cc:606] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Received request to transfer leadership to TS 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:39.443153 16599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691f918df0f648568ef24d57f8633d34"
dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:18:39.443675 16599 raft_consensus.cc:606] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:39.446007 16532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:39.446517 16532 raft_consensus.cc:606] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:39.449046 16454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:42420
I20260709 13:18:39.449756 16454 raft_consensus.cc:606] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:39.451092  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:39.452688  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:39.468905 17401 raft_consensus.cc:993] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.469478 17401 raft_consensus.cc:1081] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.471258 17202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36286
I20260709 13:18:39.471906 17202 raft_consensus.cc:493] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.472322 17202 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.480782 17202 raft_consensus.cc:515] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:39.486167 17202 leader_election.cc:290] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:39.487360 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:39.487970 16532 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.490610 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb398a629fc4b66bd64c691b6f3c181" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:39.491086 16454 raft_consensus.cc:3055] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:39.491369 16454 raft_consensus.cc:740] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:39.492127 16454 consensus_queue.cc:260] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:39.493084 16454 raft_consensus.cc:3060] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.493609 16532 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.494660 17151 leader_election.cc:304] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:39.495324 17393 raft_consensus.cc:2804] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.495779 17393 raft_consensus.cc:697] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:39.496636 17393 consensus_queue.cc:237] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:39.498999 16454 raft_consensus.cc:2468] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.505501 16280 catalog_manager.cc:5697] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.552726 17423 raft_consensus.cc:993] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.553289 17423 raft_consensus.cc:1081] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.555086 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:39.555626 17197 raft_consensus.cc:493] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.555932 17197 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.563450 17197 raft_consensus.cc:515] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.566120 17197 leader_election.cc:290] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:39.566599 16532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:39.566828 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6fc8233a26484889a5212bec2b69ed" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:39.567363 16532 raft_consensus.cc:3055] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.567397 16606 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.567860 16532 raft_consensus.cc:740] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:39.568693 16532 consensus_queue.cc:260] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.570010 16532 raft_consensus.cc:3060] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.575524 16606 raft_consensus.cc:2468] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:39.577435 17152 leader_election.cc:304] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:39.578603 17417 raft_consensus.cc:2804] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:39.578727 16532 raft_consensus.cc:2468] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:39.579172 17417 raft_consensus.cc:697] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:39.580353 17417 consensus_queue.cc:237] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.595463 16280 catalog_manager.cc:5697] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.617077 17384 raft_consensus.cc:993] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.617668 17381 raft_consensus.cc:1081] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.619378 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "691f918df0f648568ef24d57f8633d34"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36274
I20260709 13:18:39.619905 17197 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.620270 17197 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.625545 17197 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:39.627382 17197 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:39.628222 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:39.628799 16599 raft_consensus.cc:3055] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:39.629340 16599 raft_consensus.cc:740] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:39.628605 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691f918df0f648568ef24d57f8633d34" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:39.629886 16454 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.631623 16599 consensus_queue.cc:260] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:39.632916 16599 raft_consensus.cc:3060] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.635931 16454 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.637440 17151 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:39.640221 17417 raft_consensus.cc:2804] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.642223 16599 raft_consensus.cc:2468] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.642372 17417 raft_consensus.cc:697] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:39.644136 17417 consensus_queue.cc:237] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:39.653693 16277 catalog_manager.cc:5697] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.894867 17382 raft_consensus.cc:993] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.895306 17382 raft_consensus.cc:1081] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.896700 17202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:39.897159 17202 raft_consensus.cc:493] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.897500 17202 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.903391 17202 raft_consensus.cc:515] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.905824 16457 raft_consensus.cc:1275] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:39.906752 17202 leader_election.cc:290] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:39.906984 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:39.907173 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d99153b406b4158ab960b4429dd2c7e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:39.907701 16528 raft_consensus.cc:3055] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:39.907766 16606 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.908027 16528 raft_consensus.cc:740] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:39.908223 17417 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:39.908849 16528 consensus_queue.cc:260] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.909945 16528 raft_consensus.cc:3060] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.918058 16528 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.919723 17151 leader_election.cc:304] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:39.920758 17417 raft_consensus.cc:2804] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.921224 17417 raft_consensus.cc:697] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:39.918195 16606 raft_consensus.cc:2468] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:39.921633 17423 raft_consensus.cc:993] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:39.922293 17378 raft_consensus.cc:1081] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Signalling peer 21b412f6f5fb4170b45dd85f95c1ce2f to start an election
I20260709 13:18:39.922432 17417 consensus_queue.cc:237] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:39.923697 16454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
 from {username='slave'} at 127.0.0.1:38368
I20260709 13:18:39.924180 16454 raft_consensus.cc:493] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.924491 16454 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.936172 16277 catalog_manager.cc:5697] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.937362 16454 raft_consensus.cc:515] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:39.939203 16454 leader_election.cc:290] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:39.940290 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:39.940809 16606 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.944125 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4383915d34cf48d2b5a1bd28a79089ae" candidate_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:39.944715 16528 raft_consensus.cc:3055] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:39.945027 16528 raft_consensus.cc:740] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:39.945909 16528 consensus_queue.cc:260] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:39.946889 16606 raft_consensus.cc:2468] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:39.947001 16528 raft_consensus.cc:3060] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.959237 16528 raft_consensus.cc:2468] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b412f6f5fb4170b45dd85f95c1ce2f in term 2.
I20260709 13:18:39.960094 16423 leader_election.cc:304] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b412f6f5fb4170b45dd85f95c1ce2f, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:39.961248 17374 raft_consensus.cc:2804] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:39.961922 17374 raft_consensus.cc:697] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Leader. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:39.962793 17374 consensus_queue.cc:237] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } }
I20260709 13:18:39.964988 16528 raft_consensus.cc:1275] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:39.966466 17417 consensus_queue.cc:1048] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:39.967492 16606 raft_consensus.cc:1275] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.968858 17417 consensus_queue.cc:1048] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.998601 16532 raft_consensus.cc:1275] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.000440 17393 consensus_queue.cc:1048] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.007035 17374 raft_consensus.cc:993] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.007540 17401 raft_consensus.cc:1081] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:39.988272 16277 catalog_manager.cc:5697] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66). New cstate: current_term: 2 leader_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.009554 17202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36286
I20260709 13:18:40.011785 17202 raft_consensus.cc:493] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.012368 17202 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.038128 17202 raft_consensus.cc:515] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:40.050092 16606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:40.050657 16606 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.057938 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4146e0f3ef4f748a9b3f0b29acc291" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:40.058624 16454 raft_consensus.cc:3055] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.058902 16454 raft_consensus.cc:740] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:40.059609 16454 consensus_queue.cc:260] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:40.060858 16454 raft_consensus.cc:3060] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.064023 16606 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.065129 17152 leader_election.cc:304] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:40.066211 17393 raft_consensus.cc:2804] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.066828 17393 raft_consensus.cc:697] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.067723 17393 consensus_queue.cc:237] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:40.057498 17202 leader_election.cc:290] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
I20260709 13:18:40.082278 16454 raft_consensus.cc:2468] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.088410 16280 catalog_manager.cc:5697] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.091432 16599 raft_consensus.cc:1275] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:40.092736 17393 consensus_queue.cc:1048] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.107092 16457 raft_consensus.cc:1275] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:40.109984 17393 consensus_queue.cc:1048] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.339943 16606 raft_consensus.cc:1275] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:40.341583 17394 consensus_queue.cc:1048] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.353304 16528 raft_consensus.cc:1275] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:40.354787 17437 consensus_queue.cc:1048] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:40.389140 16606 raft_consensus.cc:1275] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.390465 17374 consensus_queue.cc:1048] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.401018 16528 raft_consensus.cc:1275] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 21b412f6f5fb4170b45dd85f95c1ce2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.402859 17383 consensus_queue.cc:1048] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:40.453584  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.497256  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.521950 16454 raft_consensus.cc:1275] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:40.523445 17394 consensus_queue.cc:1048] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.540917 16606 raft_consensus.cc:1275] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:40.542780 17437 consensus_queue.cc:1048] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.542963 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:40.543504 16528 raft_consensus.cc:606] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:40.551574 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:40.552021 16528 raft_consensus.cc:606] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:40.556818 16528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b"
dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:18:40.557559 16528 raft_consensus.cc:606] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:40.560824 16599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2"
dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:38746
I20260709 13:18:40.561537 16599 raft_consensus.cc:606] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:40.566772 16454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd"
dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
mode: GRACEFUL
new_leader_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:42420
I20260709 13:18:40.567407 16454 raft_consensus.cc:606] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Received request to transfer leadership to TS 1135cc63751942c48da76d29e573b5b8
I20260709 13:18:40.568848  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:40.571269  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:40.576043 17448 raft_consensus.cc:993] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.576592 17401 raft_consensus.cc:1081] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.578251 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36286
I20260709 13:18:40.578828 17197 raft_consensus.cc:493] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.579126 17197 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.585722 17197 raft_consensus.cc:515] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.587826 17382 raft_consensus.cc:993] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.588165 17197 leader_election.cc:290] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:40.588405 17382 raft_consensus.cc:1081] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.588258 16454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:40.589221 16529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aaf89415784d2dbc3cf7640506a4cd" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:40.589872 16454 raft_consensus.cc:3055] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.589964 16529 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.590281 16454 raft_consensus.cc:740] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21b412f6f5fb4170b45dd85f95c1ce2f, State: Running, Role: LEADER
I20260709 13:18:40.591054 16454 consensus_queue.cc:260] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.592010 16454 raft_consensus.cc:3060] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.596673 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:40.597345 17197 raft_consensus.cc:493] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.597726 17197 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.598100 16454 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.599303 17151 leader_election.cc:304] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:40.600208 17437 raft_consensus.cc:2804] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.600692 17437 raft_consensus.cc:697] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.601541 17437 consensus_queue.cc:237] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.606324 17197 raft_consensus.cc:515] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.609256 17381 raft_consensus.cc:993] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.608623 17197 leader_election.cc:290] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:40.609871 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:40.609395 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b59053fce284e67b6a3871de35a9078" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:40.609995 17381 raft_consensus.cc:1081] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.610442 16599 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.610611 16528 raft_consensus.cc:3055] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.610963 16528 raft_consensus.cc:740] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:40.611680 16528 consensus_queue.cc:260] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.612668 16528 raft_consensus.cc:3060] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.614984 16529 raft_consensus.cc:2468] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.616704 16599 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:40.617238 16277 catalog_manager.cc:5697] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.617897 17152 leader_election.cc:304] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:40.619041 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36274
I20260709 13:18:40.619498 17394 raft_consensus.cc:2804] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:40.620200 17394 raft_consensus.cc:697] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.619535 17197 raft_consensus.cc:493] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.621110 17197 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.621037 17394 consensus_queue.cc:237] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.624809 16528 raft_consensus.cc:2468] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:40.628585 17197 raft_consensus.cc:515] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.632495 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:40.632668 17197 leader_election.cc:290] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:40.633126 16528 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.633142 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ca9c7566aa4318a09633ed422a10a2" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:40.633912 16599 raft_consensus.cc:3055] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.634227 16599 raft_consensus.cc:740] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9b1fa0b853a943c5bf98a7834dfd8c7c, State: Running, Role: LEADER
I20260709 13:18:40.634969 16599 consensus_queue.cc:260] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.636171 16599 raft_consensus.cc:3060] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.639232 16528 raft_consensus.cc:2468] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:40.640348 17151 leader_election.cc:304] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532; no voters: 
I20260709 13:18:40.641228 17394 raft_consensus.cc:2804] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:40.642053 17394 raft_consensus.cc:697] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.642239 16599 raft_consensus.cc:2468] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 2.
I20260709 13:18:40.643105 17394 consensus_queue.cc:237] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.652554 16277 catalog_manager.cc:5697] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 1 to 2, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.654089 16277 catalog_manager.cc:5697] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 1 to 2, leader changed from 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.763860 17382 raft_consensus.cc:993] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.764364 17378 raft_consensus.cc:1081] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.766045 17202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:40.766605 17202 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.766943 17202 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.772315 17202 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.773674 17202 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Requested vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 9b1fa0b853a943c5bf98a7834dfd8c7c (127.9.68.68:45619)
I20260709 13:18:40.774269 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:40.774595 16599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bf73a024d584db697c00de0dc28ca5b" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c"
I20260709 13:18:40.774850 16528 raft_consensus.cc:3055] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.775049 16599 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.775256 16528 raft_consensus.cc:740] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:40.776074 16528 consensus_queue.cc:260] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.777189 16528 raft_consensus.cc:3060] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.781427 16599 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.782524 17152 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 
I20260709 13:18:40.783221 17394 raft_consensus.cc:2804] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.783171 16528 raft_consensus.cc:2468] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 3.
I20260709 13:18:40.783766 17394 raft_consensus.cc:697] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.784929 17394 consensus_queue.cc:237] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:40.794330 16277 catalog_manager.cc:5697] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 2 to 3, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 3 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.960086 17382 raft_consensus.cc:993] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: : Instructing follower 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.960637 17378 raft_consensus.cc:1081] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 LEADER]: Signalling peer 1135cc63751942c48da76d29e573b5b8 to start an election
I20260709 13:18:40.962167 17197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e"
dest_uuid: "1135cc63751942c48da76d29e573b5b8"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:18:40.962653 17197 raft_consensus.cc:493] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.962987 17197 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.968441 17197 raft_consensus.cc:515] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.970943 16457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f"
I20260709 13:18:40.971349 16528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cfd1e3653147699df1ac0e9482ba3e" candidate_uuid: "1135cc63751942c48da76d29e573b5b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b5db6fa2cd44206908172d50ddf3532"
I20260709 13:18:40.971469 16457 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.977514 16528 raft_consensus.cc:3055] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.977840 16528 raft_consensus.cc:740] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b5db6fa2cd44206908172d50ddf3532, State: Running, Role: LEADER
I20260709 13:18:40.978646 16528 consensus_queue.cc:260] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.981493 16457 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 4.
I20260709 13:18:40.980789 16528 raft_consensus.cc:3060] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.982420 17197 leader_election.cc:290] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 4 election: Requested vote from peers 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933), 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149)
I20260709 13:18:40.982479 17151 leader_election.cc:304] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f; no voters: 
I20260709 13:18:40.983458 17437 raft_consensus.cc:2804] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:40.983922 17437 raft_consensus.cc:697] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 4 LEADER]: Becoming Leader. State: Replica: 1135cc63751942c48da76d29e573b5b8, State: Running, Role: LEADER
I20260709 13:18:40.984741 17437 consensus_queue.cc:237] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } }
I20260709 13:18:40.990628 16528 raft_consensus.cc:2468] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1135cc63751942c48da76d29e573b5b8 in term 4.
I20260709 13:18:40.993806 16277 catalog_manager.cc:5697] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 reported cstate change: term changed from 3 to 4, leader changed from 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67) to 1135cc63751942c48da76d29e573b5b8 (127.9.68.65). New cstate: current_term: 4 leader_uuid: "1135cc63751942c48da76d29e573b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.022959 16528 raft_consensus.cc:1275] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.025383 17394 consensus_queue.cc:1048] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.034200 16599 raft_consensus.cc:1275] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.035940 17393 consensus_queue.cc:1048] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.050186 16529 raft_consensus.cc:1275] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:41.052011 17437 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.073406 16457 raft_consensus.cc:1275] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:41.074915 17437 consensus_queue.cc:1048] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:41.117259 16599 raft_consensus.cc:1275] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.118759 17437 consensus_queue.cc:1048] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.128535 16528 raft_consensus.cc:1275] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.131047 17417 consensus_queue.cc:1048] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.272001 16529 raft_consensus.cc:1275] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:41.273047 17417 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.285228 16599 raft_consensus.cc:1275] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:41.291039 17417 consensus_queue.cc:1048] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.439814 16454 raft_consensus.cc:1275] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:41.441234 17394 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:41.450852 16529 raft_consensus.cc:1275] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 4 FOLLOWER]: Refusing update from remote peer 1135cc63751942c48da76d29e573b5b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:41.452802 17437 consensus_queue.cc:1048] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.572428  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.613197  9489 tablet_server.cc:179] TabletServer@127.9.68.65:44563 shutting down...
W20260709 13:18:41.629943 16423 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 64 similar messages]
W20260709 13:18:41.647553 16423 consensus_peers.cc:597] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.654107  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:41.655138  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.655948  9489 raft_consensus.cc:2243] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.656425  9489 raft_consensus.cc:2272] T 7fcd8b1fff044727b789cd91ac9a4e80 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.658723  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.659399  9489 raft_consensus.cc:2243] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.660146  9489 raft_consensus.cc:2272] T 6c1de4c82797410d855b09dc2152d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.662177  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.662689  9489 raft_consensus.cc:2243] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.663383  9489 raft_consensus.cc:2272] T 691f918df0f648568ef24d57f8633d34 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.665606  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.666294  9489 raft_consensus.cc:2243] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.666750  9489 raft_consensus.cc:2272] T d8a1ccad75124fc1836b2ebf138c18b1 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.668790  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.669404  9489 raft_consensus.cc:2243] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.669824  9489 raft_consensus.cc:2272] T 62aa96fdb9e94536805e98e02a69f564 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.671736  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.672518  9489 raft_consensus.cc:2243] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.673134  9489 raft_consensus.cc:2272] T cabb8db6421b49da935435b9f4dd7afa P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.675153  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.675724  9489 raft_consensus.cc:2243] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.676127  9489 raft_consensus.cc:2272] T 84f209f9fb8b4c7c803d38dee43db5b9 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.678670  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.679618  9489 raft_consensus.cc:2243] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.680070  9489 raft_consensus.cc:2272] T a4a28d714f0646cf96db4e9be81b2de6 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.681442 16571 consensus_peers.cc:597] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.682389  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.682962  9489 raft_consensus.cc:2243] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.683460  9489 raft_consensus.cc:2272] T 7fb6727c39d3449f9ec4674c95b36423 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.686019  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.686825  9489 raft_consensus.cc:2243] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.687340  9489 raft_consensus.cc:2272] T 99cad407ad0d450db9c2bc97b1deefe3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.687635 16423 consensus_peers.cc:597] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.690107  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.690901  9489 raft_consensus.cc:2243] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.691744  9489 raft_consensus.cc:2272] T 80f3da48c10048b7b13cfa0b45d7ea8a P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.693971  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.694551  9489 raft_consensus.cc:2243] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.695499  9489 raft_consensus.cc:2272] T 24cfd1e3653147699df1ac0e9482ba3e P 1135cc63751942c48da76d29e573b5b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.698267  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.698947  9489 raft_consensus.cc:2243] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.699874  9489 raft_consensus.cc:2272] T ceb398a629fc4b66bd64c691b6f3c181 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.703361  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.704645  9489 raft_consensus.cc:2243] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.705461  9489 raft_consensus.cc:2272] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.707736 16497 consensus_peers.cc:597] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.708425  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.709055  9489 raft_consensus.cc:2243] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.710032  9489 raft_consensus.cc:2272] T 00291aa4a1be425a8dd5911f290c7fb2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.712782  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.713357  9489 raft_consensus.cc:2243] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.713928  9489 raft_consensus.cc:2272] T 6e1607c4cac14c5598baefa0a5a278a7 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.716233  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.716804  9489 raft_consensus.cc:2243] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.717130  9489 raft_consensus.cc:2272] T cb76a2947ae845cab4136ccd212eb71f P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.719029  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.719481  9489 raft_consensus.cc:2243] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.719841  9489 raft_consensus.cc:2272] T 769cef901a274500b98b9322eab57bc4 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.722048  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.722760  9489 raft_consensus.cc:2243] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.723208  9489 raft_consensus.cc:2272] T e56b22b1a54c4c578938b845034bf989 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.724536 16571 consensus_peers.cc:597] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.725605  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.726189  9489 raft_consensus.cc:2243] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.726573  9489 raft_consensus.cc:2272] T 572881c47e5e493a8a45f1bb34f4d7e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.728757  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.729276  9489 raft_consensus.cc:2243] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.730055  9489 raft_consensus.cc:2272] T 6d99153b406b4158ab960b4429dd2c7e P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.732039  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.732584  9489 raft_consensus.cc:2243] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.733403  9489 raft_consensus.cc:2272] T c3c54af7077b472491a17152358dfcd0 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.735528  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.736059  9489 raft_consensus.cc:2243] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.736441  9489 raft_consensus.cc:2272] T 6597b6be11d44863bb49b53494f07b3b P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.738497  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.739073  9489 raft_consensus.cc:2243] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.739480  9489 raft_consensus.cc:2272] T 112f015baf52408f865d1b5784545dfe P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.741673  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.742195  9489 raft_consensus.cc:2243] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.742568  9489 raft_consensus.cc:2272] T 0a6a639be7534d3881309e65107f6276 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.744930  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.745639  9489 raft_consensus.cc:2243] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.746047  9489 raft_consensus.cc:2272] T 628e387b7d7546b2a4c4f4e476304b97 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.747442 16497 consensus_peers.cc:597] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.748258  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.748847  9489 raft_consensus.cc:2243] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.749221  9489 raft_consensus.cc:2272] T 4e1f497bdffb4230b18aaec54cb04de0 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.751153  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.751709  9489 raft_consensus.cc:2243] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.752104  9489 raft_consensus.cc:2272] T dc279b02590c4d1d8bb12e237d2b6879 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.753901  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.754415  9489 raft_consensus.cc:2243] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.754794  9489 raft_consensus.cc:2272] T 8890c126d72a49d0a58319b296abe490 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.756590  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.757107  9489 raft_consensus.cc:2243] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.757809  9489 raft_consensus.cc:2272] T 75ca9c7566aa4318a09633ed422a10a2 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.759857  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.760363  9489 raft_consensus.cc:2243] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.760742  9489 raft_consensus.cc:2272] T dec45191582145d2a68d3146fb5008e5 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.763128  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.763824  9489 raft_consensus.cc:2243] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.764247  9489 raft_consensus.cc:2272] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.766034  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.766536  9489 raft_consensus.cc:2243] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.767243  9489 raft_consensus.cc:2272] T 3c6fc8233a26484889a5212bec2b69ed P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.769107  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.769641  9489 raft_consensus.cc:2243] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.770023  9489 raft_consensus.cc:2272] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.771850  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.772325  9489 raft_consensus.cc:2243] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.772749  9489 raft_consensus.cc:2272] T 7b7b762eaf2849079198e3c617927974 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.774677  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.775178  9489 raft_consensus.cc:2243] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.775612  9489 raft_consensus.cc:2272] T 12f4f3010d6a401980cde5692a80f092 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.778391  9489 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:41.778342 16497 consensus_peers.cc:597] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.779340  9489 raft_consensus.cc:2243] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.780364  9489 raft_consensus.cc:2272] T 3bf73a024d584db697c00de0dc28ca5b P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.783272  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.783993  9489 raft_consensus.cc:2243] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.784422  9489 raft_consensus.cc:2272] T 55a58fe97303471a81a4511d2bdc4933 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.786796  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.787386  9489 raft_consensus.cc:2243] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.788187  9489 raft_consensus.cc:2272] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.788965 16497 consensus_peers.cc:597] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.790516  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.791105  9489 raft_consensus.cc:2243] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.791600  9489 raft_consensus.cc:2272] T ec158588f7a145b6bb53ff67441c3e65 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.794063  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.794673  9489 raft_consensus.cc:2243] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.795207  9489 raft_consensus.cc:2272] T 2b61bde285854aadb8c899675630d767 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.797745  9489 tablet_replica.cc:333] stopping tablet replica
W20260709 13:18:41.797927 16497 consensus_peers.cc:597] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.798321  9489 raft_consensus.cc:2243] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:41.798589 16571 consensus_peers.cc:597] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.798808  9489 raft_consensus.cc:2272] T 7e72e3aaa572413bb34bccd2652bed01 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.801309  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.802222  9489 raft_consensus.cc:2243] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.802807  9489 raft_consensus.cc:2272] T 8c18a2e264c34f4291b3bb9965abf150 P 1135cc63751942c48da76d29e573b5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.805754  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.806289  9489 raft_consensus.cc:2243] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.806983  9489 raft_consensus.cc:2272] T 94aaf89415784d2dbc3cf7640506a4cd P 1135cc63751942c48da76d29e573b5b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.809681  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:41.810344  9489 raft_consensus.cc:2243] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:41.811275  9489 raft_consensus.cc:2272] T 0b59053fce284e67b6a3871de35a9078 P 1135cc63751942c48da76d29e573b5b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.811908 16423 consensus_peers.cc:597] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.816488 16423 consensus_peers.cc:597] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.823122 16497 consensus_peers.cc:597] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.885466  9489 tablet_server.cc:196] TabletServer@127.9.68.65:44563 shutdown complete.
W20260709 13:18:41.889816 16571 consensus_peers.cc:597] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.901593 16497 consensus_peers.cc:597] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.912382 16497 consensus_peers.cc:597] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.932902 16571 consensus_peers.cc:597] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.972836 16423 consensus_peers.cc:597] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.977444 16423 consensus_peers.cc:597] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.978176 16571 consensus_peers.cc:597] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.982514 16497 consensus_peers.cc:597] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:41.982978  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
W20260709 13:18:41.983439 16571 consensus_peers.cc:597] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.985608 16497 consensus_peers.cc:597] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.989502 16571 consensus_peers.cc:597] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.001988 16423 consensus_peers.cc:597] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.004375 16571 consensus_peers.cc:597] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.023826 16497 consensus_peers.cc:597] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.029868  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:42.031216  9489 tablet_replica.cc:333] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.032269  9489 raft_consensus.cc:2243] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.033610  9489 raft_consensus.cc:2272] T 4e1f497bdffb4230b18aaec54cb04de0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.035792 16423 consensus_peers.cc:597] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.036862  9489 tablet_replica.cc:333] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.037907  9489 raft_consensus.cc:2243] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.038455  9489 raft_consensus.cc:2272] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.041113  9489 tablet_replica.cc:333] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.042043  9489 raft_consensus.cc:2243] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.043238  9489 raft_consensus.cc:2272] T 12f4f3010d6a401980cde5692a80f092 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.043982 16497 consensus_peers.cc:597] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.046303  9489 tablet_replica.cc:333] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.047253  9489 raft_consensus.cc:2243] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.047740  9489 raft_consensus.cc:2272] T 6c1de4c82797410d855b09dc2152d6c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.050108  9489 tablet_replica.cc:333] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.050776  9489 raft_consensus.cc:2243] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.051671  9489 raft_consensus.cc:2272] T d70f92685aef44de910d2e3645e4ed91 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.054168  9489 tablet_replica.cc:333] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
W20260709 13:18:42.054942 16571 consensus_peers.cc:597] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.054952  9489 raft_consensus.cc:2243] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.055672  9489 raft_consensus.cc:2272] T ceb398a629fc4b66bd64c691b6f3c181 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.058199  9489 tablet_replica.cc:333] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.058946  9489 raft_consensus.cc:2243] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.059693  9489 raft_consensus.cc:2272] T 4383915d34cf48d2b5a1bd28a79089ae P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.060894 16571 consensus_peers.cc:597] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.062175  9489 tablet_replica.cc:333] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.062896  9489 raft_consensus.cc:2243] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.063315  9489 raft_consensus.cc:2272] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.065824  9489 tablet_replica.cc:333] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.066543  9489 raft_consensus.cc:2243] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.067045  9489 raft_consensus.cc:2272] T c3c54af7077b472491a17152358dfcd0 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.068629 16423 consensus_peers.cc:597] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.069136  9489 tablet_replica.cc:333] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.069814  9489 raft_consensus.cc:2243] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.070235  9489 raft_consensus.cc:2272] T 572881c47e5e493a8a45f1bb34f4d7e5 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.072125  9489 tablet_replica.cc:333] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.072640  9489 raft_consensus.cc:2243] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.073024  9489 raft_consensus.cc:2272] T 6e16ffbf47354393b50c7d429e157a85 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.075747  9489 tablet_replica.cc:333] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.076686  9489 raft_consensus.cc:2243] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.077281  9489 raft_consensus.cc:2272] T 94aaf89415784d2dbc3cf7640506a4cd P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.080883  9489 tablet_replica.cc:333] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.081713  9489 raft_consensus.cc:2243] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.082252  9489 raft_consensus.cc:2272] T ca85bd059c93407bad570daec3df678f P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.083796 16571 consensus_peers.cc:597] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.084741  9489 tablet_replica.cc:333] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.085376  9489 raft_consensus.cc:2243] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.086179  9489 raft_consensus.cc:2272] T d8a1ccad75124fc1836b2ebf138c18b1 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.088594  9489 tablet_replica.cc:333] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.089284  9489 raft_consensus.cc:2243] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.090226  9489 raft_consensus.cc:2272] T e871d54ea7e74517a5f6baa2a0e3d96c P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.090611 16497 consensus_peers.cc:597] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.092204  9489 tablet_replica.cc:333] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.092778  9489 raft_consensus.cc:2243] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.093194  9489 raft_consensus.cc:2272] T 8890c126d72a49d0a58319b296abe490 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.095168  9489 tablet_replica.cc:333] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.096036  9489 raft_consensus.cc:2243] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.096513  9489 raft_consensus.cc:2272] T dc279b02590c4d1d8bb12e237d2b6879 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.098639  9489 tablet_replica.cc:333] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.099186  9489 raft_consensus.cc:2243] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.099602  9489 raft_consensus.cc:2272] T f262d583f3a445c68bd8196d351fee97 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.101591  9489 tablet_replica.cc:333] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.102118  9489 raft_consensus.cc:2243] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.102792  9489 raft_consensus.cc:2272] T da7424bbbce44e14bf037b51e9f86195 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.104637  9489 tablet_replica.cc:333] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.105161  9489 raft_consensus.cc:2243] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.105912  9489 raft_consensus.cc:2272] T 14a7dab472244946b139542a19c2e9a6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.108676  9489 tablet_replica.cc:333] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.109407  9489 raft_consensus.cc:2243] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.109856  9489 raft_consensus.cc:2272] T 0a6a639be7534d3881309e65107f6276 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.112392  9489 tablet_replica.cc:333] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.113085  9489 raft_consensus.cc:2243] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.113699  9489 raft_consensus.cc:2272] T d7c8d57fe9a14ea5b84b25239c03b674 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.116561  9489 tablet_replica.cc:333] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.117336  9489 raft_consensus.cc:2243] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.118316  9489 raft_consensus.cc:2272] T 7fcd8b1fff044727b789cd91ac9a4e80 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.121012  9489 tablet_replica.cc:333] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.122167  9489 raft_consensus.cc:2243] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.122676  9489 raft_consensus.cc:2272] T 80f3da48c10048b7b13cfa0b45d7ea8a P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.125257  9489 tablet_replica.cc:333] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.125983  9489 raft_consensus.cc:2243] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:42.126746 16571 consensus_peers.cc:597] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.126881  9489 raft_consensus.cc:2272] T 24cfd1e3653147699df1ac0e9482ba3e P 21b412f6f5fb4170b45dd85f95c1ce2f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.128221 16497 consensus_peers.cc:597] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.130426  9489 tablet_replica.cc:333] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.131067  9489 raft_consensus.cc:2243] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.131546  9489 raft_consensus.cc:2272] T 62aa96fdb9e94536805e98e02a69f564 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.133445  9489 tablet_replica.cc:333] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.133973  9489 raft_consensus.cc:2243] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.134722  9489 raft_consensus.cc:2272] T cabb8db6421b49da935435b9f4dd7afa P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.136473  9489 tablet_replica.cc:333] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.136976  9489 raft_consensus.cc:2243] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.137866  9489 raft_consensus.cc:2272] T 84f209f9fb8b4c7c803d38dee43db5b9 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.140321  9489 tablet_replica.cc:333] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.141011  9489 raft_consensus.cc:2243] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.141556  9489 raft_consensus.cc:2272] T 6e1607c4cac14c5598baefa0a5a278a7 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.144192  9489 tablet_replica.cc:333] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.145028  9489 raft_consensus.cc:2243] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.145696  9489 raft_consensus.cc:2272] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.148810  9489 tablet_replica.cc:333] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.149861  9489 raft_consensus.cc:2243] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.150381  9489 raft_consensus.cc:2272] T 00291aa4a1be425a8dd5911f290c7fb2 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.153489  9489 tablet_replica.cc:333] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
W20260709 13:18:42.153913 16571 consensus_peers.cc:597] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.154428  9489 raft_consensus.cc:2243] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.155650  9489 raft_consensus.cc:2272] T 6597b6be11d44863bb49b53494f07b3b P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.156471 16497 consensus_peers.cc:597] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.157771  9489 tablet_replica.cc:333] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.158349  9489 raft_consensus.cc:2243] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.158742  9489 raft_consensus.cc:2272] T d46de5f77dc445b39fe65f5ee1c65935 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.160492  9489 tablet_replica.cc:333] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.161005  9489 raft_consensus.cc:2243] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.161481  9489 raft_consensus.cc:2272] T 2b61bde285854aadb8c899675630d767 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.163691  9489 tablet_replica.cc:333] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.164362  9489 raft_consensus.cc:2243] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:42.164373 16497 consensus_peers.cc:597] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.164981  9489 raft_consensus.cc:2272] T ec158588f7a145b6bb53ff67441c3e65 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.167795  9489 tablet_replica.cc:333] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.168495  9489 raft_consensus.cc:2243] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:42.168951 16497 consensus_peers.cc:597] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Couldn't send request to peer 1135cc63751942c48da76d29e573b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.169524  9489 raft_consensus.cc:2272] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.171442  9489 tablet_replica.cc:333] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.171960  9489 raft_consensus.cc:2243] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.172344  9489 raft_consensus.cc:2272] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.174170  9489 tablet_replica.cc:333] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.174683  9489 raft_consensus.cc:2243] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.175071  9489 raft_consensus.cc:2272] T bd4b3d6cec454dffaaf81084fdf67a55 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.177615  9489 tablet_replica.cc:333] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.178280  9489 raft_consensus.cc:2243] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.178707  9489 raft_consensus.cc:2272] T 691f918df0f648568ef24d57f8633d34 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.180490  9489 tablet_replica.cc:333] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.180980  9489 raft_consensus.cc:2243] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.181484  9489 raft_consensus.cc:2272] T bf91bf6c338842e8b2042525dff782ec P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.183434  9489 tablet_replica.cc:333] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.183938  9489 raft_consensus.cc:2243] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.184636  9489 raft_consensus.cc:2272] T 2213423f89b4439f93a8692f6fcd5cf8 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.186570  9489 tablet_replica.cc:333] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.187227  9489 raft_consensus.cc:2243] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.187788  9489 raft_consensus.cc:2272] T 8c18a2e264c34f4291b3bb9965abf150 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.190526  9489 tablet_replica.cc:333] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.191193  9489 raft_consensus.cc:2243] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.191723  9489 raft_consensus.cc:2272] T 7fb6727c39d3449f9ec4674c95b36423 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.194065  9489 tablet_replica.cc:333] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f: stopping tablet replica
I20260709 13:18:42.194620  9489 raft_consensus.cc:2243] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.195559  9489 raft_consensus.cc:2272] T a4a28d714f0646cf96db4e9be81b2de6 P 21b412f6f5fb4170b45dd85f95c1ce2f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.198130 16497 consensus_peers.cc:597] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.279451  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
W20260709 13:18:42.335752 16571 consensus_peers.cc:597] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.356905 16571 consensus_peers.cc:597] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.362318 16497 consensus_peers.cc:597] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.366057 16571 consensus_peers.cc:597] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.366598 16571 consensus_peers.cc:597] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.367070 16571 consensus_peers.cc:597] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.368996  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
W20260709 13:18:42.380726 16571 consensus_peers.cc:597] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.419299 16571 consensus_peers.cc:597] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.420653 16571 consensus_peers.cc:597] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.424863  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:42.425800  9489 tablet_replica.cc:333] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.426577  9489 raft_consensus.cc:2243] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.427606  9489 raft_consensus.cc:2272] T 628e387b7d7546b2a4c4f4e476304b97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.430653  9489 tablet_replica.cc:333] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
W20260709 13:18:42.430662 16571 consensus_peers.cc:597] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.431572  9489 raft_consensus.cc:2243] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.432576  9489 raft_consensus.cc:2272] T 1d0fd0cc28d7407a94234bdc87b0d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.434553  9489 tablet_replica.cc:333] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.435097  9489 raft_consensus.cc:2243] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.435494  9489 raft_consensus.cc:2272] T 3c6fc8233a26484889a5212bec2b69ed P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.437259  9489 tablet_replica.cc:333] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.437831  9489 raft_consensus.cc:2243] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.438215  9489 raft_consensus.cc:2272] T 55a58fe97303471a81a4511d2bdc4933 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.439965  9489 tablet_replica.cc:333] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.440510  9489 raft_consensus.cc:2243] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.440922  9489 raft_consensus.cc:2272] T 6c1de4c82797410d855b09dc2152d6c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.442641  9489 tablet_replica.cc:333] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.443272  9489 raft_consensus.cc:2243] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.443670  9489 raft_consensus.cc:2272] T d70f92685aef44de910d2e3645e4ed91 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.445518  9489 tablet_replica.cc:333] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.446056  9489 raft_consensus.cc:2243] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.446758  9489 raft_consensus.cc:2272] T 62aa96fdb9e94536805e98e02a69f564 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.448474  9489 tablet_replica.cc:333] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.449004  9489 raft_consensus.cc:2243] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.449427  9489 raft_consensus.cc:2272] T ceb398a629fc4b66bd64c691b6f3c181 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.451072  9489 tablet_replica.cc:333] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.451586  9489 raft_consensus.cc:2243] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.451967  9489 raft_consensus.cc:2272] T 4383915d34cf48d2b5a1bd28a79089ae P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.453754  9489 tablet_replica.cc:333] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.454285  9489 raft_consensus.cc:2243] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.454998  9489 raft_consensus.cc:2272] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.456843  9489 tablet_replica.cc:333] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.457388  9489 raft_consensus.cc:2243] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.458098  9489 raft_consensus.cc:2272] T e56b22b1a54c4c578938b845034bf989 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.459853  9489 tablet_replica.cc:333] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.460358  9489 raft_consensus.cc:2243] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.460753  9489 raft_consensus.cc:2272] T 94aaf89415784d2dbc3cf7640506a4cd P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.462745  9489 tablet_replica.cc:333] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.463519  9489 raft_consensus.cc:2243] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.464058  9489 raft_consensus.cc:2272] T ca85bd059c93407bad570daec3df678f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.467159  9489 tablet_replica.cc:333] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.467710  9489 raft_consensus.cc:2243] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.468119  9489 raft_consensus.cc:2272] T e871d54ea7e74517a5f6baa2a0e3d96c P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.469969  9489 tablet_replica.cc:333] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.470516  9489 raft_consensus.cc:2243] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.470902  9489 raft_consensus.cc:2272] T 3bf73a024d584db697c00de0dc28ca5b P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.472925  9489 tablet_replica.cc:333] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.473558  9489 raft_consensus.cc:2243] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.474408  9489 raft_consensus.cc:2272] T 769cef901a274500b98b9322eab57bc4 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.477622  9489 tablet_replica.cc:333] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.478514  9489 raft_consensus.cc:2243] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.479382  9489 raft_consensus.cc:2272] T cb76a2947ae845cab4136ccd212eb71f P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.482352  9489 tablet_replica.cc:333] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.483178  9489 raft_consensus.cc:2243] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.483754  9489 raft_consensus.cc:2272] T 112f015baf52408f865d1b5784545dfe P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.486585  9489 tablet_replica.cc:333] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.487390  9489 raft_consensus.cc:2243] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.487954  9489 raft_consensus.cc:2272] T 14a7dab472244946b139542a19c2e9a6 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.488723 16571 consensus_peers.cc:597] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.490453  9489 tablet_replica.cc:333] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.491381  9489 raft_consensus.cc:2243] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.492306  9489 raft_consensus.cc:2272] T 0a6a639be7534d3881309e65107f6276 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.494524  9489 tablet_replica.cc:333] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.495119  9489 raft_consensus.cc:2243] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.495556  9489 raft_consensus.cc:2272] T f262d583f3a445c68bd8196d351fee97 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.497668  9489 tablet_replica.cc:333] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.498262  9489 raft_consensus.cc:2243] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.498903  9489 raft_consensus.cc:2272] T 904a0b2b8c6b4ce6aa8e271a91ca8268 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.500972  9489 tablet_replica.cc:333] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.501575  9489 raft_consensus.cc:2243] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.502591  9489 raft_consensus.cc:2272] T 7b7b762eaf2849079198e3c617927974 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.504863  9489 tablet_replica.cc:333] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.505522  9489 raft_consensus.cc:2243] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.505957  9489 raft_consensus.cc:2272] T 75ca9c7566aa4318a09633ed422a10a2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.507776  9489 tablet_replica.cc:333] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.508289  9489 raft_consensus.cc:2243] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.508716  9489 raft_consensus.cc:2272] T dec45191582145d2a68d3146fb5008e5 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.511166  9489 tablet_replica.cc:333] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.511847  9489 raft_consensus.cc:2243] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.512346  9489 raft_consensus.cc:2272] T da7424bbbce44e14bf037b51e9f86195 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.514565  9489 tablet_replica.cc:333] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.515069  9489 raft_consensus.cc:2243] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.515818  9489 raft_consensus.cc:2272] T bf91bf6c338842e8b2042525dff782ec P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.517802  9489 tablet_replica.cc:333] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.518338  9489 raft_consensus.cc:2243] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.518795  9489 raft_consensus.cc:2272] T 2213423f89b4439f93a8692f6fcd5cf8 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.521081  9489 tablet_replica.cc:333] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.521624  9489 raft_consensus.cc:2243] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.521975  9489 raft_consensus.cc:2272] T d7c8d57fe9a14ea5b84b25239c03b674 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.523818  9489 tablet_replica.cc:333] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.524711  9489 raft_consensus.cc:2243] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.525485  9489 raft_consensus.cc:2272] T 7fcd8b1fff044727b789cd91ac9a4e80 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.528487  9489 tablet_replica.cc:333] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.529114  9489 raft_consensus.cc:2243] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.529616  9489 raft_consensus.cc:2272] T 7e72e3aaa572413bb34bccd2652bed01 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.531994  9489 tablet_replica.cc:333] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.532574  9489 raft_consensus.cc:2243] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.533008  9489 raft_consensus.cc:2272] T 24cfd1e3653147699df1ac0e9482ba3e P 6b5db6fa2cd44206908172d50ddf3532 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.535060  9489 tablet_replica.cc:333] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.535663  9489 raft_consensus.cc:2243] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.536473  9489 raft_consensus.cc:2272] T 99cad407ad0d450db9c2bc97b1deefe3 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.538609  9489 tablet_replica.cc:333] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.539170  9489 raft_consensus.cc:2243] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.539896  9489 raft_consensus.cc:2272] T 6e1607c4cac14c5598baefa0a5a278a7 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.541755  9489 tablet_replica.cc:333] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.542526  9489 raft_consensus.cc:2243] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.543660  9489 raft_consensus.cc:2272] T d46de5f77dc445b39fe65f5ee1c65935 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.546247  9489 tablet_replica.cc:333] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.547067  9489 raft_consensus.cc:2243] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:42.547714 16497 consensus_peers.cc:597] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 -> Peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Couldn't send request to peer 21b412f6f5fb4170b45dd85f95c1ce2f. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.548357  9489 raft_consensus.cc:2272] T 51cb00929bfa4e8eb1eb9cbcbfd81575 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.550400  9489 tablet_replica.cc:333] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.550948  9489 raft_consensus.cc:2243] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.551348  9489 raft_consensus.cc:2272] T 00291aa4a1be425a8dd5911f290c7fb2 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.553082  9489 tablet_replica.cc:333] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.553644  9489 raft_consensus.cc:2243] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.554126  9489 raft_consensus.cc:2272] T 6e16ffbf47354393b50c7d429e157a85 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.557021  9489 tablet_replica.cc:333] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.557781  9489 raft_consensus.cc:2243] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.558275  9489 raft_consensus.cc:2272] T 0b59053fce284e67b6a3871de35a9078 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.560426  9489 tablet_replica.cc:333] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.561122  9489 raft_consensus.cc:2243] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.561741  9489 raft_consensus.cc:2272] T a4a28d714f0646cf96db4e9be81b2de6 P 6b5db6fa2cd44206908172d50ddf3532 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.563822  9489 tablet_replica.cc:333] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.564332  9489 raft_consensus.cc:2243] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.565088  9489 raft_consensus.cc:2272] T ec158588f7a145b6bb53ff67441c3e65 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.567157  9489 tablet_replica.cc:333] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.567636  9489 raft_consensus.cc:2243] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.568019  9489 raft_consensus.cc:2272] T c3c54af7077b472491a17152358dfcd0 P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.569883  9489 tablet_replica.cc:333] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.570516  9489 raft_consensus.cc:2243] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.570953  9489 raft_consensus.cc:2272] T 6d99153b406b4158ab960b4429dd2c7e P 6b5db6fa2cd44206908172d50ddf3532 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.572798  9489 tablet_replica.cc:333] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532: stopping tablet replica
I20260709 13:18:42.573241  9489 raft_consensus.cc:2243] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.573694  9489 raft_consensus.cc:2272] T bd4b3d6cec454dffaaf81084fdf67a55 P 6b5db6fa2cd44206908172d50ddf3532 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.597155 16571 consensus_peers.cc:597] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.606395 16571 consensus_peers.cc:597] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.625021 16571 consensus_peers.cc:597] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.645105  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:18:42.664330 17480 raft_consensus.cc:493] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:42.664965 17480 raft_consensus.cc:515] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } } peers { permanent_uuid: "21b412f6f5fb4170b45dd85f95c1ce2f" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 34933 } }
I20260709 13:18:42.667465 17480 leader_election.cc:290] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563), 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933)
W20260709 13:18:42.671739 16571 leader_election.cc:336] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111)
W20260709 13:18:42.672391 16571 leader_election.cc:336] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 21b412f6f5fb4170b45dd85f95c1ce2f (127.9.68.66:34933): Network error: Client connection negotiation failed: client connection to 127.9.68.66:34933: connect: Connection refused (error 111)
I20260709 13:18:42.672713 16571 leader_election.cc:304] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 21b412f6f5fb4170b45dd85f95c1ce2f
I20260709 13:18:42.673408 17480 raft_consensus.cc:2749] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:42.684569 16571 consensus_peers.cc:597] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.67:39149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.712230  9489 tablet_server.cc:179] TabletServer@127.9.68.68:0 shutting down...
I20260709 13:18:42.766959  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:42.767813  9489 tablet_replica.cc:333] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.768567  9489 raft_consensus.cc:2243] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.769104  9489 raft_consensus.cc:2272] T 628e387b7d7546b2a4c4f4e476304b97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.771620  9489 tablet_replica.cc:333] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.772274  9489 raft_consensus.cc:2243] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.772747  9489 raft_consensus.cc:2272] T 4e1f497bdffb4230b18aaec54cb04de0 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.774933  9489 tablet_replica.cc:333] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.775538  9489 raft_consensus.cc:2243] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.776003  9489 raft_consensus.cc:2272] T 3c6fc8233a26484889a5212bec2b69ed P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.778263  9489 tablet_replica.cc:333] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.778923  9489 raft_consensus.cc:2243] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.779783  9489 raft_consensus.cc:2272] T 7fb6727c39d3449f9ec4674c95b36423 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.782186  9489 tablet_replica.cc:333] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.782783  9489 raft_consensus.cc:2243] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.783228  9489 raft_consensus.cc:2272] T 12f4f3010d6a401980cde5692a80f092 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.785218  9489 tablet_replica.cc:333] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.785892  9489 raft_consensus.cc:2243] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.786357  9489 raft_consensus.cc:2272] T d70f92685aef44de910d2e3645e4ed91 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.788666  9489 tablet_replica.cc:333] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.789470  9489 raft_consensus.cc:2243] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.789927  9489 raft_consensus.cc:2272] T 4383915d34cf48d2b5a1bd28a79089ae P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.791735  9489 tablet_replica.cc:333] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.792264  9489 raft_consensus.cc:2243] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.792676  9489 raft_consensus.cc:2272] T 958f3c6c84a24c3e9a6a13aa83ea11c3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.794471  9489 tablet_replica.cc:333] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.795018  9489 raft_consensus.cc:2243] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.795396  9489 raft_consensus.cc:2272] T e56b22b1a54c4c578938b845034bf989 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.796938 17481 raft_consensus.cc:493] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1135cc63751942c48da76d29e573b5b8)
I20260709 13:18:42.797254  9489 tablet_replica.cc:333] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.797405 17481 raft_consensus.cc:515] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b5db6fa2cd44206908172d50ddf3532" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 39149 } } peers { permanent_uuid: "9b1fa0b853a943c5bf98a7834dfd8c7c" member_type: VOTER last_known_addr { host: "127.9.68.68" port: 45619 } } peers { permanent_uuid: "1135cc63751942c48da76d29e573b5b8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44563 } }
I20260709 13:18:42.797983  9489 raft_consensus.cc:2243] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.798749  9489 raft_consensus.cc:2272] T 572881c47e5e493a8a45f1bb34f4d7e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.799409 17481 leader_election.cc:290] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149), 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563)
I20260709 13:18:42.801101  9489 tablet_replica.cc:333] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.802237  9489 raft_consensus.cc:2243] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:42.803198 16571 leader_election.cc:336] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Network error: Client connection negotiation failed: client connection to 127.9.68.67:39149: connect: Connection refused (error 111)
I20260709 13:18:42.803462  9489 raft_consensus.cc:2272] T ca85bd059c93407bad570daec3df678f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.804342 16571 leader_election.cc:336] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1135cc63751942c48da76d29e573b5b8 (127.9.68.65:44563): Network error: Client connection negotiation failed: client connection to 127.9.68.65:44563: connect: Connection refused (error 111)
I20260709 13:18:42.804831 16571 leader_election.cc:304] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b1fa0b853a943c5bf98a7834dfd8c7c; no voters: 1135cc63751942c48da76d29e573b5b8, 6b5db6fa2cd44206908172d50ddf3532
I20260709 13:18:42.805603 17481 raft_consensus.cc:2749] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.806664  9489 tablet_replica.cc:333] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.807240  9489 raft_consensus.cc:2243] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.807624  9489 raft_consensus.cc:2272] T 769cef901a274500b98b9322eab57bc4 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.809908  9489 tablet_replica.cc:333] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.810492  9489 raft_consensus.cc:2243] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.810964  9489 raft_consensus.cc:2272] T cb76a2947ae845cab4136ccd212eb71f P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.812812  9489 tablet_replica.cc:333] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.813354  9489 raft_consensus.cc:2243] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.813742  9489 raft_consensus.cc:2272] T d8a1ccad75124fc1836b2ebf138c18b1 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.815629  9489 tablet_replica.cc:333] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.816171  9489 raft_consensus.cc:2243] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.816578  9489 raft_consensus.cc:2272] T e871d54ea7e74517a5f6baa2a0e3d96c P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.818475  9489 tablet_replica.cc:333] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.819123  9489 raft_consensus.cc:2243] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.819684  9489 raft_consensus.cc:2272] T 3bf73a024d584db697c00de0dc28ca5b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.821904  9489 tablet_replica.cc:333] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.822474  9489 raft_consensus.cc:2243] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.823448  9489 raft_consensus.cc:2272] T f262d583f3a445c68bd8196d351fee97 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:42.824118 16571 consensus_peers.cc:597] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c -> Peer 6b5db6fa2cd44206908172d50ddf3532 (127.9.68.67:39149): Couldn't send request to peer 6b5db6fa2cd44206908172d50ddf3532. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.67:39149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.825718  9489 tablet_replica.cc:333] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.826318  9489 raft_consensus.cc:2243] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.826722  9489 raft_consensus.cc:2272] T d46de5f77dc445b39fe65f5ee1c65935 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.828493  9489 tablet_replica.cc:333] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.828984  9489 raft_consensus.cc:2243] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.829425  9489 raft_consensus.cc:2272] T 6597b6be11d44863bb49b53494f07b3b P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.831254  9489 tablet_replica.cc:333] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.831771  9489 raft_consensus.cc:2243] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.832492  9489 raft_consensus.cc:2272] T dc279b02590c4d1d8bb12e237d2b6879 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.834292  9489 tablet_replica.cc:333] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.834801  9489 raft_consensus.cc:2243] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.835453  9489 raft_consensus.cc:2272] T 8890c126d72a49d0a58319b296abe490 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.837236  9489 tablet_replica.cc:333] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.837829  9489 raft_consensus.cc:2243] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.838236  9489 raft_consensus.cc:2272] T 7b7b762eaf2849079198e3c617927974 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.839932  9489 tablet_replica.cc:333] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.840435  9489 raft_consensus.cc:2243] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.840816  9489 raft_consensus.cc:2272] T 75ca9c7566aa4318a09633ed422a10a2 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.842583  9489 tablet_replica.cc:333] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.843107  9489 raft_consensus.cc:2243] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.843770  9489 raft_consensus.cc:2272] T dec45191582145d2a68d3146fb5008e5 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.845602  9489 tablet_replica.cc:333] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.846102  9489 raft_consensus.cc:2243] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.846565  9489 raft_consensus.cc:2272] T da7424bbbce44e14bf037b51e9f86195 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.848549  9489 tablet_replica.cc:333] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.849046  9489 raft_consensus.cc:2243] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.850006  9489 raft_consensus.cc:2272] T 112f015baf52408f865d1b5784545dfe P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.851817  9489 tablet_replica.cc:333] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.852291  9489 raft_consensus.cc:2243] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.852698  9489 raft_consensus.cc:2272] T 14a7dab472244946b139542a19c2e9a6 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.854418  9489 tablet_replica.cc:333] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.854918  9489 raft_consensus.cc:2243] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.855611  9489 raft_consensus.cc:2272] T 8c18a2e264c34f4291b3bb9965abf150 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.857249  9489 tablet_replica.cc:333] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.857803  9489 raft_consensus.cc:2243] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.858480  9489 raft_consensus.cc:2272] T 7e72e3aaa572413bb34bccd2652bed01 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.860173  9489 tablet_replica.cc:333] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.860654  9489 raft_consensus.cc:2243] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.861407  9489 raft_consensus.cc:2272] T d7c8d57fe9a14ea5b84b25239c03b674 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.863081  9489 tablet_replica.cc:333] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.863569  9489 raft_consensus.cc:2243] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.863955  9489 raft_consensus.cc:2272] T cabb8db6421b49da935435b9f4dd7afa P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.865694  9489 tablet_replica.cc:333] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.866179  9489 raft_consensus.cc:2243] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.866565  9489 raft_consensus.cc:2272] T 84f209f9fb8b4c7c803d38dee43db5b9 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.868240  9489 tablet_replica.cc:333] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.868716  9489 raft_consensus.cc:2243] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.869138  9489 raft_consensus.cc:2272] T 80f3da48c10048b7b13cfa0b45d7ea8a P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.870741  9489 tablet_replica.cc:333] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.871244  9489 raft_consensus.cc:2243] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.871622  9489 raft_consensus.cc:2272] T 99cad407ad0d450db9c2bc97b1deefe3 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.873246  9489 tablet_replica.cc:333] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.873778  9489 raft_consensus.cc:2243] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.874168  9489 raft_consensus.cc:2272] T 6d99153b406b4158ab960b4429dd2c7e P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.875756  9489 tablet_replica.cc:333] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.876219  9489 raft_consensus.cc:2243] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.876585  9489 raft_consensus.cc:2272] T 691f918df0f648568ef24d57f8633d34 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.878284  9489 tablet_replica.cc:333] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.878760  9489 raft_consensus.cc:2243] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.879139  9489 raft_consensus.cc:2272] T bf91bf6c338842e8b2042525dff782ec P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.880757  9489 tablet_replica.cc:333] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.881234  9489 raft_consensus.cc:2243] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.881671  9489 raft_consensus.cc:2272] T 2213423f89b4439f93a8692f6fcd5cf8 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.883255  9489 tablet_replica.cc:333] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.883716  9489 raft_consensus.cc:2243] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.884405  9489 raft_consensus.cc:2272] T 6e16ffbf47354393b50c7d429e157a85 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.886111  9489 tablet_replica.cc:333] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.886592  9489 raft_consensus.cc:2243] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.886982  9489 raft_consensus.cc:2272] T 0b59053fce284e67b6a3871de35a9078 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.888540  9489 tablet_replica.cc:333] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.889003  9489 raft_consensus.cc:2243] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.889811  9489 raft_consensus.cc:2272] T 2b61bde285854aadb8c899675630d767 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.891659  9489 tablet_replica.cc:333] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.892139  9489 raft_consensus.cc:2243] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.892874  9489 raft_consensus.cc:2272] T 55a58fe97303471a81a4511d2bdc4933 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.894676  9489 tablet_replica.cc:333] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.895143  9489 raft_consensus.cc:2243] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:42.895503  9489 raft_consensus.cc:2272] T 2c4146e0f3ef4f748a9b3f0b29acc291 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.897256  9489 tablet_replica.cc:333] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c: stopping tablet replica
I20260709 13:18:42.897776  9489 raft_consensus.cc:2243] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:42.898491  9489 raft_consensus.cc:2272] T bd4b3d6cec454dffaaf81084fdf67a55 P 9b1fa0b853a943c5bf98a7834dfd8c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:42.959543  9489 tablet_server.cc:196] TabletServer@127.9.68.68:0 shutdown complete.
I20260709 13:18:43.020777  9489 master.cc:562] Master@127.9.68.126:35691 shutting down...
I20260709 13:18:43.046660  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:43.047219  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:43.047559  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P e11a1b3a37964353913db5deca7ae93c: stopping tablet replica
I20260709 13:18:43.068754  9489 master.cc:584] Master@127.9.68.126:35691 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (27084 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:18:43.156178  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:42893
I20260709 13:18:43.157277  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:43.162823 17487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.163021 17486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.164887 17489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:43.165019  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:43.166164  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:43.166347  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:43.166534  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603123166521 us; error 0 us; skew 500 ppm
I20260709 13:18:43.167091  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:43.169389  9489 webserver.cc:533] Webserver started at http://127.9.68.126:33103/ using document root <none> and password file <none>
I20260709 13:18:43.169872  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:43.170022  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:43.170293  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:43.171607  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "487a29306f0c40dcaf31aa32b50c05d2"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.175871  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:18:43.179447 17494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.180341  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:18:43.180631  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "487a29306f0c40dcaf31aa32b50c05d2"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.180862  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:43.197669  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:43.198762  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:43.239916  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:42893
I20260709 13:18:43.240053 17545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:42893 every 8 connection(s)
I20260709 13:18:43.244343 17546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.256202 17546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2: Bootstrap starting.
I20260709 13:18:43.260903 17546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:43.265508 17546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2: No bootstrap required, opened a new log
I20260709 13:18:43.267481 17546 raft_consensus.cc:359] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER }
I20260709 13:18:43.267833 17546 raft_consensus.cc:385] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:43.268013 17546 raft_consensus.cc:740] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 487a29306f0c40dcaf31aa32b50c05d2, State: Initialized, Role: FOLLOWER
I20260709 13:18:43.268575 17546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER }
I20260709 13:18:43.269073 17546 raft_consensus.cc:399] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:43.269268 17546 raft_consensus.cc:493] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:43.269554 17546 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:43.273741 17546 raft_consensus.cc:515] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER }
I20260709 13:18:43.274158 17546 leader_election.cc:304] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 487a29306f0c40dcaf31aa32b50c05d2; no voters: 
I20260709 13:18:43.275287 17546 leader_election.cc:290] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:43.275893 17549 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:43.277675 17549 raft_consensus.cc:697] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 1 LEADER]: Becoming Leader. State: Replica: 487a29306f0c40dcaf31aa32b50c05d2, State: Running, Role: LEADER
I20260709 13:18:43.278366 17549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER }
I20260709 13:18:43.278883 17546 sys_catalog.cc:565] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:43.283002 17550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "487a29306f0c40dcaf31aa32b50c05d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER } }
I20260709 13:18:43.283823 17551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 487a29306f0c40dcaf31aa32b50c05d2. Latest consensus state: current_term: 1 leader_uuid: "487a29306f0c40dcaf31aa32b50c05d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "487a29306f0c40dcaf31aa32b50c05d2" member_type: VOTER } }
I20260709 13:18:43.284216 17550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:43.284546 17551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:43.291836 17556 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:43.296947 17556 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:43.297932  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:43.305056 17556 catalog_manager.cc:1383] Generated new cluster ID: 68dc19a3cc524076acca4534511aadcf
I20260709 13:18:43.305357 17556 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:43.320251 17556 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:43.321481 17556 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:43.333393 17556 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2: Generated new TSK 0
I20260709 13:18:43.333952 17556 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:43.364641  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:43.371529 17567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.372846 17568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.374594 17570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:43.375128  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:43.375991  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:43.376231  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:43.376405  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603123376380 us; error 0 us; skew 500 ppm
I20260709 13:18:43.376904  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:43.379326  9489 webserver.cc:533] Webserver started at http://127.9.68.65:33571/ using document root <none> and password file <none>
I20260709 13:18:43.379783  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:43.379979  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:43.380247  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:43.381284  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.385640  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:18:43.388686 17575 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.389691  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:43.389928  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.390169  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:43.399897  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:43.400918  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:43.402292  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:43.404476  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:43.404644  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.404803  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:43.405022  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.444293  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:39685
I20260709 13:18:43.444404 17637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:39685 every 8 connection(s)
I20260709 13:18:43.448740  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:43.456305 17642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.459534 17643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.460633 17645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:43.462111  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:43.463099  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:43.463276  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:43.463402  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603123463390 us; error 0 us; skew 500 ppm
I20260709 13:18:43.463860  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:43.466225  9489 webserver.cc:533] Webserver started at http://127.9.68.66:44813/ using document root <none> and password file <none>
I20260709 13:18:43.466696  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:43.466902  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:43.467192  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:43.468520  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.469060 17638 heartbeater.cc:344] Connected to a master server at 127.9.68.126:42893
I20260709 13:18:43.469489 17638 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:43.470152 17638 heartbeater.cc:507] Master 127.9.68.126:42893 requested a full tablet report, sending...
I20260709 13:18:43.472194 17511 ts_manager.cc:194] Registered new tserver with Master: e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685)
I20260709 13:18:43.473562  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:43.474231 17511 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48202
I20260709 13:18:43.476946 17650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.477757  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:43.478056  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.478338  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:43.496196  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:43.497256  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:43.498672  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:43.500720  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:43.500957  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.501205  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:43.501395  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:18:43.541961  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:39059
I20260709 13:18:43.542213 17712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:39059 every 8 connection(s)
I20260709 13:18:43.546602  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:43.553694 17716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:43.556074 17717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:43.558838  9489 server_base.cc:1061] running on GCE node
W20260709 13:18:43.559625 17719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:43.560702  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:43.560963  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:43.561203  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603123561161 us; error 0 us; skew 500 ppm
I20260709 13:18:43.561579 17713 heartbeater.cc:344] Connected to a master server at 127.9.68.126:42893
I20260709 13:18:43.561933  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:43.562006 17713 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:43.563019 17713 heartbeater.cc:507] Master 127.9.68.126:42893 requested a full tablet report, sending...
I20260709 13:18:43.564747  9489 webserver.cc:533] Webserver started at http://127.9.68.67:42895/ using document root <none> and password file <none>
I20260709 13:18:43.565225 17511 ts_manager.cc:194] Registered new tserver with Master: 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:43.565438  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:43.565711  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:43.566035  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:43.567066 17511 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48206
I20260709 13:18:43.567485  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "b6d175679bc14e39815fb5e1a5820980"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.572688  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:18:43.576071 17724 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.576954  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:18:43.577277  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "b6d175679bc14e39815fb5e1a5820980"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:43.577714  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:43.601701  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:43.602820  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:43.604233  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:43.606478  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:43.606701  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.606938  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:43.607116  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:43.646561  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:44101
I20260709 13:18:43.646708 17786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:44101 every 8 connection(s)
I20260709 13:18:43.660107 17787 heartbeater.cc:344] Connected to a master server at 127.9.68.126:42893
I20260709 13:18:43.660504 17787 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:43.661206 17787 heartbeater.cc:507] Master 127.9.68.126:42893 requested a full tablet report, sending...
I20260709 13:18:43.663100 17511 ts_manager.cc:194] Registered new tserver with Master: b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:43.663425  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013611522s
I20260709 13:18:43.664497 17511 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48214
I20260709 13:18:43.688890 17511 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48216:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:43.692332 17511 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:43.789732 17752 tablet_service.cc:1511] Processing CreateTablet for tablet fff2b1ccd80e429e816837e6dc8fea7f (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:43.791425 17752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2b1ccd80e429e816837e6dc8fea7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.792199 17603 tablet_service.cc:1511] Processing CreateTablet for tablet fff2b1ccd80e429e816837e6dc8fea7f (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:43.792559 17602 tablet_service.cc:1511] Processing CreateTablet for tablet f7aba3a7b7f2478bac6836ed3b3a48c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:43.793813 17603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2b1ccd80e429e816837e6dc8fea7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.794510 17601 tablet_service.cc:1511] Processing CreateTablet for tablet d0ad0762546446568a646bb0f2f63317 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:43.794569 17599 tablet_service.cc:1511] Processing CreateTablet for tablet 491a2afd00a94cccbc196288be48e1c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:43.796548 17600 tablet_service.cc:1511] Processing CreateTablet for tablet 04b88fe4281a4dd0bed87c117e7af1f8 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:43.796644 17598 tablet_service.cc:1511] Processing CreateTablet for tablet ae47c61379ff48b09eeac59d2c64c626 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:43.798292 17601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ad0762546446568a646bb0f2f63317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.798817 17597 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9479af65aa48578dacf85006b55986 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:43.800076 17597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9479af65aa48578dacf85006b55986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.805212 17598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae47c61379ff48b09eeac59d2c64c626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.804972 17596 tablet_service.cc:1511] Processing CreateTablet for tablet ef56dfe1f6cd4221850c66d811479966 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:43.807730 17750 tablet_service.cc:1511] Processing CreateTablet for tablet d0ad0762546446568a646bb0f2f63317 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:43.805449 17751 tablet_service.cc:1511] Processing CreateTablet for tablet f7aba3a7b7f2478bac6836ed3b3a48c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:43.809039 17750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ad0762546446568a646bb0f2f63317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.809202 17594 tablet_service.cc:1511] Processing CreateTablet for tablet 208c90cca5434b09ba42caf0a311ea03 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:43.809710 17751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7aba3a7b7f2478bac6836ed3b3a48c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.807108 17595 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed89f7b90ec431f84dc81ede0a05206 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:43.818884 17749 tablet_service.cc:1511] Processing CreateTablet for tablet 04b88fe4281a4dd0bed87c117e7af1f8 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:43.820132 17749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b88fe4281a4dd0bed87c117e7af1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.830375 17678 tablet_service.cc:1511] Processing CreateTablet for tablet fff2b1ccd80e429e816837e6dc8fea7f (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:43.830996 17748 tablet_service.cc:1511] Processing CreateTablet for tablet 491a2afd00a94cccbc196288be48e1c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:43.831657 17678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff2b1ccd80e429e816837e6dc8fea7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.833377 17747 tablet_service.cc:1511] Processing CreateTablet for tablet ae47c61379ff48b09eeac59d2c64c626 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:43.834434 17673 tablet_service.cc:1511] Processing CreateTablet for tablet ae47c61379ff48b09eeac59d2c64c626 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:43.835767 17673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae47c61379ff48b09eeac59d2c64c626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.836025 17746 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9479af65aa48578dacf85006b55986 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:43.836169 17676 tablet_service.cc:1511] Processing CreateTablet for tablet d0ad0762546446568a646bb0f2f63317 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:43.834336 17677 tablet_service.cc:1511] Processing CreateTablet for tablet f7aba3a7b7f2478bac6836ed3b3a48c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:43.838670 17676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ad0762546446568a646bb0f2f63317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.841701 17744 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed89f7b90ec431f84dc81ede0a05206 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:43.842383 17672 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9479af65aa48578dacf85006b55986 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:43.843787 17672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9479af65aa48578dacf85006b55986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.844660 17743 tablet_service.cc:1511] Processing CreateTablet for tablet 208c90cca5434b09ba42caf0a311ea03 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:43.839221 17671 tablet_service.cc:1511] Processing CreateTablet for tablet ef56dfe1f6cd4221850c66d811479966 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:43.841125 17670 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed89f7b90ec431f84dc81ede0a05206 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:43.846364 17671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef56dfe1f6cd4221850c66d811479966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.846554 17748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491a2afd00a94cccbc196288be48e1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.847069 17670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed89f7b90ec431f84dc81ede0a05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.839409 17745 tablet_service.cc:1511] Processing CreateTablet for tablet ef56dfe1f6cd4221850c66d811479966 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:43.840035 17675 tablet_service.cc:1511] Processing CreateTablet for tablet 04b88fe4281a4dd0bed87c117e7af1f8 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:43.850024 17675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b88fe4281a4dd0bed87c117e7af1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.850466 17669 tablet_service.cc:1511] Processing CreateTablet for tablet 208c90cca5434b09ba42caf0a311ea03 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:43.851836 17669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208c90cca5434b09ba42caf0a311ea03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.853662 17677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7aba3a7b7f2478bac6836ed3b3a48c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.853826 17746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9479af65aa48578dacf85006b55986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.855937 17747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae47c61379ff48b09eeac59d2c64c626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.859385 17743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208c90cca5434b09ba42caf0a311ea03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.845435 17674 tablet_service.cc:1511] Processing CreateTablet for tablet 491a2afd00a94cccbc196288be48e1c0 (DEFAULT_TABLE table=test-workload [id=43be42697a6b44c99a6c8e8dfd615fa4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:43.861028 17744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed89f7b90ec431f84dc81ede0a05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.861611 17674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491a2afd00a94cccbc196288be48e1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.862430 17745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef56dfe1f6cd4221850c66d811479966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.877736 17596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef56dfe1f6cd4221850c66d811479966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.880404 17594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 208c90cca5434b09ba42caf0a311ea03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.882661 17600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b88fe4281a4dd0bed87c117e7af1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.885680 17602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7aba3a7b7f2478bac6836ed3b3a48c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.892814 17803 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:43.895633 17599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491a2afd00a94cccbc196288be48e1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.905615 17595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed89f7b90ec431f84dc81ede0a05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.981993 17802 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:43.985704 17804 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:43.998435 17804 tablet_bootstrap.cc:654] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.000669 17802 tablet_bootstrap.cc:654] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.004905 17803 tablet_bootstrap.cc:654] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.014266 17804 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.015129 17804 ts_tablet_manager.cc:1403] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.004s
I20260709 13:18:44.020167 17804 raft_consensus.cc:359] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.021253 17804 raft_consensus.cc:385] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.021685 17804 raft_consensus.cc:740] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.022735 17804 consensus_queue.cc:260] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.028347 17713 heartbeater.cc:499] Master 127.9.68.126:42893 was elected leader, sending a full tablet report...
I20260709 13:18:44.030167 17802 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.030519 17803 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.030535 17802 ts_tablet_manager.cc:1403] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.010s
I20260709 13:18:44.031265 17803 ts_tablet_manager.cc:1403] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.004s
I20260709 13:18:44.033201 17804 ts_tablet_manager.cc:1434] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 13:18:44.033381 17802 raft_consensus.cc:359] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.033922 17802 raft_consensus.cc:385] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.034108 17802 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.034266 17804 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.034673 17802 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.035774 17803 raft_consensus.cc:359] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.036743 17803 raft_consensus.cc:385] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.037119 17803 raft_consensus.cc:740] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.038161 17803 consensus_queue.cc:260] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.041038 17804 tablet_bootstrap.cc:654] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.044204 17802 ts_tablet_manager.cc:1434] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:18:44.045107 17638 heartbeater.cc:499] Master 127.9.68.126:42893 was elected leader, sending a full tablet report...
I20260709 13:18:44.048050 17787 heartbeater.cc:499] Master 127.9.68.126:42893 was elected leader, sending a full tablet report...
I20260709 13:18:44.050349 17804 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.050840 17804 ts_tablet_manager.cc:1403] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:18:44.051371 17802 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.053819 17804 raft_consensus.cc:359] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.054524 17804 raft_consensus.cc:385] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.054819 17804 raft_consensus.cc:740] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.055815 17804 consensus_queue.cc:260] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.057704 17809 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.057936 17804 ts_tablet_manager.cc:1434] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:44.058383 17809 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.058986 17804 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.066233 17804 tablet_bootstrap.cc:654] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.051371 17803 ts_tablet_manager.cc:1434] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:18:44.068830 17803 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.084973 17809 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.086550 17802 tablet_bootstrap.cc:654] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.086961 17803 tablet_bootstrap.cc:654] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.088047 17804 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.088543 17804 ts_tablet_manager.cc:1403] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 13:18:44.092623 17804 raft_consensus.cc:359] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.093199 17802 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.093400 17804 raft_consensus.cc:385] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.093745 17802 ts_tablet_manager.cc:1403] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.002s
I20260709 13:18:44.093839 17804 raft_consensus.cc:740] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.094807 17804 consensus_queue.cc:260] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.096930 17804 ts_tablet_manager.cc:1434] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:44.096647 17802 raft_consensus.cc:359] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.097405 17802 raft_consensus.cc:385] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.097703 17802 raft_consensus.cc:740] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.098166 17804 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.098438 17802 consensus_queue.cc:260] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.100486 17802 ts_tablet_manager.cc:1434] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:44.106142 17804 tablet_bootstrap.cc:654] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.109576 17803 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.110021 17803 ts_tablet_manager.cc:1403] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 13:18:44.112797 17803 raft_consensus.cc:359] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.113469 17803 raft_consensus.cc:385] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.113765 17803 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.114835 17803 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.117892 17802 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.126252 17803 ts_tablet_manager.cc:1434] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:44.127179 17803 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.129544 17802 tablet_bootstrap.cc:654] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.134042 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.134651 17803 tablet_bootstrap.cc:654] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.134510 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
W20260709 13:18:44.135545 17576 leader_election.cc:343] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:44.136302 17576 leader_election.cc:343] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.136739 17576 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.137645 17811 raft_consensus.cc:2749] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.140443 17804 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.141063 17804 ts_tablet_manager.cc:1403] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.017s
I20260709 13:18:44.143431 17803 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.143862 17803 ts_tablet_manager.cc:1403] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.007s
I20260709 13:18:44.143885 17802 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.144465 17802 ts_tablet_manager.cc:1403] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.011s
I20260709 13:18:44.144225 17804 raft_consensus.cc:359] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.144941 17804 raft_consensus.cc:385] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.145262 17804 raft_consensus.cc:740] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.146018 17804 consensus_queue.cc:260] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.146449 17803 raft_consensus.cc:359] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.147095 17803 raft_consensus.cc:385] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.147387 17803 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.147346 17802 raft_consensus.cc:359] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.148240 17802 raft_consensus.cc:385] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.148240 17804 ts_tablet_manager.cc:1434] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:18:44.148675 17802 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.148442 17803 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.149418 17804 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.149578 17802 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.150745 17803 ts_tablet_manager.cc:1434] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:18:44.151669 17803 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.156087 17802 ts_tablet_manager.cc:1434] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:18:44.157099 17802 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.157716 17803 tablet_bootstrap.cc:654] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.157832 17804 tablet_bootstrap.cc:654] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.164124 17802 tablet_bootstrap.cc:654] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.166782 17804 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.167339 17804 ts_tablet_manager.cc:1403] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:18:44.171118 17804 raft_consensus.cc:359] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.172066 17804 raft_consensus.cc:385] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.172504 17804 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.174953 17804 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.177935 17803 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.178144 17804 ts_tablet_manager.cc:1434] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:18:44.178442 17803 ts_tablet_manager.cc:1403] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:18:44.179694 17804 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.183789 17803 raft_consensus.cc:359] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.184484 17803 raft_consensus.cc:385] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.184775 17803 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.185570 17803 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.188581 17804 tablet_bootstrap.cc:654] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.189726 17803 ts_tablet_manager.cc:1434] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:18:44.190757 17803 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.191468 17802 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.191993 17802 ts_tablet_manager.cc:1403] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.011s
I20260709 13:18:44.195643 17802 raft_consensus.cc:359] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.196641 17802 raft_consensus.cc:385] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.197050 17802 raft_consensus.cc:740] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.198639 17803 tablet_bootstrap.cc:654] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.198071 17802 consensus_queue.cc:260] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.200152 17810 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.200668 17810 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.201761 17804 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.202452 17804 ts_tablet_manager.cc:1403] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:18:44.205763 17804 raft_consensus.cc:359] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.206485 17804 raft_consensus.cc:385] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.206781 17804 raft_consensus.cc:740] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.207563 17811 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.207619 17804 consensus_queue.cc:260] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.208201 17811 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.210206 17811 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.210296 17804 ts_tablet_manager.cc:1434] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:18:44.212299 17802 ts_tablet_manager.cc:1434] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:18:44.212361 17804 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.213119 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.214989 17802 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
W20260709 13:18:44.216205 17576 leader_election.cc:343] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.220772 17803 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.221352 17803 ts_tablet_manager.cc:1403] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:18:44.221628 17802 tablet_bootstrap.cc:654] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.221943 17804 tablet_bootstrap.cc:654] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.222944 17807 raft_consensus.cc:493] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.223443 17807 raft_consensus.cc:515] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.224962 17803 raft_consensus.cc:359] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.225936 17803 raft_consensus.cc:385] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.225880 17810 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.226682 17803 raft_consensus.cc:740] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.227696 17803 consensus_queue.cc:260] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.230631 17807 leader_election.cc:290] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.247473 17803 ts_tablet_manager.cc:1434] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:18:44.248592 17803 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.250880 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.251581 17762 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.252108 17804 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.252835 17804 ts_tablet_manager.cc:1403] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.006s
I20260709 13:18:44.252754 17576 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:44.253764 17811 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.254168 17811 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.254745 17810 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.254796 17811 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.255277 17810 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.257431 17810 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.261101 17803 tablet_bootstrap.cc:654] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.265542 17802 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.266031 17802 ts_tablet_manager.cc:1403] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.027s
I20260709 13:18:44.266206 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.262292 17811 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
W20260709 13:18:44.267629 17651 leader_election.cc:343] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.256640 17804 raft_consensus.cc:359] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.268581 17804 raft_consensus.cc:385] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.268882 17804 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.269743 17804 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.270733 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.272236 17804 ts_tablet_manager.cc:1434] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:18:44.272912 17811 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.273278 17804 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
W20260709 13:18:44.273625 17576 leader_election.cc:343] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.275807 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.276729 17802 raft_consensus.cc:359] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.277496 17802 raft_consensus.cc:385] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.277787 17802 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.278509 17802 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.279089 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.279702 17762 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.280304 17804 tablet_bootstrap.cc:654] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:44.281097 17654 leader_election.cc:343] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.281567 17654 leader_election.cc:304] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1; no voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:44.282661 17807 raft_consensus.cc:2749] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.282779 17802 ts_tablet_manager.cc:1434] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:18:44.284169 17802 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.284379 17803 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.284759 17811 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.285269 17811 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.287283 17811 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
W20260709 13:18:44.290562 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:44.291080 17802 tablet_bootstrap.cc:654] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.291373 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.291998 17688 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.293232 17576 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.294500 17811 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.294840 17811 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.295172 17811 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.296742 17804 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.297387 17804 ts_tablet_manager.cc:1403] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:18:44.300220 17762 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.300796 17804 raft_consensus.cc:359] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.301616 17804 raft_consensus.cc:385] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.301865 17804 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.302836 17802 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.302558 17576 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:44.302618 17804 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.303789 17809 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.303941 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.304598 17762 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.304719 17811 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.305270 17804 ts_tablet_manager.cc:1434] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:44.308216 17802 ts_tablet_manager.cc:1403] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:18:44.315805 17811 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.316437 17811 raft_consensus.cc:493] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.312536 17803 ts_tablet_manager.cc:1403] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.005s
I20260709 13:18:44.314152 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.317715 17688 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.317811 17804 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.314536 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.318608 17687 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.319041 17725 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.319883 17810 raft_consensus.cc:2804] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.320281 17810 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.319990 17803 raft_consensus.cc:359] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.320751 17807 raft_consensus.cc:493] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.320695 17810 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.321484 17807 raft_consensus.cc:515] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.316847 17811 raft_consensus.cc:515] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.323928 17807 leader_election.cc:290] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.324738 17811 leader_election.cc:290] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.324887 17802 raft_consensus.cc:359] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.325641 17802 raft_consensus.cc:385] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.325560 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.326059 17802 raft_consensus.cc:740] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.326839 17802 consensus_queue.cc:260] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
W20260709 13:18:44.327078 17654 leader_election.cc:343] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.327173 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
W20260709 13:18:44.328372 17651 leader_election.cc:343] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.328534 17725 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.328859 17651 leader_election.cc:304] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1; no voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:44.328959 17802 ts_tablet_manager.cc:1434] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260709 13:18:44.329674 17807 raft_consensus.cc:2749] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.327708 17810 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.330677 17802 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.332365 17810 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.320832 17803 raft_consensus.cc:385] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.333439 17804 tablet_bootstrap.cc:654] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.334523 17810 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.336045 17810 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.336856 17810 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.334218 17803 raft_consensus.cc:740] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.338524 17809 raft_consensus.cc:697] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.338258 17803 consensus_queue.cc:260] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.338759 17802 tablet_bootstrap.cc:654] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.339447 17809 consensus_queue.cc:237] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.341588 17837 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.342187 17837 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.344547 17837 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.346503 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.347239 17687 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.353760 17810 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.356448 17687 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.358258 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.360196 17762 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.360348 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.358481 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.361852 17688 raft_consensus.cc:2468] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.364378 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.365072 17688 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.367306 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.369529 17762 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.369562 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.371335 17613 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.373001 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.373839 17612 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.375126 17810 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.375830 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:44.376546 17612 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.376701 17810 raft_consensus.cc:493] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.378120 17810 raft_consensus.cc:515] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.383746 17810 leader_election.cc:290] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.386140 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:44.386853 17613 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.396054 17613 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
W20260709 13:18:44.397372 17725 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:39059, user_credentials={real_user=slave}} blocked reactor thread for 68900.9us
W20260709 13:18:44.398265 17576 leader_election.cc:343] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:44.399124 17576 leader_election.cc:343] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.399417 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.399912 17576 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.400231 17687 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.401000 17836 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.401533 17836 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.403690 17576 leader_election.cc:304] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.407881 17612 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.409256 17836 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.409786 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.410573 17688 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.411808 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7aba3a7b7f2478bac6836ed3b3a48c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.412271 17804 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.412727 17804 ts_tablet_manager.cc:1403] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.095s	user 0.029s	sys 0.015s
I20260709 13:18:44.414891 17811 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.415676 17804 raft_consensus.cc:359] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.416535 17804 raft_consensus.cc:385] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.416846 17804 raft_consensus.cc:740] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.417677 17804 consensus_queue.cc:260] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.419898 17687 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.420419 17836 raft_consensus.cc:2804] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.420657 17803 ts_tablet_manager.cc:1434] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.033s
I20260709 13:18:44.427413 17725 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.422330 17688 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.424589 17804 ts_tablet_manager.cc:1434] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:18:44.425151 17686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7aba3a7b7f2478bac6836ed3b3a48c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.428999 17836 raft_consensus.cc:493] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.429425 17686 raft_consensus.cc:2468] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.429715 17804 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: Bootstrap starting.
I20260709 13:18:44.429818 17840 raft_consensus.cc:2804] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.429407 17836 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.430701 17840 raft_consensus.cc:697] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:44.431952 17840 consensus_queue.cc:237] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:44.425308 17576 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.435231 17804 tablet_bootstrap.cc:654] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.428722 17803 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.436321 17843 raft_consensus.cc:2804] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.436709 17843 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.437032 17843 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.439966 17728 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.440961 17838 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.441403 17838 raft_consensus.cc:697] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:44.442121 17803 tablet_bootstrap.cc:654] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.442696 17802 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.442203 17838 consensus_queue.cc:237] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.443181 17802 ts_tablet_manager.cc:1403] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.065s
I20260709 13:18:44.446664 17802 raft_consensus.cc:359] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.446738 17843 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.447173 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.428511 17811 raft_consensus.cc:697] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.447479 17836 raft_consensus.cc:515] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.448058 17688 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.448421 17811 consensus_queue.cc:237] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.449594 17836 leader_election.cc:290] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.434906 17725 leader_election.cc:304] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.448895 17843 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.453066 17810 raft_consensus.cc:2804] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.447404 17802 raft_consensus.cc:385] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.453580 17810 raft_consensus.cc:493] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.453722 17802 raft_consensus.cc:740] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.453991 17810 raft_consensus.cc:3060] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.454650 17802 consensus_queue.cc:260] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.457084 17802 ts_tablet_manager.cc:1434] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:18:44.459860 17728 leader_election.cc:343] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.470433 17802 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.470454 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.465186 17509 catalog_manager.cc:5697] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.466831 17686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.472409 17686 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.462054 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.474979 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.476702 17804 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: No bootstrap required, opened a new log
I20260709 13:18:44.477216 17804 ts_tablet_manager.cc:1403] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.015s
I20260709 13:18:44.479508 17802 tablet_bootstrap.cc:654] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.480212 17804 raft_consensus.cc:359] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.480947 17804 raft_consensus.cc:385] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.481240 17804 raft_consensus.cc:740] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.482064 17804 consensus_queue.cc:260] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.487519 17810 raft_consensus.cc:515] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.488457 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.495739 17687 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.489869 17804 ts_tablet_manager.cc:1434] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:18:44.501396 17802 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.501951 17802 ts_tablet_manager.cc:1403] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.003s
I20260709 13:18:44.491993 17686 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
W20260709 13:18:44.492875 17576 leader_election.cc:343] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:44.503476 17576 leader_election.cc:343] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:44.471011 17803 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.503849 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7aba3a7b7f2478bac6836ed3b3a48c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.504380 17803 ts_tablet_manager.cc:1403] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.010s
I20260709 13:18:44.504268 17576 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.504575 17802 raft_consensus.cc:359] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.505913 17802 raft_consensus.cc:385] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.506021 17811 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:44.506196 17802 raft_consensus.cc:740] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.506431 17811 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.506793 17811 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.506927 17802 consensus_queue.cc:260] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.508023 17803 raft_consensus.cc:359] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.508854 17803 raft_consensus.cc:385] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.509169 17803 raft_consensus.cc:740] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.510018 17803 consensus_queue.cc:260] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.509881 17688 raft_consensus.cc:3060] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.509930 17802 ts_tablet_manager.cc:1434] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:44.511933 17802 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.512472 17803 ts_tablet_manager.cc:1434] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:44.514303 17576 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.505460 17810 leader_election.cc:290] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.515440 17803 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.517226 17802 tablet_bootstrap.cc:654] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.516248 17811 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.519224 17811 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 2 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.519820 17688 raft_consensus.cc:2468] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.525729 17843 raft_consensus.cc:2804] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.526273 17843 raft_consensus.cc:697] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.526494 17687 raft_consensus.cc:2468] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.526968 17725 leader_election.cc:304] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.527101 17843 consensus_queue.cc:237] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.527662 17810 raft_consensus.cc:2804] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.528154 17810 raft_consensus.cc:697] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:44.522639 17802 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.524850 17803 tablet_bootstrap.cc:654] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.524000 17508 catalog_manager.cc:5697] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.529278 17802 ts_tablet_manager.cc:1403] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:18:44.529002 17810 consensus_queue.cc:237] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.530171 17508 catalog_manager.cc:5697] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.531912 17802 raft_consensus.cc:359] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.532784 17802 raft_consensus.cc:385] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.533123 17802 raft_consensus.cc:740] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.533577 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.534343 17687 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.533936 17802 consensus_queue.cc:260] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.534494 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.536721 17802 ts_tablet_manager.cc:1434] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:44.537964 17802 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:44.542284 17576 leader_election.cc:304] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.542385 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7aba3a7b7f2478bac6836ed3b3a48c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:44.543023 17613 raft_consensus.cc:3060] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.544962 17802 tablet_bootstrap.cc:654] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.549218 17811 raft_consensus.cc:2804] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.549901 17811 raft_consensus.cc:697] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.550625 17803 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.551144 17803 ts_tablet_manager.cc:1403] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:18:44.550961 17811 consensus_queue.cc:237] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.554127 17803 raft_consensus.cc:359] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.554937 17803 raft_consensus.cc:385] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.555323 17803 raft_consensus.cc:740] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.556406 17803 consensus_queue.cc:260] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.557629 17687 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 2.
I20260709 13:18:44.558764 17803 ts_tablet_manager.cc:1434] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:44.558728 17576 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:44.559382 17613 raft_consensus.cc:2468] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.559927 17803 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.559865 17843 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:44.560542 17843 raft_consensus.cc:697] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.561350 17843 consensus_queue.cc:237] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.570096 17508 catalog_manager.cc:5697] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.572024 17803 tablet_bootstrap.cc:654] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.572407 17508 catalog_manager.cc:5697] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.577790 17810 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.578503 17810 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.582083 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.586242 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.587266 17687 raft_consensus.cc:2393] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6d175679bc14e39815fb5e1a5820980 in current term 1: Already voted for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in this term.
I20260709 13:18:44.588694 17725 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980; no voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:44.589927 17840 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.590225 17810 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.591377 17807 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.591946 17807 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.593930 17807 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.594959 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.595281 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.595733 17761 raft_consensus.cc:2393] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e631a23e41e4bf6b00af373f72b9ef1 in current term 1: Already voted for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in this term.
I20260709 13:18:44.596982 17802 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: No bootstrap required, opened a new log
I20260709 13:18:44.596910 17651 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1; no voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:44.597496 17802 ts_tablet_manager.cc:1403] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.028s
I20260709 13:18:44.588737 17510 catalog_manager.cc:5697] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.599666 17802 raft_consensus.cc:359] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.600186 17802 raft_consensus.cc:385] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.597749 17807 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.600401 17802 raft_consensus.cc:740] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.601454 17840 raft_consensus.cc:2749] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.602149 17802 consensus_queue.cc:260] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.604465 17802 ts_tablet_manager.cc:1434] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:18:44.607939 17803 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.608489 17803 ts_tablet_manager.cc:1403] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.028s
I20260709 13:18:44.611842 17807 raft_consensus.cc:2749] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:44.612720 17508 catalog_manager.cc:5697] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.614014 17508 catalog_manager.cc:5697] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 1 to 2, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.614369 17803 raft_consensus.cc:359] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.615110 17803 raft_consensus.cc:385] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.615396 17803 raft_consensus.cc:740] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.615957 17803 consensus_queue.cc:260] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.618060 17803 ts_tablet_manager.cc:1434] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:18:44.618909 17803 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: Bootstrap starting.
I20260709 13:18:44.624451 17803 tablet_bootstrap.cc:654] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:44.629169 17803 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: No bootstrap required, opened a new log
I20260709 13:18:44.629654 17803 ts_tablet_manager.cc:1403] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:18:44.631508 17803 raft_consensus.cc:359] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.631961 17803 raft_consensus.cc:385] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:44.632130 17803 raft_consensus.cc:740] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Initialized, Role: FOLLOWER
I20260709 13:18:44.632599 17803 consensus_queue.cc:260] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.634112 17803 ts_tablet_manager.cc:1434] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:18:44.720126 17807 raft_consensus.cc:493] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.720811 17807 raft_consensus.cc:515] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.722666 17807 leader_election.cc:290] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.723392 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b88fe4281a4dd0bed87c117e7af1f8" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.723817 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b88fe4281a4dd0bed87c117e7af1f8" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.723981 17613 raft_consensus.cc:2468] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 0.
I20260709 13:18:44.724440 17761 raft_consensus.cc:2468] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 0.
I20260709 13:18:44.725023 17654 leader_election.cc:304] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.725924 17807 raft_consensus.cc:2804] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.726279 17807 raft_consensus.cc:493] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.726562 17807 raft_consensus.cc:3060] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.732180 17807 raft_consensus.cc:515] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.733743 17807 leader_election.cc:290] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.734411 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b88fe4281a4dd0bed87c117e7af1f8" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:44.734984 17613 raft_consensus.cc:3060] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.734978 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b88fe4281a4dd0bed87c117e7af1f8" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.735917 17761 raft_consensus.cc:3060] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.739992 17613 raft_consensus.cc:2468] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 1.
I20260709 13:18:44.740967 17654 leader_election.cc:304] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.741636 17807 raft_consensus.cc:2804] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.741596 17761 raft_consensus.cc:2468] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 1.
I20260709 13:18:44.742929 17807 raft_consensus.cc:697] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:44.743696 17807 consensus_queue.cc:237] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.751573 17510 catalog_manager.cc:5697] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.788959 17811 raft_consensus.cc:493] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.789532 17811 raft_consensus.cc:515] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.790062 17840 raft_consensus.cc:493] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.790648 17840 raft_consensus.cc:515] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.791239 17811 leader_election.cc:290] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.792282 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.792905 17687 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.792850 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:44.793696 17761 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 0.
I20260709 13:18:44.793769 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" is_pre_election: true
I20260709 13:18:44.794157 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.792918 17840 leader_election.cc:290] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.794371 17576 leader_election.cc:304] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.795013 17688 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.794981 17613 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 0.
I20260709 13:18:44.795521 17811 raft_consensus.cc:2804] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.795979 17811 raft_consensus.cc:493] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.796360 17811 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.796415 17728 leader_election.cc:304] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.797279 17840 raft_consensus.cc:2804] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:44.797659 17840 raft_consensus.cc:493] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.797947 17840 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.802630 17840 raft_consensus.cc:515] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.802810 17811 raft_consensus.cc:515] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.804884 17811 leader_election.cc:290] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Requested vote from peers 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:44.805413 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.806023 17688 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.806102 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:44.806543 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:44.806725 17687 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.807117 17613 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.806140 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:44.807905 17761 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:44.813814 17688 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.814834 17840 leader_election.cc:290] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.814996 17725 leader_election.cc:304] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:44.815023 17613 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:44.814741 17761 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.814741 17687 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in term 1.
I20260709 13:18:44.816044 17840 raft_consensus.cc:2804] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.816717 17840 raft_consensus.cc:697] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:44.816752 17576 leader_election.cc:304] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:44.817665 17811 raft_consensus.cc:2804] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:44.818250 17811 raft_consensus.cc:697] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Running, Role: LEADER
I20260709 13:18:44.817685 17840 consensus_queue.cc:237] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.819132 17811 consensus_queue.cc:237] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.829154 17836 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.830123 17510 catalog_manager.cc:5697] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.830886 17508 catalog_manager.cc:5697] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.833684 17836 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.861308 17843 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.871533 17843 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.893144  9489 ts_manager.cc:295] Set tserver state for e8ce03c3ff5f4d83ba149697e2ce7837 to MAINTENANCE_MODE
I20260709 13:18:44.893997  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:18:44.916136  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:44.917752  9489 tablet_replica.cc:333] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.918535  9489 raft_consensus.cc:2243] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.918994  9489 raft_consensus.cc:2272] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.919981 17840 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.922031  9489 tablet_replica.cc:333] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.922780  9489 raft_consensus.cc:2243] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.923252  9489 raft_consensus.cc:2272] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.925673  9489 tablet_replica.cc:333] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.926450  9489 raft_consensus.cc:2243] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.927125  9489 pending_rounds.cc:70] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Trying to abort 1 pending ops.
I20260709 13:18:44.927345  9489 pending_rounds.cc:77] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638399268372480 op_type: NO_OP noop_request { }
I20260709 13:18:44.927786  9489 raft_consensus.cc:2889] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:44.928122  9489 raft_consensus.cc:2272] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.933908  9489 tablet_replica.cc:333] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.934716  9489 raft_consensus.cc:2243] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.935453  9489 pending_rounds.cc:70] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Trying to abort 1 pending ops.
I20260709 13:18:44.935860  9489 pending_rounds.cc:77] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638398175297536 op_type: NO_OP noop_request { }
I20260709 13:18:44.936218  9489 raft_consensus.cc:2889] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:44.936609  9489 raft_consensus.cc:2272] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.939752  9489 tablet_replica.cc:333] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.940605  9489 raft_consensus.cc:2243] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.941075  9489 raft_consensus.cc:2272] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.945163 17688 raft_consensus.cc:1240] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Rejecting Update request from peer b6d175679bc14e39815fb5e1a5820980 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:44.945501 17810 consensus_queue.cc:1048] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.946945 17810 consensus_queue.cc:1059] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:44.947700 17810 raft_consensus.cc:3055] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:44.948016 17810 raft_consensus.cc:740] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:44.948942 17810 consensus_queue.cc:260] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.949231  9489 tablet_replica.cc:333] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.950357 17810 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.951345  9489 raft_consensus.cc:2243] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.952116  9489 pending_rounds.cc:70] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Trying to abort 1 pending ops.
I20260709 13:18:44.952384  9489 pending_rounds.cc:77] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638398072324096 op_type: NO_OP noop_request { }
I20260709 13:18:44.952708  9489 raft_consensus.cc:2889] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:44.952998  9489 raft_consensus.cc:2272] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.955796  9489 tablet_replica.cc:333] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
W20260709 13:18:44.956056 17728 consensus_peers.cc:597] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:44.956511  9489 raft_consensus.cc:2243] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.957566  9489 raft_consensus.cc:2272] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.960511  9489 tablet_replica.cc:333] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.961150  9489 raft_consensus.cc:2243] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.961997  9489 pending_rounds.cc:70] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Trying to abort 1 pending ops.
I20260709 13:18:44.962250  9489 pending_rounds.cc:77] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7305638398212337664 op_type: NO_OP noop_request { }
I20260709 13:18:44.962598  9489 raft_consensus.cc:2889] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:44.963069  9489 raft_consensus.cc:2272] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.966070  9489 tablet_replica.cc:333] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.967576  9489 raft_consensus.cc:2243] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:44.968581  9489 raft_consensus.cc:2272] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.971853  9489 tablet_replica.cc:333] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: stopping tablet replica
I20260709 13:18:44.972486  9489 raft_consensus.cc:2243] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.972914  9489 raft_consensus.cc:2272] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:44.974633 17728 consensus_peers.cc:597] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:44.989279 17838 raft_consensus.cc:493] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.989885 17838 raft_consensus.cc:515] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:44.993631 17838 leader_election.cc:290] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:44.994669 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:44.995368 17688 raft_consensus.cc:2393] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6d175679bc14e39815fb5e1a5820980 in current term 1: Already voted for candidate e8ce03c3ff5f4d83ba149697e2ce7837 in this term.
W20260709 13:18:44.997110 17728 leader_election.cc:336] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:44.997550 17728 leader_election.cc:304] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980; no voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:44.998168 17838 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:45.002846 17838 raft_consensus.cc:2749] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:45.005206  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
W20260709 13:18:45.291630 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:45.320837 17654 consensus_peers.cc:597] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.320936 17807 consensus_queue.cc:1048] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:45.324968 17728 consensus_peers.cc:597] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.335309 17838 consensus_queue.cc:1048] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:46.259737 17783 debug-util.cc:398] Leaking SignalData structure 0x7b080021ec60 after lost signal to thread 9492
W20260709 13:18:46.261191 17783 debug-util.cc:398] Leaking SignalData structure 0x7b080015c8a0 after lost signal to thread 17545
W20260709 13:18:46.262778 17783 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5440 after lost signal to thread 17712
W20260709 13:18:46.264114 17783 debug-util.cc:398] Leaking SignalData structure 0x7b0800140fe0 after lost signal to thread 17786
W20260709 13:18:46.293480 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:46.351097 17879 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8ce03c3ff5f4d83ba149697e2ce7837)
I20260709 13:18:46.352403 17879 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.355973 17879 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.357395 17810 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8ce03c3ff5f4d83ba149697e2ce7837)
I20260709 13:18:46.358336 17810 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.358887 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:46.362444 17810 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.363862 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:46.364807 17688 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
W20260709 13:18:46.364799 17654 leader_election.cc:336] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.366222 17654 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1; no voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.366621 17725 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
W20260709 13:18:46.367660 17728 leader_election.cc:336] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.367733 17810 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.367249 17879 raft_consensus.cc:2749] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.368319 17810 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8ce03c3ff5f4d83ba149697e2ce7837)
I20260709 13:18:46.368789 17810 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.375128 17887 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8ce03c3ff5f4d83ba149697e2ce7837)
I20260709 13:18:46.375808 17887 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.378264 17887 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.379204 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:46.379951 17688 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 1.
I20260709 13:18:46.381424 17725 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:46.382619 17879 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.383625 17879 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.385555 17810 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.387612 17810 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.385535 17890 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.390000 17890 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8ce03c3ff5f4d83ba149697e2ce7837)
I20260709 13:18:46.390355 17890 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:46.392833 17654 leader_election.cc:336] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.394205 17879 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.396253 17879 raft_consensus.cc:493] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.396965 17879 raft_consensus.cc:515] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.399247 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:46.399778 17890 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.400745 17761 raft_consensus.cc:2410] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e631a23e41e4bf6b00af373f72b9ef1 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:18:46.402491 17890 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.394358 17891 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.395677 17728 leader_election.cc:336] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.406080 17891 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.408861 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:46.409579 17688 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.409422 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:46.410168 17687 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.411257 17651 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1; no voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837
W20260709 13:18:46.412061 17654 leader_election.cc:336] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
W20260709 13:18:46.413522 17728 leader_election.cc:336] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.414094 17892 raft_consensus.cc:2749] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.413798 17879 leader_election.cc:290] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.416203 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:46.416945 17761 raft_consensus.cc:2468] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 1.
W20260709 13:18:46.417447 17654 leader_election.cc:336] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.418277 17651 leader_election.cc:304] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.419137 17892 raft_consensus.cc:2804] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:46.419267 17728 leader_election.cc:336] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.419549 17892 raft_consensus.cc:493] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.419633 17688 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 2.
I20260709 13:18:46.419970 17892 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.420085 17891 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.421576 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
I20260709 13:18:46.422484 17761 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 1.
I20260709 13:18:46.423481 17687 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 2.
I20260709 13:18:46.423880 17725 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.424921 17651 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.425261 17725 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.425804 17891 raft_consensus.cc:2804] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.426184 17891 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.426522 17890 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.426525 17891 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.427349 17890 raft_consensus.cc:697] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:46.428347 17892 raft_consensus.cc:515] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.428653 17890 consensus_queue.cc:237] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.432667 17810 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.434942 17891 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
W20260709 13:18:46.435261 17654 leader_election.cc:336] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.436921 17891 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.438684 17761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef56dfe1f6cd4221850c66d811479966" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:46.439236 17761 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:46.441433 17654 leader_election.cc:336] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.436306 17892 leader_election.cc:290] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.443723 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:46.444356 17762 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.447960 17761 raft_consensus.cc:2468] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:46.449622 17651 leader_election.cc:304] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.450456 17891 raft_consensus.cc:2804] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.450958 17891 raft_consensus.cc:697] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:46.451974 17891 consensus_queue.cc:237] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.460211 17762 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:46.463883 17651 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.465530 17892 raft_consensus.cc:2804] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.466250 17892 raft_consensus.cc:697] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:46.467566 17892 consensus_queue.cc:237] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.474280 17810 raft_consensus.cc:697] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:46.475806 17810 consensus_queue.cc:237] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.483990 17508 catalog_manager.cc:5697] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 1 to 2, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.489337 17509 catalog_manager.cc:5697] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 1 to 2, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.491770 17509 catalog_manager.cc:5697] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 1 to 2, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.506798 17509 catalog_manager.cc:5697] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 1 to 2, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.695075 17892 raft_consensus.cc:493] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.695724 17892 raft_consensus.cc:515] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.697438 17892 leader_election.cc:290] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.698621 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980" is_pre_election: true
W20260709 13:18:46.698876 17654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111) [suppressed 116 similar messages]
I20260709 13:18:46.699501 17762 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 1.
I20260709 13:18:46.700626 17651 leader_election.cc:304] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:46.701469 17892 raft_consensus.cc:2804] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.701889 17892 raft_consensus.cc:493] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.701721 17654 leader_election.cc:336] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.702273 17892 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.709246 17892 raft_consensus.cc:515] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.710873 17892 leader_election.cc:290] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:46.711942 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "208c90cca5434b09ba42caf0a311ea03" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:46.712509 17762 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:46.714790 17654 leader_election.cc:336] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.718394 17762 raft_consensus.cc:2468] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:46.719295 17651 leader_election.cc:304] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.719940 17892 raft_consensus.cc:2804] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.720382 17892 raft_consensus.cc:697] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:46.721304 17892 consensus_queue.cc:237] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.729475 17509 catalog_manager.cc:5697] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 1 to 2, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.750003 17810 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.750728 17810 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.752751 17810 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.754007 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" is_pre_election: true
I20260709 13:18:46.754791 17687 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 2.
I20260709 13:18:46.756088 17725 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:46.756973 17810 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:46.757567 17810 raft_consensus.cc:493] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.757489 17728 leader_election.cc:336] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.758219 17810 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.764346 17810 raft_consensus.cc:515] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.766325 17810 leader_election.cc:290] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:46.767580 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9479af65aa48578dacf85006b55986" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:46.768210 17687 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:46.770125 17728 leader_election.cc:336] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111)
I20260709 13:18:46.775631 17687 raft_consensus.cc:2468] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 3.
I20260709 13:18:46.776710 17725 leader_election.cc:304] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: e8ce03c3ff5f4d83ba149697e2ce7837
I20260709 13:18:46.777365 17810 raft_consensus.cc:2804] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:46.777849 17810 raft_consensus.cc:697] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:46.778831 17810 consensus_queue.cc:237] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:46.786921 17509 catalog_manager.cc:5697] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 2 to 3, leader changed from e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:46.816346 17728 consensus_peers.cc:597] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.818570 17688 raft_consensus.cc:1275] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.819792 17810 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:46.899699 17654 consensus_peers.cc:597] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.914296 17654 consensus_peers.cc:597] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.919143 17762 raft_consensus.cc:1275] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:46.920457 17892 consensus_queue.cc:1048] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:46.965615 17728 consensus_peers.cc:597] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.047731 17762 raft_consensus.cc:1275] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:47.049439 17892 consensus_queue.cc:1048] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:47.095851 17688 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.097947 17810 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.101478 17762 raft_consensus.cc:1275] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:47.103046 17879 consensus_queue.cc:1048] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:47.121146 17654 consensus_peers.cc:597] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.294778 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:47.303840 17688 raft_consensus.cc:1275] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:47.305117 17810 consensus_queue.cc:1048] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:47.324323 17728 consensus_peers.cc:597] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.411557 17728 consensus_peers.cc:597] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.616473 17728 consensus_peers.cc:597] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.693004 17728 consensus_peers.cc:597] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.899891 17654 consensus_peers.cc:597] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.295624 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:49.076383 17654 consensus_peers.cc:597] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.193112 17728 consensus_peers.cc:597] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.205224 17654 consensus_peers.cc:597] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.296566 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:49.416692 17654 consensus_peers.cc:597] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.440696 17728 consensus_peers.cc:597] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:49.782016 17728 consensus_peers.cc:597] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.051272 17728 consensus_peers.cc:597] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.147433 17728 consensus_peers.cc:597] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:50.249934  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:50.259310 17916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:50.261770 17917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:50.262873  9489 server_base.cc:1061] running on GCE node
W20260709 13:18:50.264391 17919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:50.265452  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:50.265710  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:50.265925  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603130265903 us; error 0 us; skew 500 ppm
I20260709 13:18:50.266479  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:50.269199  9489 webserver.cc:533] Webserver started at http://127.9.68.65:33571/ using document root <none> and password file <none>
I20260709 13:18:50.269775  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:50.269984  9489 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:50.273923  9489 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:50.277966 17924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:50.278824  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:18:50.279071  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
format_stamp: "Formatted at 2026-07-09 13:18:43 on dist-test-slave-9s6w"
I20260709 13:18:50.279369  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:18:50.297937 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:50.302546 17728 consensus_peers.cc:597] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:50.304409  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:50.306048  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:50.307878  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:50.311513 17931 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:18:50.364255  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:18:50.364609  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:18:50.365057  9489 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:18:50.370369 17931 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.384590 17931 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:50.385424 17931 tablet_bootstrap.cc:492] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.385982 17931 ts_tablet_manager.cc:1403] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:18:50.388163 17931 raft_consensus.cc:359] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.388844 17931 raft_consensus.cc:740] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.389518 17931 consensus_queue.cc:260] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.392302 17931 ts_tablet_manager.cc:1434] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:18:50.393121 17931 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.400818  9489 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:18:50.401140  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.033s	sys 0.000s
I20260709 13:18:50.406561 17931 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.407445 17931 tablet_bootstrap.cc:492] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.408141 17931 ts_tablet_manager.cc:1403] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 13:18:50.411010 17931 raft_consensus.cc:359] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.411810 17931 raft_consensus.cc:740] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.412830 17931 consensus_queue.cc:260] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.415632 17931 ts_tablet_manager.cc:1434] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:50.416625 17931 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.438978 17931 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.439857 17931 tablet_bootstrap.cc:492] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.440522 17931 ts_tablet_manager.cc:1403] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:18:50.443327 17931 raft_consensus.cc:359] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.443951 17931 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.444660 17931 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.446525 17931 ts_tablet_manager.cc:1434] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:18:50.447398 17931 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.460933 17931 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.462157 17931 tablet_bootstrap.cc:492] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.463174 17931 ts_tablet_manager.cc:1403] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:18:50.466323 17931 raft_consensus.cc:359] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.467114 17931 raft_consensus.cc:740] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.468008 17931 consensus_queue.cc:260] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.469121  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:39685
I20260709 13:18:50.469414 17992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:39685 every 8 connection(s)
I20260709 13:18:50.470793 17931 ts_tablet_manager.cc:1434] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:18:50.471689 17931 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
W20260709 13:18:50.475121 17994 tablet.cc:2406] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:50.475997  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.488492 17931 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:50.489548 17931 tablet_bootstrap.cc:492] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.490211 17931 ts_tablet_manager.cc:1403] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:18:50.494107 17931 raft_consensus.cc:359] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.495098 17931 raft_consensus.cc:740] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.495863 17931 consensus_queue.cc:260] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.497290 17993 heartbeater.cc:344] Connected to a master server at 127.9.68.126:42893
I20260709 13:18:50.497794 17993 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:50.498019 17931 ts_tablet_manager.cc:1434] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:50.498716 17931 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.499280 17993 heartbeater.cc:507] Master 127.9.68.126:42893 requested a full tablet report, sending...
I20260709 13:18:50.503965 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:50.504683 17762 raft_consensus.cc:606] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:50.506353 17509 ts_manager.cc:194] Re-registered known tserver with Master: e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685)
I20260709 13:18:50.512183 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:50.513115 17762 raft_consensus.cc:606] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:50.515619  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:50.517437  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.518509  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.519568 17509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40400
I20260709 13:18:50.523873 17993 heartbeater.cc:499] Master 127.9.68.126:42893 was elected leader, sending a full tablet report...
I20260709 13:18:50.527552 17967 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.528036 17931 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.533517 17931 tablet_bootstrap.cc:492] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.534211 17931 ts_tablet_manager.cc:1403] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.014s
I20260709 13:18:50.536473 17931 raft_consensus.cc:359] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.536965 17931 raft_consensus.cc:740] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.537793 17931 consensus_queue.cc:260] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.539307 17931 ts_tablet_manager.cc:1434] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:18:50.539923 17931 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.553684 17931 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:50.554364 17931 tablet_bootstrap.cc:492] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.554886 17931 ts_tablet_manager.cc:1403] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:18:50.556926 17931 raft_consensus.cc:359] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.557698 17931 raft_consensus.cc:740] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.558370 17931 consensus_queue.cc:260] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.560096 17931 ts_tablet_manager.cc:1434] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:50.560708 17931 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.573822 17931 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:50.574636 17931 tablet_bootstrap.cc:492] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.575201 17931 ts_tablet_manager.cc:1403] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:18:50.577133 17931 raft_consensus.cc:359] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.577816 17931 raft_consensus.cc:740] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.578384 17931 consensus_queue.cc:260] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.579813 17931 ts_tablet_manager.cc:1434] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:18:50.580675 17931 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.595054 17931 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.595970 17931 tablet_bootstrap.cc:492] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.596621 17931 ts_tablet_manager.cc:1403] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.007s
I20260709 13:18:50.596662 17967 raft_consensus.cc:3060] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.598910 17931 raft_consensus.cc:359] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.599464 17931 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.600153 17931 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.602067 17931 ts_tablet_manager.cc:1434] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:50.603004 17931 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap starting.
I20260709 13:18:50.604028 17967 pending_rounds.cc:85] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting all ops after (but not including) 0
I20260709 13:18:50.604437 17967 pending_rounds.cc:107] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:18:50.604722 17967 raft_consensus.cc:2889] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.616240 17931 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.616884 17931 tablet_bootstrap.cc:492] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Bootstrap complete.
I20260709 13:18:50.617492 17931 ts_tablet_manager.cc:1403] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:18:50.619243 17931 raft_consensus.cc:359] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:50.619709 17931 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce03c3ff5f4d83ba149697e2ce7837, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.620313 17931 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:50.622094 17931 ts_tablet_manager.cc:1434] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:50.714779 17810 raft_consensus.cc:993] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:50.715184 17810 raft_consensus.cc:1081] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:50.716609 17688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:50.717096 17688 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.717450 17688 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.722565 17688 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.724151 17688 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:50.725155 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:50.725402 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:50.726081 17967 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.726126 17762 raft_consensus.cc:3055] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:50.726691 17762 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:50.727653 17762 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.729094 17762 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.734602 17967 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 3.
I20260709 13:18:50.734905 17966 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.736047 17654 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:50.737282 18009 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:50.737859 18009 raft_consensus.cc:697] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:50.738688 17762 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 3.
I20260709 13:18:50.738839 18009 consensus_queue.cc:237] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:50.744130 17966 pending_rounds.cc:85] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting all ops after (but not including) 0
I20260709 13:18:50.744484 17966 pending_rounds.cc:107] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:18:50.744722 17966 raft_consensus.cc:2889] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.747567 17509 catalog_manager.cc:5697] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 2 to 3, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:50.768184 17966 raft_consensus.cc:3060] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.774190 17966 pending_rounds.cc:85] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting all ops after (but not including) 0
I20260709 13:18:50.774487 17966 pending_rounds.cc:107] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 13:18:50.774667 17966 raft_consensus.cc:2889] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.775930 17810 consensus_queue.cc:1050] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:50.814886 17967 raft_consensus.cc:3060] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.820782 17967 pending_rounds.cc:85] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting all ops after (but not including) 0
I20260709 13:18:50.821000 17967 pending_rounds.cc:107] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:18:50.821189 17967 raft_consensus.cc:2889] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.840727 18011 raft_consensus.cc:993] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:50.841223 17810 raft_consensus.cc:1081] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:50.842674 17688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:50.843092 17688 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.843327 17688 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.848013 17688 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:50.849574 17688 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:50.850775 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:50.850775 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:50.851794 17762 raft_consensus.cc:3055] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.851814 17967 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.852329 17762 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:50.853292 17762 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:50.854600 17762 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.859082 17967 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:50.860273 17654 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:50.860991 18009 raft_consensus.cc:2804] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:50.861500 18009 raft_consensus.cc:697] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:50.861779 17762 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:50.862455 18009 consensus_queue.cc:237] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:50.870760 17509 catalog_manager.cc:5697] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 1 to 2, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.940305 17967 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.254739 17967 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.256289 17914 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:51.267894 17762 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.269788 17914 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:51.298981 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:51.345129 17762 raft_consensus.cc:1275] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.346931 17914 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.347764 17966 raft_consensus.cc:1275] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.349360 18024 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.534022  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.550298 17688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
mode: GRACEFUL
new_leader_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:18:51.550824 17688 raft_consensus.cc:606] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Received request to transfer leadership to TS b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:51.553782 17688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
mode: GRACEFUL
new_leader_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:18:51.554503 17688 raft_consensus.cc:606] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Received request to transfer leadership to TS b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:51.555751  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:51.556368  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:51.556973  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.749640 17914 raft_consensus.cc:993] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: : Instructing follower b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:51.750324 18024 raft_consensus.cc:1081] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Signalling peer b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:51.752007 17762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:57236
I20260709 13:18:51.752559 17762 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.752823 17762 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.757735 17762 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:51.759135 17762 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:51.760031 17966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:51.760516 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:51.760659 17966 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.761034 17688 raft_consensus.cc:3055] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:51.761300 17688 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:51.762009 17688 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:51.762847 17688 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.765432 17966 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 3.
I20260709 13:18:51.766398 17728 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:51.767045 18011 raft_consensus.cc:2804] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.767508 18011 raft_consensus.cc:697] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:51.767597 17688 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 3.
I20260709 13:18:51.768473 18011 consensus_queue.cc:237] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:51.774945 17508 catalog_manager.cc:5697] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 2 to 3, leader changed from 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.949405 17914 raft_consensus.cc:993] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: : Instructing follower b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:51.949995 18024 raft_consensus.cc:1081] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Signalling peer b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:51.951442 17762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:57236
I20260709 13:18:51.951932 17762 raft_consensus.cc:493] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.952201 17762 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.957849 17762 raft_consensus.cc:515] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:51.959306 17762 leader_election.cc:290] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:51.960325 17688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:51.960938 17688 raft_consensus.cc:3055] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:51.961040 17966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed89f7b90ec431f84dc81ede0a05206" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:51.961264 17688 raft_consensus.cc:740] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:51.961762 17966 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.962177 17688 consensus_queue.cc:260] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:51.963292 17688 raft_consensus.cc:3060] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.967792 17688 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 3.
I20260709 13:18:51.968523 17966 raft_consensus.cc:2468] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 3.
I20260709 13:18:51.968812 17725 leader_election.cc:304] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:51.969883 18011 raft_consensus.cc:2804] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.970383 18011 raft_consensus.cc:697] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:51.971161 18011 consensus_queue.cc:237] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:51.977855 17508 catalog_manager.cc:5697] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 2 to 3, leader changed from 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:52.300017 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:52.324201 17966 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.325536 18011 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.336505 17688 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:52.341825 18011 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.422538 17688 raft_consensus.cc:1275] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:52.423928 18040 consensus_queue.cc:1048] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:52.432562 17967 raft_consensus.cc:1275] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:52.434279 17810 consensus_queue.cc:1048] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:52.562718  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.570359 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:52.570843 17762 raft_consensus.cc:606] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:52.573496 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:52.573941 17762 raft_consensus.cc:606] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:52.574815  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:52.575207  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:52.575668  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.698645 18040 raft_consensus.cc:993] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:52.699156 17810 raft_consensus.cc:1081] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:52.700388 17688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:52.700780 17688 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.700997 17688 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.705297 17688 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:52.706642 17688 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:52.707612 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:52.708182 17762 raft_consensus.cc:3055] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:52.707854 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:52.708458 17762 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:52.708814 17967 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.709224 17762 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:52.710184 17762 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.715425 17762 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 3.
I20260709 13:18:52.716243 17967 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 3.
I20260709 13:18:52.716315 17651 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, b6d175679bc14e39815fb5e1a5820980; no voters: 
I20260709 13:18:52.717198 17914 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:52.718037 17914 raft_consensus.cc:697] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:52.718713 17914 consensus_queue.cc:237] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:52.724921 17509 catalog_manager.cc:5697] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 2 to 3, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 3 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.807313 17810 raft_consensus.cc:993] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:52.807870 18011 raft_consensus.cc:1081] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:52.809671 17688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:52.810212 17688 raft_consensus.cc:493] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.810526 17688 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.815683 17688 raft_consensus.cc:515] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:52.817109 17688 leader_election.cc:290] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 4 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:52.818156 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:52.818657 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff2b1ccd80e429e816837e6dc8fea7f" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:52.818773 17967 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.819185 17762 raft_consensus.cc:3055] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.819442 17762 raft_consensus.cc:740] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:52.819975 17762 consensus_queue.cc:260] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:52.820843 17762 raft_consensus.cc:3060] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.824306 17967 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 4.
I20260709 13:18:52.824980 17762 raft_consensus.cc:2468] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 4.
I20260709 13:18:52.825531 17654 leader_election.cc:304] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:52.826508 18047 raft_consensus.cc:2804] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:52.826948 18047 raft_consensus.cc:697] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:52.827651 18047 consensus_queue.cc:237] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } }
I20260709 13:18:52.834015 17509 catalog_manager.cc:5697] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 3 to 4, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 4 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.123612 17967 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:53.125008 18047 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:53.135637 17762 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:53.137224 18047 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:53.289459 17967 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:53.290871 17914 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:53.300388 17762 raft_consensus.cc:1275] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:18:53.300935 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:53.302290 18058 consensus_queue.cc:1048] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:53.582073  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:53.589766 17687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
mode: GRACEFUL
new_leader_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:18:53.590411 17687 raft_consensus.cc:606] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Received request to transfer leadership to TS b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:53.592759 17687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
mode: GRACEFUL
new_leader_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:44770
I20260709 13:18:53.593200 17687 raft_consensus.cc:606] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Received request to transfer leadership to TS b6d175679bc14e39815fb5e1a5820980
I20260709 13:18:53.594635  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:53.595332  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:53.596046  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:53.637023 17914 raft_consensus.cc:993] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: : Instructing follower b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:53.637655 18058 raft_consensus.cc:1081] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Signalling peer b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:53.639111 17762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:57236
I20260709 13:18:53.639535 17762 raft_consensus.cc:493] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.639794 17762 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.644076 17762 raft_consensus.cc:515] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.645345 17762 leader_election.cc:290] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 4 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:53.646147 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:53.646315 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ad0762546446568a646bb0f2f63317" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:53.646766 17967 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.646906 17687 raft_consensus.cc:3055] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.647320 17687 raft_consensus.cc:740] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:53.648121 17687 consensus_queue.cc:260] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.649432 17687 raft_consensus.cc:3060] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.653506 17967 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 4.
I20260709 13:18:53.654685 17728 leader_election.cc:304] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:53.655298 18011 raft_consensus.cc:2804] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.655676 18011 raft_consensus.cc:697] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:53.656033 17687 raft_consensus.cc:2468] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 4.
I20260709 13:18:53.656471 18011 consensus_queue.cc:237] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.662599 17508 catalog_manager.cc:5697] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 3 to 4, leader changed from 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 4 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.728308 18058 raft_consensus.cc:993] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: : Instructing follower b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:53.728783 18047 raft_consensus.cc:1081] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Signalling peer b6d175679bc14e39815fb5e1a5820980 to start an election
I20260709 13:18:53.730332 17762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
 from {username='slave'} at 127.0.0.1:57236
I20260709 13:18:53.730959 17762 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.731317 17762 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.736418 17762 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.738024 17762 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 4 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66:39059)
I20260709 13:18:53.738906 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:53.739262 17687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "b6d175679bc14e39815fb5e1a5820980" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
I20260709 13:18:53.739632 17967 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.739872 17687 raft_consensus.cc:3055] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.740226 17687 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:53.741092 17687 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.742413 17687 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.747128 17967 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 4.
I20260709 13:18:53.748288 17728 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6d175679bc14e39815fb5e1a5820980, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:53.748915 18011 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.749213 17687 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6d175679bc14e39815fb5e1a5820980 in term 4.
I20260709 13:18:53.749351 18011 raft_consensus.cc:697] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Becoming Leader. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:53.750319 18011 consensus_queue.cc:237] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:53.756520 17508 catalog_manager.cc:5697] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 reported cstate change: term changed from 3 to 4, leader changed from 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66) to b6d175679bc14e39815fb5e1a5820980 (127.9.68.67). New cstate: current_term: 4 leader_uuid: "b6d175679bc14e39815fb5e1a5820980" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.061362 17687 raft_consensus.cc:1275] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:54.062613 18011 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:54.073519 17967 raft_consensus.cc:1275] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:54.074928 18011 consensus_queue.cc:1048] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:54.147414 17687 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:54.148690 18011 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:54.158213 17967 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Refusing update from remote peer b6d175679bc14e39815fb5e1a5820980: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:54.159623 18011 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:18:54.301939 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:54.602821  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.609912 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:54.610426 17762 raft_consensus.cc:606] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:54.612818 17762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626"
dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
mode: GRACEFUL
new_leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:43672
I20260709 13:18:54.613229 17762 raft_consensus.cc:606] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Received request to transfer leadership to TS 1e631a23e41e4bf6b00af373f72b9ef1
I20260709 13:18:54.614289  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:54.614739  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:54.615267  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.802178 18059 raft_consensus.cc:993] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:54.802629 18011 raft_consensus.cc:1081] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:54.803929 17687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:54.804386 17687 raft_consensus.cc:493] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.804673 17687 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.809514 17687 raft_consensus.cc:515] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:54.811174 17687 leader_election.cc:290] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:54.812054 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:54.812153 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae47c61379ff48b09eeac59d2c64c626" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:54.812549 17762 raft_consensus.cc:3055] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:54.812870 17762 raft_consensus.cc:740] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:54.812876 17967 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.813632 17762 consensus_queue.cc:260] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:54.814538 17762 raft_consensus.cc:3060] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.818426 17967 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:54.819417 17654 leader_election.cc:304] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:54.819983 18047 raft_consensus.cc:2804] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:54.820284 17762 raft_consensus.cc:2468] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 2.
I20260709 13:18:54.820928 18047 raft_consensus.cc:697] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:54.822007 18047 consensus_queue.cc:237] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:54.829710 17508 catalog_manager.cc:5697] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 1 to 2, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.988773 18059 raft_consensus.cc:993] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: : Instructing follower 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:54.989413 18011 raft_consensus.cc:1081] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Signalling peer 1e631a23e41e4bf6b00af373f72b9ef1 to start an election
I20260709 13:18:54.991197 17687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0"
dest_uuid: "1e631a23e41e4bf6b00af373f72b9ef1"
 from {username='slave'} at 127.0.0.1:59076
I20260709 13:18:54.991927 17687 raft_consensus.cc:493] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:54.992357 17687 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.999011 17687 raft_consensus.cc:515] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:55.000929 17687 leader_election.cc:290] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 5 election: Requested vote from peers e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685), b6d175679bc14e39815fb5e1a5820980 (127.9.68.67:44101)
I20260709 13:18:55.001752 17967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837"
I20260709 13:18:55.002403 17967 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.002812 17762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491a2afd00a94cccbc196288be48e1c0" candidate_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b6d175679bc14e39815fb5e1a5820980"
I20260709 13:18:55.003465 17762 raft_consensus.cc:3055] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.003856 17762 raft_consensus.cc:740] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6d175679bc14e39815fb5e1a5820980, State: Running, Role: LEADER
I20260709 13:18:55.004616 17762 consensus_queue.cc:260] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:55.005640 17762 raft_consensus.cc:3060] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.007649 17967 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 5.
I20260709 13:18:55.008643 17654 leader_election.cc:304] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e631a23e41e4bf6b00af373f72b9ef1, e8ce03c3ff5f4d83ba149697e2ce7837; no voters: 
I20260709 13:18:55.009276 18047 raft_consensus.cc:2804] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.009732 18047 raft_consensus.cc:697] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 5 LEADER]: Becoming Leader. State: Replica: 1e631a23e41e4bf6b00af373f72b9ef1, State: Running, Role: LEADER
I20260709 13:18:55.010512 18047 consensus_queue.cc:237] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } }
I20260709 13:18:55.011272 17762 raft_consensus.cc:2468] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e631a23e41e4bf6b00af373f72b9ef1 in term 5.
I20260709 13:18:55.016860 17508 catalog_manager.cc:5697] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 reported cstate change: term changed from 4 to 5, leader changed from b6d175679bc14e39815fb5e1a5820980 (127.9.68.67) to 1e631a23e41e4bf6b00af373f72b9ef1 (127.9.68.66). New cstate: current_term: 5 leader_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e631a23e41e4bf6b00af373f72b9ef1" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.293360 17762 raft_consensus.cc:1275] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:55.294723 18047 consensus_queue.cc:1048] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:55.302856 17559 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:55.305176 17967 raft_consensus.cc:1275] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:55.307302 18047 consensus_queue.cc:1048] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:55.446928 17762 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 5 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:55.448112 18081 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d175679bc14e39815fb5e1a5820980" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:55.456866 17967 raft_consensus.cc:1275] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 5 FOLLOWER]: Refusing update from remote peer 1e631a23e41e4bf6b00af373f72b9ef1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:55.458446 18081 consensus_queue.cc:1048] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce03c3ff5f4d83ba149697e2ce7837" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:55.622212  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:55.651127  9489 tablet_server.cc:179] TabletServer@127.9.68.65:39685 shutting down...
I20260709 13:18:55.671253  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:55.671973  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.672732  9489 raft_consensus.cc:2243] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.673424  9489 raft_consensus.cc:2272] T fff2b1ccd80e429e816837e6dc8fea7f P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.675635  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.676259  9489 raft_consensus.cc:2243] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.676733  9489 raft_consensus.cc:2272] T 491a2afd00a94cccbc196288be48e1c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.679153  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.679891  9489 raft_consensus.cc:2243] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.680392  9489 raft_consensus.cc:2272] T 2a9479af65aa48578dacf85006b55986 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.682269  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.682771  9489 raft_consensus.cc:2243] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.683152  9489 raft_consensus.cc:2272] T 208c90cca5434b09ba42caf0a311ea03 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.685166  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.685796  9489 raft_consensus.cc:2243] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.686205  9489 raft_consensus.cc:2272] T f7aba3a7b7f2478bac6836ed3b3a48c0 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.687852  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.688352  9489 raft_consensus.cc:2243] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.688732  9489 raft_consensus.cc:2272] T 04b88fe4281a4dd0bed87c117e7af1f8 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.690605  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.691129  9489 raft_consensus.cc:2243] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.691548  9489 raft_consensus.cc:2272] T ef56dfe1f6cd4221850c66d811479966 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:55.692076 17728 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
I20260709 13:18:55.693620  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.694464  9489 raft_consensus.cc:2243] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.694998  9489 raft_consensus.cc:2272] T d0ad0762546446568a646bb0f2f63317 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:55.696564 17728 consensus_peers.cc:597] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.696857  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.697439  9489 raft_consensus.cc:2243] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.697849  9489 raft_consensus.cc:2272] T ae47c61379ff48b09eeac59d2c64c626 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.699932  9489 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:55.700385  9489 raft_consensus.cc:2243] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.700773  9489 raft_consensus.cc:2272] T 0ed89f7b90ec431f84dc81ede0a05206 P e8ce03c3ff5f4d83ba149697e2ce7837 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:55.718750 17728 consensus_peers.cc:597] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.729604  9489 tablet_server.cc:196] TabletServer@127.9.68.65:39685 shutdown complete.
W20260709 13:18:55.735932 17728 consensus_peers.cc:597] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 -> Peer e8ce03c3ff5f4d83ba149697e2ce7837 (127.9.68.65:39685): Couldn't send request to peer e8ce03c3ff5f4d83ba149697e2ce7837. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:55.748575  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
I20260709 13:18:55.774564  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:55.775357  9489 tablet_replica.cc:333] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.776104  9489 raft_consensus.cc:2243] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.777027  9489 raft_consensus.cc:2272] T 04b88fe4281a4dd0bed87c117e7af1f8 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.779731  9489 tablet_replica.cc:333] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.780404  9489 raft_consensus.cc:2243] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.781208  9489 raft_consensus.cc:2272] T 491a2afd00a94cccbc196288be48e1c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.784015  9489 tablet_replica.cc:333] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.784576  9489 raft_consensus.cc:2243] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.785270  9489 raft_consensus.cc:2272] T ef56dfe1f6cd4221850c66d811479966 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.787189  9489 tablet_replica.cc:333] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.787695  9489 raft_consensus.cc:2243] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.788117  9489 raft_consensus.cc:2272] T 2a9479af65aa48578dacf85006b55986 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.789908  9489 tablet_replica.cc:333] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.790403  9489 raft_consensus.cc:2243] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.791025  9489 raft_consensus.cc:2272] T d0ad0762546446568a646bb0f2f63317 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.793396  9489 tablet_replica.cc:333] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.793992  9489 raft_consensus.cc:2243] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.794437  9489 raft_consensus.cc:2272] T 0ed89f7b90ec431f84dc81ede0a05206 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.796576  9489 tablet_replica.cc:333] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.797197  9489 raft_consensus.cc:2243] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.798146  9489 raft_consensus.cc:2272] T ae47c61379ff48b09eeac59d2c64c626 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.800827  9489 tablet_replica.cc:333] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.801610  9489 raft_consensus.cc:2243] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.802104  9489 raft_consensus.cc:2272] T f7aba3a7b7f2478bac6836ed3b3a48c0 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.804148  9489 tablet_replica.cc:333] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.804708  9489 raft_consensus.cc:2243] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.805559  9489 raft_consensus.cc:2272] T 208c90cca5434b09ba42caf0a311ea03 P 1e631a23e41e4bf6b00af373f72b9ef1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.807403  9489 tablet_replica.cc:333] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1: stopping tablet replica
I20260709 13:18:55.807859  9489 raft_consensus.cc:2243] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.808540  9489 raft_consensus.cc:2272] T fff2b1ccd80e429e816837e6dc8fea7f P 1e631a23e41e4bf6b00af373f72b9ef1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.839697  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
I20260709 13:18:55.864938  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:18:55.898681  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:55.899431  9489 tablet_replica.cc:333] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.900130  9489 raft_consensus.cc:2243] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.900847  9489 raft_consensus.cc:2272] T ef56dfe1f6cd4221850c66d811479966 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.903676  9489 tablet_replica.cc:333] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.904341  9489 raft_consensus.cc:2243] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.904793  9489 raft_consensus.cc:2272] T 04b88fe4281a4dd0bed87c117e7af1f8 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.907140  9489 tablet_replica.cc:333] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.907780  9489 raft_consensus.cc:2243] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.908682  9489 raft_consensus.cc:2272] T 2a9479af65aa48578dacf85006b55986 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.911048  9489 tablet_replica.cc:333] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.911640  9489 raft_consensus.cc:2243] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.912436  9489 raft_consensus.cc:2272] T 0ed89f7b90ec431f84dc81ede0a05206 P b6d175679bc14e39815fb5e1a5820980 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.914551  9489 tablet_replica.cc:333] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.915108  9489 raft_consensus.cc:2243] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.915542  9489 raft_consensus.cc:2272] T ae47c61379ff48b09eeac59d2c64c626 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.918248  9489 tablet_replica.cc:333] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.918825  9489 raft_consensus.cc:2243] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.919620  9489 raft_consensus.cc:2272] T d0ad0762546446568a646bb0f2f63317 P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.921746  9489 tablet_replica.cc:333] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.922235  9489 raft_consensus.cc:2243] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.922637  9489 raft_consensus.cc:2272] T 491a2afd00a94cccbc196288be48e1c0 P b6d175679bc14e39815fb5e1a5820980 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.925573  9489 tablet_replica.cc:333] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.926136  9489 raft_consensus.cc:2243] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.926719  9489 raft_consensus.cc:2272] T fff2b1ccd80e429e816837e6dc8fea7f P b6d175679bc14e39815fb5e1a5820980 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.929936  9489 tablet_replica.cc:333] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.930581  9489 raft_consensus.cc:2243] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:55.931203  9489 raft_consensus.cc:2272] T 208c90cca5434b09ba42caf0a311ea03 P b6d175679bc14e39815fb5e1a5820980 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.933820  9489 tablet_replica.cc:333] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980: stopping tablet replica
I20260709 13:18:55.934276  9489 raft_consensus.cc:2243] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:55.935081  9489 raft_consensus.cc:2272] T f7aba3a7b7f2478bac6836ed3b3a48c0 P b6d175679bc14e39815fb5e1a5820980 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:55.984663  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:18:56.012511  9489 master.cc:562] Master@127.9.68.126:42893 shutting down...
I20260709 13:18:56.038337  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:56.038883  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:56.039220  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P 487a29306f0c40dcaf31aa32b50c05d2: stopping tablet replica
I20260709 13:18:56.061033  9489 master.cc:584] Master@127.9.68.126:42893 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12950 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:18:56.106352  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:43329
I20260709 13:18:56.107424  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:56.112730 18093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.112704 18092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.114315 18095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:56.115898  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:56.116892  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:56.117061  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:56.117175  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603136117165 us; error 0 us; skew 500 ppm
I20260709 13:18:56.117821  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:56.119949  9489 webserver.cc:533] Webserver started at http://127.9.68.126:34651/ using document root <none> and password file <none>
I20260709 13:18:56.120355  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:56.120502  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:56.120707  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:56.121737  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "9adcedd9cdc74f118bce9c28b4fef084"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.125753  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:18:56.128944 18100 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.130004  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:56.130357  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "9adcedd9cdc74f118bce9c28b4fef084"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.130666  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:56.149138  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:56.150187  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:56.188369  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:43329
I20260709 13:18:56.188483 18151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:43329 every 8 connection(s)
I20260709 13:18:56.192569 18152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.203361 18152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084: Bootstrap starting.
I20260709 13:18:56.207864 18152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.231583 18152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084: No bootstrap required, opened a new log
I20260709 13:18:56.235198 18152 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER }
I20260709 13:18:56.235850 18152 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.236107 18152 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9adcedd9cdc74f118bce9c28b4fef084, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.236907 18152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER }
I20260709 13:18:56.237673 18152 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:56.237910 18152 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:56.238397 18152 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.245230 18152 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER }
I20260709 13:18:56.245797 18152 leader_election.cc:304] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9adcedd9cdc74f118bce9c28b4fef084; no voters: 
I20260709 13:18:56.246933 18152 leader_election.cc:290] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:56.247339 18156 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.248685 18156 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 1 LEADER]: Becoming Leader. State: Replica: 9adcedd9cdc74f118bce9c28b4fef084, State: Running, Role: LEADER
I20260709 13:18:56.249480 18156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER }
I20260709 13:18:56.250123 18152 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:56.255658 18157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9adcedd9cdc74f118bce9c28b4fef084" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER } }
I20260709 13:18:56.255661 18158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9adcedd9cdc74f118bce9c28b4fef084. Latest consensus state: current_term: 1 leader_uuid: "9adcedd9cdc74f118bce9c28b4fef084" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9adcedd9cdc74f118bce9c28b4fef084" member_type: VOTER } }
I20260709 13:18:56.256379 18157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:56.256599 18158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:56.258229 18163 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:56.263090 18163 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:56.267441  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:56.274340 18163 catalog_manager.cc:1383] Generated new cluster ID: 86b0c1a79d6e4ea590aae43b7ce11e14
I20260709 13:18:56.274741 18163 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:56.297022 18163 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:56.298533 18163 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:56.315725 18163 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084: Generated new TSK 0
I20260709 13:18:56.316295 18163 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:56.334561  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:56.341920 18174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.342895 18175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.343920 18177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:56.344465  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:56.345656  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:56.345840  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:56.346042  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603136346023 us; error 0 us; skew 500 ppm
I20260709 13:18:56.346608  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:56.349901  9489 webserver.cc:533] Webserver started at http://127.9.68.65:39369/ using document root <none> and password file <none>
I20260709 13:18:56.350513  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:56.350692  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:56.351078  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:56.352712  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.358073  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:18:56.361675 18182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.362412  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:18:56.362694  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.362969  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:56.380899  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:56.382373  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:56.384091  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:56.386878  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:56.387069  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.387380  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:56.387560  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.431569  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:44907
I20260709 13:18:56.431701 18244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:44907 every 8 connection(s)
I20260709 13:18:56.436877  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:56.444988 18249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.446141 18250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:56.450631  9489 server_base.cc:1061] running on GCE node
W20260709 13:18:56.450982 18252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:56.452162  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:56.452208 18245 heartbeater.cc:344] Connected to a master server at 127.9.68.126:43329
W20260709 13:18:56.452481  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:56.452697 18245 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:56.452711  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603136452695 us; error 0 us; skew 500 ppm
I20260709 13:18:56.453586  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:56.453644 18245 heartbeater.cc:507] Master 127.9.68.126:43329 requested a full tablet report, sending...
I20260709 13:18:56.456306  9489 webserver.cc:533] Webserver started at http://127.9.68.66:45429/ using document root <none> and password file <none>
I20260709 13:18:56.456313 18117 ts_manager.cc:194] Registered new tserver with Master: 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907)
I20260709 13:18:56.457226  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:56.457520  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:56.457846  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:56.459128 18117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35308
I20260709 13:18:56.459587  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "1f628aa47687476f9b54a66c67835d72"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.464572  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:56.468523 18257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.469398  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:56.469687  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "1f628aa47687476f9b54a66c67835d72"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.469993  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:56.488101  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:56.489250  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:56.490705  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:56.492928  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:56.493150  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.493415  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:56.493582  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.534490  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:35349
I20260709 13:18:56.534670 18319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:35349 every 8 connection(s)
I20260709 13:18:56.539626  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:56.546999 18323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.548666 18324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:56.551478 18326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:56.552364 18320 heartbeater.cc:344] Connected to a master server at 127.9.68.126:43329
I20260709 13:18:56.552927 18320 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:56.554168 18320 heartbeater.cc:507] Master 127.9.68.126:43329 requested a full tablet report, sending...
I20260709 13:18:56.555691  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:56.556411 18117 ts_manager.cc:194] Registered new tserver with Master: 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:56.556571  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:56.556885  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:56.557057  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603136557042 us; error 0 us; skew 500 ppm
I20260709 13:18:56.557694  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:56.557919 18117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35314
I20260709 13:18:56.560571  9489 webserver.cc:533] Webserver started at http://127.9.68.67:37027/ using document root <none> and password file <none>
I20260709 13:18:56.561034  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:56.561252  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:56.561542  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:56.562742  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "d15307742e0d454ba0007e6c2383d893"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.567013  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:56.570569 18331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.571600  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:56.571893  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "d15307742e0d454ba0007e6c2383d893"
format_stamp: "Formatted at 2026-07-09 13:18:56 on dist-test-slave-9s6w"
I20260709 13:18:56.572127  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:56.589602  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:56.590751  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:56.592188  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:56.594313  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:56.594539  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.594767  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:56.594940  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:56.639035  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:46049
I20260709 13:18:56.639174 18393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:46049 every 8 connection(s)
I20260709 13:18:56.653707 18394 heartbeater.cc:344] Connected to a master server at 127.9.68.126:43329
I20260709 13:18:56.654266 18394 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:56.655292 18394 heartbeater.cc:507] Master 127.9.68.126:43329 requested a full tablet report, sending...
I20260709 13:18:56.657400 18117 ts_manager.cc:194] Registered new tserver with Master: d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:56.658181  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015812942s
I20260709 13:18:56.658818 18117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35328
I20260709 13:18:56.685236 18117 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35336:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:56.687414 18117 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:56.755596 18285 tablet_service.cc:1511] Processing CreateTablet for tablet 1a322ac852404d6d90236068e1f8c855 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:56.755827 18284 tablet_service.cc:1511] Processing CreateTablet for tablet a4dd91bc2f3b4138bc3776aa6b597fb6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:56.755930 18359 tablet_service.cc:1511] Processing CreateTablet for tablet 1a322ac852404d6d90236068e1f8c855 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:56.757481 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a322ac852404d6d90236068e1f8c855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.757016 18358 tablet_service.cc:1511] Processing CreateTablet for tablet a4dd91bc2f3b4138bc3776aa6b597fb6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:56.757648 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a322ac852404d6d90236068e1f8c855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.758430 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4dd91bc2f3b4138bc3776aa6b597fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.758512 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4dd91bc2f3b4138bc3776aa6b597fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.767509 18210 tablet_service.cc:1511] Processing CreateTablet for tablet 1a322ac852404d6d90236068e1f8c855 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:56.769120 18210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a322ac852404d6d90236068e1f8c855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.772131 18209 tablet_service.cc:1511] Processing CreateTablet for tablet a4dd91bc2f3b4138bc3776aa6b597fb6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=83c4ba2ce49348f483952660fe5fff12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:56.773396 18209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4dd91bc2f3b4138bc3776aa6b597fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:56.786495 18409 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: Bootstrap starting.
I20260709 13:18:56.790997 18410 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: Bootstrap starting.
I20260709 13:18:56.797243 18409 tablet_bootstrap.cc:654] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.799324 18410 tablet_bootstrap.cc:654] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.805724 18411 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Bootstrap starting.
I20260709 13:18:56.810623 18409 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: No bootstrap required, opened a new log
I20260709 13:18:56.811381 18409 ts_tablet_manager.cc:1403] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:18:56.814247 18411 tablet_bootstrap.cc:654] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.815438 18409 raft_consensus.cc:359] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.818394 18409 raft_consensus.cc:385] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.818689 18409 raft_consensus.cc:740] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f628aa47687476f9b54a66c67835d72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.819053 18410 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: No bootstrap required, opened a new log
I20260709 13:18:56.819530 18410 ts_tablet_manager.cc:1403] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.015s
I20260709 13:18:56.819458 18409 consensus_queue.cc:260] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.822599 18320 heartbeater.cc:499] Master 127.9.68.126:43329 was elected leader, sending a full tablet report...
I20260709 13:18:56.822721 18415 raft_consensus.cc:493] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.822829 18410 raft_consensus.cc:359] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.823364 18415 raft_consensus.cc:515] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.823805 18411 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: No bootstrap required, opened a new log
I20260709 13:18:56.823726 18410 raft_consensus.cc:385] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.824298 18411 ts_tablet_manager.cc:1403] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.006s
I20260709 13:18:56.824239 18410 raft_consensus.cc:740] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.825635 18410 consensus_queue.cc:260] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.827526 18409 ts_tablet_manager.cc:1434] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:18:56.829408 18409 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: Bootstrap starting.
I20260709 13:18:56.831588 18415 leader_election.cc:290] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:56.834214 18411 raft_consensus.cc:359] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.835037 18411 raft_consensus.cc:385] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.835726 18411 raft_consensus.cc:740] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.836637 18411 consensus_queue.cc:260] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.862944 18394 heartbeater.cc:499] Master 127.9.68.126:43329 was elected leader, sending a full tablet report...
I20260709 13:18:56.863754 18409 tablet_bootstrap.cc:654] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.861850 18410 ts_tablet_manager.cc:1434] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: Time spent starting tablet: real 0.042s	user 0.019s	sys 0.021s
I20260709 13:18:56.865163 18410 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: Bootstrap starting.
I20260709 13:18:56.868780 18245 heartbeater.cc:499] Master 127.9.68.126:43329 was elected leader, sending a full tablet report...
I20260709 13:18:56.869619 18411 ts_tablet_manager.cc:1434] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.026s
I20260709 13:18:56.870971 18411 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: Bootstrap starting.
I20260709 13:18:56.874368 18410 tablet_bootstrap.cc:654] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.874512 18409 tablet_bootstrap.cc:492] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: No bootstrap required, opened a new log
I20260709 13:18:56.875233 18409 ts_tablet_manager.cc:1403] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.008s
I20260709 13:18:56.877806 18411 tablet_bootstrap.cc:654] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.878440 18409 raft_consensus.cc:359] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.879324 18409 raft_consensus.cc:385] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.879683 18409 raft_consensus.cc:740] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f628aa47687476f9b54a66c67835d72, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.881556 18418 raft_consensus.cc:493] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.882223 18418 raft_consensus.cc:515] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.902953 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "1f628aa47687476f9b54a66c67835d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893" is_pre_election: true
I20260709 13:18:56.905844 18418 leader_election.cc:290] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
W20260709 13:18:56.905840 18261 leader_election.cc:343] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.909179 18410 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: No bootstrap required, opened a new log
I20260709 13:18:56.909722 18410 ts_tablet_manager.cc:1403] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.022s
I20260709 13:18:56.909842 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72" is_pre_election: true
I20260709 13:18:56.912444 18410 raft_consensus.cc:359] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.913149 18410 raft_consensus.cc:385] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.913475 18410 raft_consensus.cc:740] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.914348 18410 consensus_queue.cc:260] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.880756 18409 consensus_queue.cc:260] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.916057 18295 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:56.919997 18410 ts_tablet_manager.cc:1434] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:18:56.921788 18185 leader_election.cc:304] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8; no voters: 
I20260709 13:18:56.922501 18418 raft_consensus.cc:2804] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.922987 18418 raft_consensus.cc:493] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.928049 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "1f628aa47687476f9b54a66c67835d72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" is_pre_election: true
I20260709 13:18:56.929009 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893" is_pre_election: true
I20260709 13:18:56.929644 18418 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.930557 18369 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:56.930789 18411 tablet_bootstrap.cc:492] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: No bootstrap required, opened a new log
I20260709 13:18:56.931293 18411 ts_tablet_manager.cc:1403] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.034s
W20260709 13:18:56.931386 18261 leader_election.cc:343] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.931874 18261 leader_election.cc:304] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72; no voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893
I20260709 13:18:56.924147 18409 ts_tablet_manager.cc:1434] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:18:56.932667 18415 raft_consensus.cc:2749] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.935796 18411 raft_consensus.cc:359] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.936483 18411 raft_consensus.cc:385] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.936758 18411 raft_consensus.cc:740] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.937479 18411 consensus_queue.cc:260] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.940737 18411 ts_tablet_manager.cc:1434] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:18:56.942414 18418 raft_consensus.cc:515] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.944865 18418 leader_election.cc:290] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Requested vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:56.945741 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:56.946352 18295 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.946321 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893"
I20260709 13:18:56.947031 18369 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.956403 18369 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 1.
I20260709 13:18:56.956406 18295 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 1.
I20260709 13:18:56.957839 18186 leader_election.cc:304] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:56.958503 18418 raft_consensus.cc:2804] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.958931 18418 raft_consensus.cc:697] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:56.959674 18418 consensus_queue.cc:237] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:56.966859 18115 catalog_manager.cc:5697] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.182664 18418 raft_consensus.cc:493] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.183259 18418 raft_consensus.cc:515] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.185281 18418 leader_election.cc:290] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:57.186038 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72" is_pre_election: true
I20260709 13:18:57.186420 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893" is_pre_election: true
I20260709 13:18:57.186852 18295 raft_consensus.cc:2468] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:57.187026 18369 raft_consensus.cc:2468] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:57.188081 18185 leader_election.cc:304] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8; no voters: 
I20260709 13:18:57.188755 18418 raft_consensus.cc:2804] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.189124 18418 raft_consensus.cc:493] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.189427 18418 raft_consensus.cc:3060] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.194257 18418 raft_consensus.cc:515] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.195878 18418 leader_election.cc:290] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Requested vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:57.196775 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:57.197244 18295 raft_consensus.cc:3060] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.197068 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a322ac852404d6d90236068e1f8c855" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893"
I20260709 13:18:57.198032 18369 raft_consensus.cc:3060] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.203655 18295 raft_consensus.cc:2468] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 1.
I20260709 13:18:57.203967 18369 raft_consensus.cc:2468] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 1.
I20260709 13:18:57.204931 18185 leader_election.cc:304] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8; no voters: 
I20260709 13:18:57.205693 18418 raft_consensus.cc:2804] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.206171 18418 raft_consensus.cc:697] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:57.206928 18418 consensus_queue.cc:237] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.212541 18115 catalog_manager.cc:5697] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.343010 18115 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35352:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:57.344852 18115 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:57.360673 18418 consensus_queue.cc:1048] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.369493 18210 tablet_service.cc:1511] Processing CreateTablet for tablet 32420f9183ef4e96984fafbd086c7dfc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:57.370705 18210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32420f9183ef4e96984fafbd086c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.372607 18284 tablet_service.cc:1511] Processing CreateTablet for tablet 32420f9183ef4e96984fafbd086c7dfc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:57.374259 18284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32420f9183ef4e96984fafbd086c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.374884 18358 tablet_service.cc:1511] Processing CreateTablet for tablet 32420f9183ef4e96984fafbd086c7dfc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:57.376089 18358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32420f9183ef4e96984fafbd086c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.379283 18418 consensus_queue.cc:1048] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.379871 18285 tablet_service.cc:1511] Processing CreateTablet for tablet 254d0f72c25f48cfb6383e56b7dd9828 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:57.381073 18285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254d0f72c25f48cfb6383e56b7dd9828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.381706 18209 tablet_service.cc:1511] Processing CreateTablet for tablet 254d0f72c25f48cfb6383e56b7dd9828 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:57.382859 18209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254d0f72c25f48cfb6383e56b7dd9828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.387157 18359 tablet_service.cc:1511] Processing CreateTablet for tablet 254d0f72c25f48cfb6383e56b7dd9828 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d721a06cbfa5467c86c0c88aae18f46b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:57.388603 18359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254d0f72c25f48cfb6383e56b7dd9828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:57.393981 18409 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: Bootstrap starting.
I20260709 13:18:57.400180 18409 tablet_bootstrap.cc:654] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.451352 18409 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: No bootstrap required, opened a new log
I20260709 13:18:57.454509 18409 ts_tablet_manager.cc:1403] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.034s
I20260709 13:18:57.458405 18409 raft_consensus.cc:359] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.459487 18409 raft_consensus.cc:385] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.459924 18409 raft_consensus.cc:740] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f628aa47687476f9b54a66c67835d72, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.461102 18409 consensus_queue.cc:260] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.463131 18439 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: Bootstrap starting.
I20260709 13:18:57.469084 18438 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Bootstrap starting.
I20260709 13:18:57.471171 18409 ts_tablet_manager.cc:1434] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:57.472674 18409 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: Bootstrap starting.
I20260709 13:18:57.474128 18439 tablet_bootstrap.cc:654] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.479633 18409 tablet_bootstrap.cc:654] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.483084 18438 tablet_bootstrap.cc:654] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.490391 18439 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: No bootstrap required, opened a new log
I20260709 13:18:57.490860 18439 ts_tablet_manager.cc:1403] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.007s
I20260709 13:18:57.490974 18438 tablet_bootstrap.cc:492] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: No bootstrap required, opened a new log
I20260709 13:18:57.491473 18438 ts_tablet_manager.cc:1403] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:18:57.492012 18409 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: No bootstrap required, opened a new log
I20260709 13:18:57.492501 18409 ts_tablet_manager.cc:1403] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:18:57.493345 18439 raft_consensus.cc:359] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.494238 18439 raft_consensus.cc:385] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.494315 18438 raft_consensus.cc:359] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.494663 18439 raft_consensus.cc:740] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.495103 18438 raft_consensus.cc:385] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.495528 18438 raft_consensus.cc:740] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.495198 18409 raft_consensus.cc:359] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.495965 18409 raft_consensus.cc:385] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.496377 18409 raft_consensus.cc:740] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f628aa47687476f9b54a66c67835d72, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.495807 18439 consensus_queue.cc:260] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.496388 18438 consensus_queue.cc:260] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.499378 18439 ts_tablet_manager.cc:1434] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:57.500526 18439 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Bootstrap starting.
I20260709 13:18:57.501261 18409 consensus_queue.cc:260] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.503703 18438 ts_tablet_manager.cc:1434] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:57.504720 18438 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: Bootstrap starting.
I20260709 13:18:57.516526 18409 ts_tablet_manager.cc:1434] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.006s
I20260709 13:18:57.519587 18439 tablet_bootstrap.cc:654] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.520211 18438 tablet_bootstrap.cc:654] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.525804 18438 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: No bootstrap required, opened a new log
I20260709 13:18:57.526150 18439 tablet_bootstrap.cc:492] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: No bootstrap required, opened a new log
I20260709 13:18:57.526263 18438 ts_tablet_manager.cc:1403] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:18:57.526633 18439 ts_tablet_manager.cc:1403] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 13:18:57.529392 18438 raft_consensus.cc:359] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.529623 18439 raft_consensus.cc:359] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.530056 18438 raft_consensus.cc:385] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.530279 18439 raft_consensus.cc:385] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.530386 18438 raft_consensus.cc:740] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.530642 18439 raft_consensus.cc:740] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.531194 18438 consensus_queue.cc:260] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.531306 18439 consensus_queue.cc:260] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.533401 18438 ts_tablet_manager.cc:1434] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:57.533427 18439 ts_tablet_manager.cc:1434] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:57.585743 18416 raft_consensus.cc:493] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.586134 18416 raft_consensus.cc:515] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.588268 18416 leader_election.cc:290] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:57.609144 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" is_pre_election: true
I20260709 13:18:57.609551 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72" is_pre_election: true
I20260709 13:18:57.609791 18220 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 0.
I20260709 13:18:57.610128 18295 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 0.
I20260709 13:18:57.610889 18335 leader_election.cc:304] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:57.611687 18416 raft_consensus.cc:2804] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.611992 18416 raft_consensus.cc:493] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.612267 18416 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.619117 18416 raft_consensus.cc:515] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.620702 18416 leader_election.cc:290] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 election: Requested vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:57.621628 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
I20260709 13:18:57.621765 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:57.622093 18220 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.622316 18295 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.627068 18295 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 1.
I20260709 13:18:57.627791 18220 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 1.
I20260709 13:18:57.628132 18334 leader_election.cc:304] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:57.628973 18416 raft_consensus.cc:2804] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.630151 18416 raft_consensus.cc:697] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 LEADER]: Becoming Leader. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Running, Role: LEADER
I20260709 13:18:57.630791 18416 consensus_queue.cc:237] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.637866 18115 catalog_manager.cc:5697] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 reported cstate change: term changed from 0 to 1, leader changed from <none> to d15307742e0d454ba0007e6c2383d893 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "d15307742e0d454ba0007e6c2383d893" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.706943 18418 consensus_queue.cc:1048] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.719000 18418 consensus_queue.cc:1048] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.828558 18418 raft_consensus.cc:493] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.829012 18418 raft_consensus.cc:515] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.830366 18416 raft_consensus.cc:493] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.830933 18416 raft_consensus.cc:515] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.831344 18418 leader_election.cc:290] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:57.831640 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72" is_pre_election: true
I20260709 13:18:57.831903 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893" is_pre_election: true
I20260709 13:18:57.832463 18369 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:57.832418 18295 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 0.
I20260709 13:18:57.832966 18416 leader_election.cc:290] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:57.839143 18186 leader_election.cc:304] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:57.839223 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" is_pre_election: true
I20260709 13:18:57.840341 18294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72" is_pre_election: true
I20260709 13:18:57.840479 18220 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 0.
I20260709 13:18:57.841118 18294 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 0.
I20260709 13:18:57.841127 18418 raft_consensus.cc:2804] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.841663 18335 leader_election.cc:304] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:57.841822 18418 raft_consensus.cc:493] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.842438 18418 raft_consensus.cc:3060] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.842487 18416 raft_consensus.cc:2804] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.842968 18416 raft_consensus.cc:493] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.843238 18416 raft_consensus.cc:3060] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.848582 18418 raft_consensus.cc:515] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.848758 18416 raft_consensus.cc:515] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.850351 18418 leader_election.cc:290] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Requested vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:57.850472 18416 leader_election.cc:290] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 election: Requested vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:57.851071 18294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:57.851234 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
I20260709 13:18:57.851630 18294 raft_consensus.cc:3060] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.852079 18220 raft_consensus.cc:2393] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d15307742e0d454ba0007e6c2383d893 in current term 1: Already voted for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in this term.
I20260709 13:18:57.852147 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:57.852020 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15307742e0d454ba0007e6c2383d893"
I20260709 13:18:57.853261 18369 raft_consensus.cc:2393] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66a8eb037be741d5ba1526e84c0bb2e8 in current term 1: Already voted for candidate d15307742e0d454ba0007e6c2383d893 in this term.
I20260709 13:18:57.853706 18334 leader_election.cc:304] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d15307742e0d454ba0007e6c2383d893; no voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8
I20260709 13:18:57.854525 18416 raft_consensus.cc:2749] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:57.857491 18294 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 1.
I20260709 13:18:57.858302 18185 leader_election.cc:304] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8; no voters: d15307742e0d454ba0007e6c2383d893
I20260709 13:18:57.859081 18418 raft_consensus.cc:2804] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.859683 18418 raft_consensus.cc:697] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Becoming Leader. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:57.860635 18418 consensus_queue.cc:237] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:57.867939 18116 catalog_manager.cc:5697] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65). New cstate: current_term: 1 leader_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.955015 18220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6"
dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
mode: GRACEFUL
new_leader_uuid: "1f628aa47687476f9b54a66c67835d72"
 from {username='slave'} at 127.0.0.1:35084
I20260709 13:18:57.955678 18220 raft_consensus.cc:606] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Received request to transfer leadership to TS 1f628aa47687476f9b54a66c67835d72
I20260709 13:18:57.973834 18369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828"
dest_uuid: "d15307742e0d454ba0007e6c2383d893"
mode: GRACEFUL
new_leader_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
 from {username='slave'} at 127.0.0.1:50200
I20260709 13:18:57.974339 18369 raft_consensus.cc:606] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 LEADER]: Received request to transfer leadership to TS 66a8eb037be741d5ba1526e84c0bb2e8
I20260709 13:18:58.005333 18452 raft_consensus.cc:993] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: : Instructing follower 1f628aa47687476f9b54a66c67835d72 to start an election
I20260709 13:18:58.005828 18418 raft_consensus.cc:1081] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Signalling peer 1f628aa47687476f9b54a66c67835d72 to start an election
I20260709 13:18:58.007510 18294 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6"
dest_uuid: "1f628aa47687476f9b54a66c67835d72"
 from {username='slave'} at 127.0.0.1:47020
I20260709 13:18:58.008134 18294 raft_consensus.cc:493] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.008483 18294 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.014855 18294 raft_consensus.cc:515] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.016860 18294 leader_election.cc:290] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 2 election: Requested vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:58.018481 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "1f628aa47687476f9b54a66c67835d72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d15307742e0d454ba0007e6c2383d893"
I20260709 13:18:58.019050 18369 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.021661 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4dd91bc2f3b4138bc3776aa6b597fb6" candidate_uuid: "1f628aa47687476f9b54a66c67835d72" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
I20260709 13:18:58.022197 18220 raft_consensus.cc:3055] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:58.022490 18220 raft_consensus.cc:740] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:58.023222 18220 consensus_queue.cc:260] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.024237 18220 raft_consensus.cc:3060] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.024605 18369 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f628aa47687476f9b54a66c67835d72 in term 2.
I20260709 13:18:58.025858 18261 leader_election.cc:304] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, d15307742e0d454ba0007e6c2383d893; no voters: 
I20260709 13:18:58.026656 18415 raft_consensus.cc:2804] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:58.027746 18415 raft_consensus.cc:697] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 2 LEADER]: Becoming Leader. State: Replica: 1f628aa47687476f9b54a66c67835d72, State: Running, Role: LEADER
I20260709 13:18:58.028482 18415 consensus_queue.cc:237] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.031543 18220 raft_consensus.cc:2468] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f628aa47687476f9b54a66c67835d72 in term 2.
I20260709 13:18:58.035176 18116 catalog_manager.cc:5697] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 reported cstate change: term changed from 1 to 2, leader changed from 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65) to 1f628aa47687476f9b54a66c67835d72 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "1f628aa47687476f9b54a66c67835d72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.133780 18416 consensus_queue.cc:1048] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:58.145097 18459 consensus_queue.cc:1048] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:58.151934 18460 raft_consensus.cc:993] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: : Instructing follower 66a8eb037be741d5ba1526e84c0bb2e8 to start an election
I20260709 13:18:58.152370 18459 raft_consensus.cc:1081] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 LEADER]: Signalling peer 66a8eb037be741d5ba1526e84c0bb2e8 to start an election
I20260709 13:18:58.153720 18220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828"
dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
 from {username='slave'} at 127.0.0.1:35068
I20260709 13:18:58.154160 18220 raft_consensus.cc:493] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.154464 18220 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.159071 18220 raft_consensus.cc:515] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.160684 18220 leader_election.cc:290] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 2 election: Requested vote from peers 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349), d15307742e0d454ba0007e6c2383d893 (127.9.68.67:46049)
I20260709 13:18:58.161358 18294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:58.161732 18369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254d0f72c25f48cfb6383e56b7dd9828" candidate_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d15307742e0d454ba0007e6c2383d893"
I20260709 13:18:58.162061 18294 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.162355 18369 raft_consensus.cc:3055] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:58.162708 18369 raft_consensus.cc:740] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Running, Role: LEADER
I20260709 13:18:58.163419 18369 consensus_queue.cc:260] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.164407 18369 raft_consensus.cc:3060] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.170064 18294 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 2.
I20260709 13:18:58.170594 18369 raft_consensus.cc:2468] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a8eb037be741d5ba1526e84c0bb2e8 in term 2.
I20260709 13:18:58.171114 18185 leader_election.cc:304] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f628aa47687476f9b54a66c67835d72, 66a8eb037be741d5ba1526e84c0bb2e8; no voters: 
I20260709 13:18:58.172026 18418 raft_consensus.cc:2804] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:58.172497 18418 raft_consensus.cc:697] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 LEADER]: Becoming Leader. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:58.173385 18418 consensus_queue.cc:237] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.179545 18115 catalog_manager.cc:5697] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 reported cstate change: term changed from 1 to 2, leader changed from d15307742e0d454ba0007e6c2383d893 (127.9.68.67) to 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65). New cstate: current_term: 2 leader_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.273176  9489 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:18:58.274957  9489 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:18:58.275309  9489 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:18:58.287341 18220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc"
dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
mode: GRACEFUL
new_leader_uuid: "d15307742e0d454ba0007e6c2383d893"
 from {username='slave'} at 127.0.0.1:35092
I20260709 13:18:58.287823 18220 raft_consensus.cc:606] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Received request to transfer leadership to TS d15307742e0d454ba0007e6c2383d893
I20260709 13:18:58.288933  9489 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:18:58.355027 18418 consensus_queue.cc:1048] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:58.362159 18423 raft_consensus.cc:993] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: : Instructing follower d15307742e0d454ba0007e6c2383d893 to start an election
I20260709 13:18:58.362627 18452 raft_consensus.cc:1081] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Signalling peer d15307742e0d454ba0007e6c2383d893 to start an election
I20260709 13:18:58.364511 18368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc"
dest_uuid: "d15307742e0d454ba0007e6c2383d893"
 from {username='slave'} at 127.0.0.1:50186
I20260709 13:18:58.365137 18368 raft_consensus.cc:493] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.365545 18368 raft_consensus.cc:3060] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.370779 18423 consensus_queue.cc:1048] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:58.373059 18368 raft_consensus.cc:515] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.381726 18220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66a8eb037be741d5ba1526e84c0bb2e8"
I20260709 13:18:58.382077 18295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32420f9183ef4e96984fafbd086c7dfc" candidate_uuid: "d15307742e0d454ba0007e6c2383d893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f628aa47687476f9b54a66c67835d72"
I20260709 13:18:58.382421 18220 raft_consensus.cc:3055] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:58.382817 18220 raft_consensus.cc:740] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66a8eb037be741d5ba1526e84c0bb2e8, State: Running, Role: LEADER
I20260709 13:18:58.383679 18220 consensus_queue.cc:260] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.385563 18220 raft_consensus.cc:3060] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.391577 18368 leader_election.cc:290] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 2 election: Requested vote from peers 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907), 1f628aa47687476f9b54a66c67835d72 (127.9.68.66:35349)
I20260709 13:18:58.393853 18220 raft_consensus.cc:2468] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d15307742e0d454ba0007e6c2383d893 in term 2.
I20260709 13:18:58.394951 18335 leader_election.cc:304] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a8eb037be741d5ba1526e84c0bb2e8, d15307742e0d454ba0007e6c2383d893; no voters: 1f628aa47687476f9b54a66c67835d72
I20260709 13:18:58.395721 18459 raft_consensus.cc:2804] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:58.396119 18459 raft_consensus.cc:697] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 LEADER]: Becoming Leader. State: Replica: d15307742e0d454ba0007e6c2383d893, State: Running, Role: LEADER
I20260709 13:18:58.396839 18459 consensus_queue.cc:237] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } }
I20260709 13:18:58.402216 18115 catalog_manager.cc:5697] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 reported cstate change: term changed from 1 to 2, leader changed from 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65) to d15307742e0d454ba0007e6c2383d893 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "d15307742e0d454ba0007e6c2383d893" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f628aa47687476f9b54a66c67835d72" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.427498 18220 raft_consensus.cc:1275] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Refusing update from remote peer 1f628aa47687476f9b54a66c67835d72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:58.428990 18415 consensus_queue.cc:1048] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a8eb037be741d5ba1526e84c0bb2e8" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:58.430670  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:18:58.443006 18368 raft_consensus.cc:1275] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Refusing update from remote peer 1f628aa47687476f9b54a66c67835d72: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:58.454676 18457 consensus_queue.cc:1048] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d15307742e0d454ba0007e6c2383d893" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 46049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:58.455856 18261 consensus_peers.cc:597] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 -> Peer 66a8eb037be741d5ba1526e84c0bb2e8 (127.9.68.65:44907): Couldn't send request to peer 66a8eb037be741d5ba1526e84c0bb2e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:58.467764  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:58.468323  9489 tablet_replica.cc:333] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: stopping tablet replica
I20260709 13:18:58.468875  9489 raft_consensus.cc:2243] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:58.469852  9489 pending_rounds.cc:70] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Trying to abort 1 pending ops.
I20260709 13:18:58.470093  9489 pending_rounds.cc:77] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638453966151680 op_type: NO_OP noop_request { }
I20260709 13:18:58.470386  9489 raft_consensus.cc:2889] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:58.470654  9489 raft_consensus.cc:2272] T 254d0f72c25f48cfb6383e56b7dd9828 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.473452  9489 tablet_replica.cc:333] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8: stopping tablet replica
I20260709 13:18:58.474296  9489 raft_consensus.cc:2243] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:58.475198  9489 raft_consensus.cc:2272] T 1a322ac852404d6d90236068e1f8c855 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.477399  9489 tablet_replica.cc:333] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8: stopping tablet replica
I20260709 13:18:58.477891  9489 raft_consensus.cc:2243] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.478276  9489 raft_consensus.cc:2272] T 32420f9183ef4e96984fafbd086c7dfc P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.480204  9489 tablet_replica.cc:333] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: stopping tablet replica
I20260709 13:18:58.480662  9489 raft_consensus.cc:2243] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.481001  9489 pending_rounds.cc:70] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Trying to abort 1 pending ops.
I20260709 13:18:58.481143  9489 pending_rounds.cc:77] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638453372366848 op_type: NO_OP noop_request { }
I20260709 13:18:58.481482  9489 raft_consensus.cc:2889] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:58.481748  9489 raft_consensus.cc:2272] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 66a8eb037be741d5ba1526e84c0bb2e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.494668  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
I20260709 13:18:58.507117  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
I20260709 13:18:58.525887  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:58.526427  9489 tablet_replica.cc:333] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72: stopping tablet replica
I20260709 13:18:58.526906  9489 raft_consensus.cc:2243] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.527278  9489 raft_consensus.cc:2272] T 254d0f72c25f48cfb6383e56b7dd9828 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.529896  9489 tablet_replica.cc:333] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72: stopping tablet replica
I20260709 13:18:58.530352  9489 raft_consensus.cc:2243] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.530695  9489 raft_consensus.cc:2272] T 32420f9183ef4e96984fafbd086c7dfc P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.532752  9489 tablet_replica.cc:333] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72: stopping tablet replica
I20260709 13:18:58.533284  9489 raft_consensus.cc:2243] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:58.534076  9489 raft_consensus.cc:2272] T a4dd91bc2f3b4138bc3776aa6b597fb6 P 1f628aa47687476f9b54a66c67835d72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.536382  9489 tablet_replica.cc:333] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72: stopping tablet replica
I20260709 13:18:58.536789  9489 raft_consensus.cc:2243] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.537114  9489 raft_consensus.cc:2272] T 1a322ac852404d6d90236068e1f8c855 P 1f628aa47687476f9b54a66c67835d72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.559108  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
I20260709 13:18:58.570030  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:18:58.588421  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:58.588981  9489 tablet_replica.cc:333] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893: stopping tablet replica
I20260709 13:18:58.589574  9489 raft_consensus.cc:2243] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.590010  9489 raft_consensus.cc:2272] T 254d0f72c25f48cfb6383e56b7dd9828 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.592012  9489 tablet_replica.cc:333] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893: stopping tablet replica
I20260709 13:18:58.592515  9489 raft_consensus.cc:2243] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.592895  9489 raft_consensus.cc:2272] T 1a322ac852404d6d90236068e1f8c855 P d15307742e0d454ba0007e6c2383d893 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.594972  9489 tablet_replica.cc:333] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: stopping tablet replica
I20260709 13:18:58.595454  9489 raft_consensus.cc:2243] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:58.595997  9489 pending_rounds.cc:70] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Trying to abort 1 pending ops.
I20260709 13:18:58.596180  9489 pending_rounds.cc:77] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638454879895552 op_type: NO_OP noop_request { }
I20260709 13:18:58.596434  9489 raft_consensus.cc:2889] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:58.596693  9489 raft_consensus.cc:2272] T 32420f9183ef4e96984fafbd086c7dfc P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.599076  9489 tablet_replica.cc:333] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893: stopping tablet replica
I20260709 13:18:58.599629  9489 raft_consensus.cc:2243] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:58.600039  9489 raft_consensus.cc:2272] T a4dd91bc2f3b4138bc3776aa6b597fb6 P d15307742e0d454ba0007e6c2383d893 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.622598  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:18:58.633883  9489 master.cc:562] Master@127.9.68.126:43329 shutting down...
I20260709 13:18:58.652856  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:58.653673  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:58.654057  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9adcedd9cdc74f118bce9c28b4fef084: stopping tablet replica
I20260709 13:18:58.666304  9489 master.cc:584] Master@127.9.68.126:43329 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2592 ms)
[----------] 6 tests from LeaderRebalancerTest (259497 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:18:58.699014  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:36901
I20260709 13:18:58.699980  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:58.705049 18468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:58.706424 18469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:58.706651 18471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:58.707048  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:58.707980  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:58.708220  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:58.708400  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603138708386 us; error 0 us; skew 500 ppm
I20260709 13:18:58.708972  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:58.711107  9489 webserver.cc:533] Webserver started at http://127.9.68.126:37531/ using document root <none> and password file <none>
I20260709 13:18:58.711555  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:58.711736  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:58.712011  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:58.712991  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "557e225848f840b9acf32003d59a999a"
format_stamp: "Formatted at 2026-07-09 13:18:58 on dist-test-slave-9s6w"
I20260709 13:18:58.718019  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:18:58.721292 18476 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:58.722203  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:58.722491  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "557e225848f840b9acf32003d59a999a"
format_stamp: "Formatted at 2026-07-09 13:18:58 on dist-test-slave-9s6w"
I20260709 13:18:58.722774  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:58.743608  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:58.744674  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:58.785677  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:36901
I20260709 13:18:58.785789 18527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:36901 every 8 connection(s)
I20260709 13:18:58.789280 18528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:58.799439 18528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: Bootstrap starting.
I20260709 13:18:58.803891 18528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.809715 18528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: No bootstrap required, opened a new log
I20260709 13:18:58.812207 18528 raft_consensus.cc:359] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER }
I20260709 13:18:58.812647 18528 raft_consensus.cc:385] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.812858 18528 raft_consensus.cc:740] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557e225848f840b9acf32003d59a999a, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.813547 18528 consensus_queue.cc:260] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER }
I20260709 13:18:58.814013 18528 raft_consensus.cc:399] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:58.814227 18528 raft_consensus.cc:493] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:58.814463 18528 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.820201 18528 raft_consensus.cc:515] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER }
I20260709 13:18:58.820683 18528 leader_election.cc:304] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 557e225848f840b9acf32003d59a999a; no voters: 
I20260709 13:18:58.821875 18528 leader_election.cc:290] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:58.822301 18531 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:58.824270 18531 raft_consensus.cc:697] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 1 LEADER]: Becoming Leader. State: Replica: 557e225848f840b9acf32003d59a999a, State: Running, Role: LEADER
I20260709 13:18:58.824507 18528 sys_catalog.cc:565] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:58.825042 18531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER }
I20260709 13:18:58.828044 18532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "557e225848f840b9acf32003d59a999a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER } }
I20260709 13:18:58.828289 18533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 557e225848f840b9acf32003d59a999a. Latest consensus state: current_term: 1 leader_uuid: "557e225848f840b9acf32003d59a999a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "557e225848f840b9acf32003d59a999a" member_type: VOTER } }
I20260709 13:18:58.828719 18532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:58.828830 18533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:58.831751 18538 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:58.836524 18538 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:58.840615  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:58.844615 18538 catalog_manager.cc:1383] Generated new cluster ID: ee8a72072e6d4f4ea501c69d975c6a3e
I20260709 13:18:58.845036 18538 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:58.862195 18538 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:58.863358 18538 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:58.880858 18538 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: Generated new TSK 0
I20260709 13:18:58.881379 18538 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:58.908195  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:58.914314 18549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:58.915759 18550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:58.917516 18552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:58.917866  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:58.918756  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:58.918974  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:58.919133  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603138919117 us; error 0 us; skew 500 ppm
I20260709 13:18:58.919647  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:58.921972  9489 webserver.cc:533] Webserver started at http://127.9.68.65:39371/ using document root <none> and password file <none>
I20260709 13:18:58.922431  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:58.922626  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:58.922883  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:58.923960  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "0b07f0363858493c83d7b3fea5327ead"
format_stamp: "Formatted at 2026-07-09 13:18:58 on dist-test-slave-9s6w"
I20260709 13:18:58.928501  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:58.931591 18557 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:58.932396  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:58.932638  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "0b07f0363858493c83d7b3fea5327ead"
format_stamp: "Formatted at 2026-07-09 13:18:58 on dist-test-slave-9s6w"
I20260709 13:18:58.932861  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:58.943938  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:58.944911  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:58.946372  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:58.948386  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:58.948560  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:58.948833  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:58.948973  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:58.987659  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:44973
I20260709 13:18:58.987766 18619 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:44973 every 8 connection(s)
I20260709 13:18:58.992377  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:58.999151 18624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:59.000456 18625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:59.004936 18627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:59.005072  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:59.006582  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:59.006806  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:59.006974 18620 heartbeater.cc:344] Connected to a master server at 127.9.68.126:36901
I20260709 13:18:59.007004  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603139006986 us; error 0 us; skew 500 ppm
I20260709 13:18:59.007510 18620 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:59.007982  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:59.008389 18620 heartbeater.cc:507] Master 127.9.68.126:36901 requested a full tablet report, sending...
I20260709 13:18:59.010521  9489 webserver.cc:533] Webserver started at http://127.9.68.66:43117/ using document root <none> and password file <none>
I20260709 13:18:59.010847 18493 ts_manager.cc:194] Registered new tserver with Master: 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973)
I20260709 13:18:59.011166  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:59.011466  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:59.011785  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:59.013157  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "756c8d53c710434e8a243ac69e140dba"
format_stamp: "Formatted at 2026-07-09 13:18:59 on dist-test-slave-9s6w"
I20260709 13:18:59.013175 18493 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37644
I20260709 13:18:59.018360  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:59.022076 18632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.022836  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:18:59.023131  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "756c8d53c710434e8a243ac69e140dba"
format_stamp: "Formatted at 2026-07-09 13:18:59 on dist-test-slave-9s6w"
I20260709 13:18:59.023391  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:59.041455  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:59.042320  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:59.043568  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:59.045637  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:59.045804  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.046079  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:59.046231  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.084473  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:35973
I20260709 13:18:59.084564 18694 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:35973 every 8 connection(s)
I20260709 13:18:59.089036  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:59.096561 18699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:59.096696 18698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:59.100431 18701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:59.100605  9489 server_base.cc:1061] running on GCE node
I20260709 13:18:59.100942 18695 heartbeater.cc:344] Connected to a master server at 127.9.68.126:36901
I20260709 13:18:59.101573 18695 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:59.101946  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:59.102231  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:59.102407  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603139102391 us; error 0 us; skew 500 ppm
I20260709 13:18:59.102512 18695 heartbeater.cc:507] Master 127.9.68.126:36901 requested a full tablet report, sending...
I20260709 13:18:59.103041  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:59.104737 18493 ts_manager.cc:194] Registered new tserver with Master: 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:18:59.105688  9489 webserver.cc:533] Webserver started at http://127.9.68.67:38927/ using document root <none> and password file <none>
I20260709 13:18:59.106194  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:59.106396  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:59.106256 18493 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37658
I20260709 13:18:59.106781  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:59.107965  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "1e2ec72689e54d81868d5956afecf07c"
format_stamp: "Formatted at 2026-07-09 13:18:59 on dist-test-slave-9s6w"
I20260709 13:18:59.112298  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:18:59.115533 18706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.116374  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:18:59.116613  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "1e2ec72689e54d81868d5956afecf07c"
format_stamp: "Formatted at 2026-07-09 13:18:59 on dist-test-slave-9s6w"
I20260709 13:18:59.116827  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:59.142834  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:59.143760  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:59.145107  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:59.147322  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:59.147630  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.148043  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:59.148237  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:59.191304  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:37733
I20260709 13:18:59.191423 18768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:37733 every 8 connection(s)
I20260709 13:18:59.206851 18769 heartbeater.cc:344] Connected to a master server at 127.9.68.126:36901
I20260709 13:18:59.207394 18769 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:59.208176 18769 heartbeater.cc:507] Master 127.9.68.126:36901 requested a full tablet report, sending...
I20260709 13:18:59.210366 18493 ts_manager.cc:194] Registered new tserver with Master: 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.211436  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017174756s
I20260709 13:18:59.212014 18493 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37668
I20260709 13:18:59.236558 18493 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37682:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:59.239013 18493 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:59.304582 18585 tablet_service.cc:1511] Processing CreateTablet for tablet 98c88af3f7644808b8bc8d09fbd926a4 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:59.305680 18585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c88af3f7644808b8bc8d09fbd926a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.305277 18584 tablet_service.cc:1511] Processing CreateTablet for tablet 30cf3061175f497c99a8d0974bd86b1d (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:59.307087 18584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cf3061175f497c99a8d0974bd86b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.309497 18583 tablet_service.cc:1511] Processing CreateTablet for tablet bfad3994192648c3ad66d610f9ce4c28 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:59.311110 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfad3994192648c3ad66d610f9ce4c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.330263 18784 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.333787 18660 tablet_service.cc:1511] Processing CreateTablet for tablet 98c88af3f7644808b8bc8d09fbd926a4 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:59.334573 18659 tablet_service.cc:1511] Processing CreateTablet for tablet 30cf3061175f497c99a8d0974bd86b1d (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:59.336349 18784 tablet_bootstrap.cc:654] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.335139 18660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c88af3f7644808b8bc8d09fbd926a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.336603 18585 tablet_service.cc:1511] Processing CreateTablet for tablet 44a025dd52e04dcdb2512536a3c3ef21 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:59.337868 18585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a025dd52e04dcdb2512536a3c3ef21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.335741 18658 tablet_service.cc:1511] Processing CreateTablet for tablet bfad3994192648c3ad66d610f9ce4c28 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:59.342906 18658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfad3994192648c3ad66d610f9ce4c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.347494 18583 tablet_service.cc:1511] Processing CreateTablet for tablet 06c9b14be4cd437a9312ded80f9b7641 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:59.348026 18659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cf3061175f497c99a8d0974bd86b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.348727 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c9b14be4cd437a9312ded80f9b7641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.351400 18734 tablet_service.cc:1511] Processing CreateTablet for tablet 98c88af3f7644808b8bc8d09fbd926a4 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:59.353879 18784 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.354386 18784 ts_tablet_manager.cc:1403] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:18:59.354598 18733 tablet_service.cc:1511] Processing CreateTablet for tablet 30cf3061175f497c99a8d0974bd86b1d (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:59.355199 18657 tablet_service.cc:1511] Processing CreateTablet for tablet 44a025dd52e04dcdb2512536a3c3ef21 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:59.356631 18657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a025dd52e04dcdb2512536a3c3ef21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.356922 18732 tablet_service.cc:1511] Processing CreateTablet for tablet bfad3994192648c3ad66d610f9ce4c28 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:59.357411 18784 raft_consensus.cc:359] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.358191 18784 raft_consensus.cc:385] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.358471 18784 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.358901 18731 tablet_service.cc:1511] Processing CreateTablet for tablet 44a025dd52e04dcdb2512536a3c3ef21 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:59.359149 18784 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.353164 18734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c88af3f7644808b8bc8d09fbd926a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.361301 18620 heartbeater.cc:499] Master 127.9.68.126:36901 was elected leader, sending a full tablet report...
I20260709 13:18:59.368768 18731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a025dd52e04dcdb2512536a3c3ef21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.369706 18732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfad3994192648c3ad66d610f9ce4c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.370307 18733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cf3061175f497c99a8d0974bd86b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.371906 18784 ts_tablet_manager.cc:1434] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:18:59.375212 18784 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.381125 18784 tablet_bootstrap.cc:654] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.397403 18656 tablet_service.cc:1511] Processing CreateTablet for tablet 06c9b14be4cd437a9312ded80f9b7641 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:59.399186 18656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c9b14be4cd437a9312ded80f9b7641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.425566 18730 tablet_service.cc:1511] Processing CreateTablet for tablet 06c9b14be4cd437a9312ded80f9b7641 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:59.426991 18730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c9b14be4cd437a9312ded80f9b7641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.425590 18784 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.435060 18784 ts_tablet_manager.cc:1403] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.025s
I20260709 13:18:59.434715 18656 tablet_service.cc:1511] Processing CreateTablet for tablet 54e722465c234305a3815e9e9b66a066 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:59.436530 18656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e722465c234305a3815e9e9b66a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.438138 18784 raft_consensus.cc:359] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.445474 18784 raft_consensus.cc:385] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.445858 18784 raft_consensus.cc:740] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.445925 18732 tablet_service.cc:1511] Processing CreateTablet for tablet 54e722465c234305a3815e9e9b66a066 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:59.447243 18732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e722465c234305a3815e9e9b66a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.446864 18784 consensus_queue.cc:260] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.440773 18584 tablet_service.cc:1511] Processing CreateTablet for tablet 54e722465c234305a3815e9e9b66a066 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:59.449141 18584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e722465c234305a3815e9e9b66a066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.450820 18784 ts_tablet_manager.cc:1434] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:18:59.451820 18784 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.454365 18789 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.442392 18788 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.459318 18784 tablet_bootstrap.cc:654] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.464473 18583 tablet_service.cc:1511] Processing CreateTablet for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:59.465700 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.465772 18658 tablet_service.cc:1511] Processing CreateTablet for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:59.467017 18658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.469048 18789 tablet_bootstrap.cc:654] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.480562 18731 tablet_service.cc:1511] Processing CreateTablet for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:59.486138 18788 tablet_bootstrap.cc:654] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.484460 18731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e2caf4bc94b8ca5a5b022f3c25cf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.486686 18784 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.488674 18784 ts_tablet_manager.cc:1403] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.014s
I20260709 13:18:59.491475 18784 raft_consensus.cc:359] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.487927 18789 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.492146 18784 raft_consensus.cc:385] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.492532 18789 ts_tablet_manager.cc:1403] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.007s
I20260709 13:18:59.492508 18784 raft_consensus.cc:740] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.493559 18784 consensus_queue.cc:260] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.494570 18585 tablet_service.cc:1511] Processing CreateTablet for tablet 43238fe01e2a492896103417790df294 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:59.495703 18784 ts_tablet_manager.cc:1434] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:59.496184 18585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43238fe01e2a492896103417790df294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.498077 18656 tablet_service.cc:1511] Processing CreateTablet for tablet 43238fe01e2a492896103417790df294 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:59.498936 18656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43238fe01e2a492896103417790df294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.507372 18583 tablet_service.cc:1511] Processing CreateTablet for tablet 88139800ee184027a6b58362b9b61516 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:59.508235 18732 tablet_service.cc:1511] Processing CreateTablet for tablet 43238fe01e2a492896103417790df294 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:59.509485 18732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43238fe01e2a492896103417790df294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.510150 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88139800ee184027a6b58362b9b61516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.512625 18658 tablet_service.cc:1511] Processing CreateTablet for tablet 88139800ee184027a6b58362b9b61516 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:59.513819 18658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88139800ee184027a6b58362b9b61516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.519901 18730 tablet_service.cc:1511] Processing CreateTablet for tablet 88139800ee184027a6b58362b9b61516 (DEFAULT_TABLE table=test-workload [id=551cf3f51222429ea57f2f56639ff5b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:59.521106 18730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88139800ee184027a6b58362b9b61516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:59.522152 18784 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.530440 18789 raft_consensus.cc:359] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.536506 18788 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.537792 18789 raft_consensus.cc:385] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.538029 18788 ts_tablet_manager.cc:1403] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.008s
I20260709 13:18:59.538139 18789 raft_consensus.cc:740] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.538993 18789 consensus_queue.cc:260] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.541074 18695 heartbeater.cc:499] Master 127.9.68.126:36901 was elected leader, sending a full tablet report...
I20260709 13:18:59.541061 18788 raft_consensus.cc:359] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.541976 18788 raft_consensus.cc:385] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.542265 18788 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.542965 18788 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.545179 18769 heartbeater.cc:499] Master 127.9.68.126:36901 was elected leader, sending a full tablet report...
I20260709 13:18:59.545759 18788 ts_tablet_manager.cc:1434] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:18:59.546799 18788 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.546877 18784 tablet_bootstrap.cc:654] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.552452 18788 tablet_bootstrap.cc:654] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.556831 18789 ts_tablet_manager.cc:1434] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:18:59.559193 18789 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.559242 18784 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.559777 18788 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.559950 18784 ts_tablet_manager.cc:1403] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.004s
I20260709 13:18:59.560281 18788 ts_tablet_manager.cc:1403] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:18:59.563076 18784 raft_consensus.cc:359] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.563812 18784 raft_consensus.cc:385] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.563731 18788 raft_consensus.cc:359] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.564383 18784 raft_consensus.cc:740] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.564702 18788 raft_consensus.cc:385] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.565089 18788 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.565384 18784 consensus_queue.cc:260] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.566217 18789 tablet_bootstrap.cc:654] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.565898 18788 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.568305 18784 ts_tablet_manager.cc:1434] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:59.569392 18784 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.571043 18788 ts_tablet_manager.cc:1434] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:59.572300 18788 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.575464 18784 tablet_bootstrap.cc:654] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.577224 18789 tablet_bootstrap.cc:492] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.577764 18789 ts_tablet_manager.cc:1403] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:18:59.579648 18788 tablet_bootstrap.cc:654] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.580508 18789 raft_consensus.cc:359] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.581260 18789 raft_consensus.cc:385] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.581588 18789 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.582731 18789 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.585937 18789 ts_tablet_manager.cc:1434] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:18:59.586609 18786 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.587152 18789 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.587267 18786 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.596354 18789 tablet_bootstrap.cc:654] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.596653 18788 tablet_bootstrap.cc:492] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.597165 18788 ts_tablet_manager.cc:1403] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:18:59.601030 18788 raft_consensus.cc:359] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.601760 18786 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.601985 18788 raft_consensus.cc:385] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.602520 18788 raft_consensus.cc:740] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.603510 18788 consensus_queue.cc:260] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.606308 18788 ts_tablet_manager.cc:1434] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:59.607251 18788 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.607360 18789 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.607844 18789 ts_tablet_manager.cc:1403] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:18:59.610975 18789 raft_consensus.cc:359] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.611670 18789 raft_consensus.cc:385] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.611961 18789 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.612780 18789 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.613814 18788 tablet_bootstrap.cc:654] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.615819 18789 ts_tablet_manager.cc:1434] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:18:59.616858 18789 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.630702 18789 tablet_bootstrap.cc:654] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.641542 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.642498 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
W20260709 13:18:59.644245 18560 leader_election.cc:343] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.644366 18784 tablet_bootstrap.cc:492] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.645053 18784 ts_tablet_manager.cc:1403] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.033s
I20260709 13:18:59.645799 18786 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.646924 18786 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.648228 18784 raft_consensus.cc:359] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.648918 18786 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.641808 18788 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
W20260709 13:18:59.645133 18558 leader_election.cc:343] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.650235 18558 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:18:59.650321 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.650341 18788 ts_tablet_manager.cc:1403] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.002s
I20260709 13:18:59.650981 18786 raft_consensus.cc:2749] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.651075 18744 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:18:59.649005 18784 raft_consensus.cc:385] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.652371 18784 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.652227 18560 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:18:59.653264 18786 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.653790 18786 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.653214 18784 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.654124 18786 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.654688 18788 raft_consensus.cc:359] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.655658 18788 raft_consensus.cc:385] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.656037 18788 raft_consensus.cc:740] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.657119 18788 consensus_queue.cc:260] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.664392 18786 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.666834 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:18:59.667686 18670 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:18:59.669166 18788 ts_tablet_manager.cc:1434] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:18:59.674683 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:18:59.675625 18670 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.679483 18788 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.687412 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:18:59.688220 18744 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.689049 18788 tablet_bootstrap.cc:654] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.697870 18793 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.697995 18786 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.698468 18793 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.700075 18789 tablet_bootstrap.cc:492] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.700589 18789 ts_tablet_manager.cc:1403] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.041s
I20260709 13:18:59.701116 18670 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:18:59.702713 18558 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.703706 18786 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.704438 18786 raft_consensus.cc:697] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:18:59.707777 18793 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733), 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973)
I20260709 13:18:59.708709 18793 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.709903 18793 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.705498 18786 consensus_queue.cc:237] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.711690 18744 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:18:59.712846 18793 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.715215 18784 ts_tablet_manager.cc:1434] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.070s	user 0.037s	sys 0.011s
I20260709 13:18:59.716557 18784 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.703840 18789 raft_consensus.cc:359] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.718663 18789 raft_consensus.cc:385] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.718951 18789 raft_consensus.cc:740] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.719741 18789 consensus_queue.cc:260] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.722090 18789 ts_tablet_manager.cc:1434] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:18:59.723178 18789 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.725445 18788 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.726054 18788 ts_tablet_manager.cc:1403] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.008s
I20260709 13:18:59.727799 18784 tablet_bootstrap.cc:654] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.730151 18789 tablet_bootstrap.cc:654] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.731421 18788 raft_consensus.cc:359] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.732189 18788 raft_consensus.cc:385] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.732478 18788 raft_consensus.cc:740] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.738289 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.738138 18788 consensus_queue.cc:260] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.738688 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.739025 18595 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.739612 18594 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.740048 18784 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.740753 18784 ts_tablet_manager.cc:1403] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:18:59.741384 18794 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.741653 18789 tablet_bootstrap.cc:492] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.742190 18794 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.743791 18784 raft_consensus.cc:359] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.742327 18789 ts_tablet_manager.cc:1403] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:18:59.744531 18784 raft_consensus.cc:385] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.745007 18784 raft_consensus.cc:740] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.745738 18784 consensus_queue.cc:260] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.748018 18784 ts_tablet_manager.cc:1434] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:18:59.747699 18789 raft_consensus.cc:359] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.748418 18789 raft_consensus.cc:385] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.748694 18789 raft_consensus.cc:740] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.749032 18784 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.749521 18789 consensus_queue.cc:260] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.750538 18636 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.751751 18789 ts_tablet_manager.cc:1434] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:18:59.753032 18789 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.754808 18788 ts_tablet_manager.cc:1434] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:18:59.756017 18788 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.756805 18784 tablet_bootstrap.cc:654] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.759477 18789 tablet_bootstrap.cc:654] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.751853 18636 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.768447 18793 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.768956 18793 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.769377 18793 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.773581 18794 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:18:59.778453 18809 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.782471 18809 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.787842 18809 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.794795 18793 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.800673 18794 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.801594 18794 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.804368 18794 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:18:59.806399 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.807021 18594 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.807947 18793 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733), 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973)
I20260709 13:18:59.816833 18594 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:18:59.818639 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.820277 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.840978 18595 raft_consensus.cc:2468] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:18:59.841167 18593 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:18:59.822203 18793 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.835669 18541 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:59.842777 18710 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:18:59.842643 18793 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.843933 18710 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:18:59.844789 18794 raft_consensus.cc:2804] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.845198 18794 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.845604 18794 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.846230 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.847092 18593 raft_consensus.cc:2468] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.846588 18492 catalog_manager.cc:5697] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 1 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.848532 18636 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.852264 18793 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.852931 18793 raft_consensus.cc:2804] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.853389 18793 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.853595 18813 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.854241 18813 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.854136 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.854592 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.855011 18813 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.855264 18744 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.856123 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:18:59.856775 18742 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.853833 18793 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.864096 18742 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:18:59.864539 18809 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.867298 18635 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.866219 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.867149 18788 tablet_bootstrap.cc:654] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.875272 18794 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.876914 18742 raft_consensus.cc:2393] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 756c8d53c710434e8a243ac69e140dba in current term 1: Already voted for candidate 1e2ec72689e54d81868d5956afecf07c in this term.
I20260709 13:18:59.882437 18788 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.883131 18788 ts_tablet_manager.cc:1403] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.002s
I20260709 13:18:59.884375 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:18:59.884923 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:18:59.886092 18669 raft_consensus.cc:2393] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 1: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:18:59.890344 18818 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:59.892292 18636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44973, user_credentials={real_user=slave}} blocked reactor thread for 43870.7us
I20260709 13:18:59.894375 18818 raft_consensus.cc:697] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:18:59.895829 18809 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.896466 18784 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.896968 18784 ts_tablet_manager.cc:1403] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.148s	user 0.048s	sys 0.089s
I20260709 13:18:59.896878 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:18:59.897413 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.898046 18594 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.895417 18818 consensus_queue.cc:237] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:18:59.900192 18784 raft_consensus.cc:359] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.900934 18784 raft_consensus.cc:385] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.901221 18784 raft_consensus.cc:740] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.901950 18784 consensus_queue.cc:260] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.899780 18813 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.904060 18743 raft_consensus.cc:2393] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 756c8d53c710434e8a243ac69e140dba in current term 1: Already voted for candidate 1e2ec72689e54d81868d5956afecf07c in this term.
I20260709 13:18:59.904194 18784 ts_tablet_manager.cc:1434] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:59.897706 18789 tablet_bootstrap.cc:492] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:18:59.907614 18813 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:18:59.905054 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.909706 18789 ts_tablet_manager.cc:1403] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.157s	user 0.024s	sys 0.051s
I20260709 13:18:59.907137 18788 raft_consensus.cc:359] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.905272 18784 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.905031 18594 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:18:59.908245 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.909817 18593 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.907161 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:18:59.914638 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:18:59.919734 18668 raft_consensus.cc:2393] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 1: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:18:59.888967 18793 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.920732 18670 raft_consensus.cc:2393] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 1: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:18:59.920903 18784 tablet_bootstrap.cc:654] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.921072 18707 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:18:59.921661 18789 raft_consensus.cc:359] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.922464 18789 raft_consensus.cc:385] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.922757 18789 raft_consensus.cc:740] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.923503 18793 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.924844 18813 raft_consensus.cc:2749] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.924683 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:18:59.931766 18743 raft_consensus.cc:2393] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 756c8d53c710434e8a243ac69e140dba in current term 1: Already voted for candidate 1e2ec72689e54d81868d5956afecf07c in this term.
I20260709 13:18:59.933154 18593 raft_consensus.cc:2468] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:18:59.910571 18788 raft_consensus.cc:385] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.934777 18788 raft_consensus.cc:740] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.935195 18636 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
I20260709 13:18:59.934264 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.936441 18594 raft_consensus.cc:2393] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 756c8d53c710434e8a243ac69e140dba in current term 1: Already voted for candidate 1e2ec72689e54d81868d5956afecf07c in this term.
I20260709 13:18:59.935801 18788 consensus_queue.cc:260] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.936745 18784 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.937271 18784 ts_tablet_manager.cc:1403] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 13:18:59.937292 18818 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.937889 18818 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.938319 18710 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:18:59.939883 18818 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:18:59.925669 18669 raft_consensus.cc:2393] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 1: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:18:59.940037 18784 raft_consensus.cc:359] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.940714 18784 raft_consensus.cc:385] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.940896 18793 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.941012 18784 raft_consensus.cc:740] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.941485 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:18:59.941749 18784 consensus_queue.cc:260] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.942474 18743 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.943085 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:18:59.943717 18593 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:18:59.943920 18784 ts_tablet_manager.cc:1434] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:18:59.943990 18635 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.909863 18794 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:18:59.944957 18784 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:18:59.945343 18818 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.945664 18636 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:18:59.945902 18818 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.946427 18818 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.947315 18821 raft_consensus.cc:2749] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.950989 18784 tablet_bootstrap.cc:654] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.952315 18788 ts_tablet_manager.cc:1434] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 13:18:59.952911 18794 raft_consensus.cc:2804] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.953449 18794 raft_consensus.cc:697] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:18:59.953645 18788 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:18:59.954510 18794 consensus_queue.cc:237] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.941483 18793 raft_consensus.cc:697] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:18:59.958000 18793 consensus_queue.cc:237] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.926113 18789 consensus_queue.cc:260] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.967415 18789 ts_tablet_manager.cc:1434] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:18:59.968462 18789 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:18:59.974092 18788 tablet_bootstrap.cc:654] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.973758 18490 catalog_manager.cc:5697] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.975112 18784 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:18:59.975728 18784 ts_tablet_manager.cc:1403] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.003s
I20260709 13:18:59.981014 18784 raft_consensus.cc:359] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.984750 18818 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.987974 18493 catalog_manager.cc:5697] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 1 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.988840 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:18:59.989194 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:18:59.989506 18743 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.989864 18594 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.990084 18789 tablet_bootstrap.cc:654] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.981828 18784 raft_consensus.cc:385] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.990986 18784 raft_consensus.cc:740] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.991622 18784 consensus_queue.cc:260] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.993856 18788 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:18:59.994431 18788 ts_tablet_manager.cc:1403] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.005s
I20260709 13:18:59.997020 18743 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:18:59.997431 18788 raft_consensus.cc:359] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:18:59.998267 18788 raft_consensus.cc:385] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.998359 18635 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:18:59.999257 18793 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.999361 18784 ts_tablet_manager.cc:1434] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:18:59.999788 18793 raft_consensus.cc:697] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:18:59.998654 18788 raft_consensus.cc:740] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.000665 18793 consensus_queue.cc:237] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.001001 18788 consensus_queue.cc:260] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.003208 18788 ts_tablet_manager.cc:1434] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:00.003576 18594 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.004200 18788 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:00.006430 18818 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.010458 18788 tablet_bootstrap.cc:654] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.012353 18789 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:00.012861 18789 ts_tablet_manager.cc:1403] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.003s
I20260709 13:19:00.011852 18491 catalog_manager.cc:5697] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.015640 18789 raft_consensus.cc:359] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.016222 18789 raft_consensus.cc:385] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.016505 18789 raft_consensus.cc:740] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.017237 18789 consensus_queue.cc:260] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.019534 18789 ts_tablet_manager.cc:1434] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:00.020448 18789 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:00.028553 18789 tablet_bootstrap.cc:654] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.029428 18491 catalog_manager.cc:5697] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.033116 18788 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:00.033563 18788 ts_tablet_manager.cc:1403] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:19:00.033871 18789 tablet_bootstrap.cc:492] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:00.034336 18789 ts_tablet_manager.cc:1403] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:19:00.036424 18788 raft_consensus.cc:359] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.036664 18789 raft_consensus.cc:359] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.037071 18788 raft_consensus.cc:385] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.037256 18789 raft_consensus.cc:385] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.037397 18788 raft_consensus.cc:740] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.037681 18789 raft_consensus.cc:740] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.038199 18788 consensus_queue.cc:260] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.038442 18789 consensus_queue.cc:260] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.040273 18788 ts_tablet_manager.cc:1434] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:00.040387 18789 ts_tablet_manager.cc:1434] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:00.041163 18788 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:00.041464 18789 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:00.047714 18789 tablet_bootstrap.cc:654] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.048137 18788 tablet_bootstrap.cc:654] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.053095 18789 tablet_bootstrap.cc:492] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:00.053524 18789 ts_tablet_manager.cc:1403] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:19:00.054709 18818 raft_consensus.cc:493] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.055019 18788 tablet_bootstrap.cc:492] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:00.055512 18788 ts_tablet_manager.cc:1403] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:19:00.055241 18818 raft_consensus.cc:515] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.055981 18789 raft_consensus.cc:359] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.056620 18789 raft_consensus.cc:385] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.056864 18789 raft_consensus.cc:740] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.057514 18789 consensus_queue.cc:260] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.058467 18788 raft_consensus.cc:359] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.058674 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:00.059113 18788 raft_consensus.cc:385] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.059363 18594 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.059407 18788 raft_consensus.cc:740] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.059751 18789 ts_tablet_manager.cc:1434] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:00.060387 18788 consensus_queue.cc:260] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.061041 18636 leader_election.cc:304] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.061877 18793 raft_consensus.cc:2804] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.062206 18788 ts_tablet_manager.cc:1434] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:00.062247 18793 raft_consensus.cc:493] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.062810 18793 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.063324 18818 leader_election.cc:290] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.069832 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:00.070425 18743 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.080531 18793 raft_consensus.cc:515] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.082618 18793 leader_election.cc:290] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.083317 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.083818 18594 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.083824 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.084460 18743 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.088593 18594 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.089059 18743 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.089519 18636 leader_election.cc:304] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.090176 18793 raft_consensus.cc:2804] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.090554 18793 raft_consensus.cc:697] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.091285 18793 consensus_queue.cc:237] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.096427 18793 raft_consensus.cc:493] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.096776 18793 raft_consensus.cc:515] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.098421 18793 leader_election.cc:290] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.099256 18793 raft_consensus.cc:493] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.099592 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:00.099612 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:00.099889 18793 raft_consensus.cc:515] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.100621 18743 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.100888 18594 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.099967 18492 catalog_manager.cc:5697] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.101954 18635 leader_election.cc:304] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.102612 18793 leader_election.cc:290] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.102743 18818 raft_consensus.cc:2804] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.103264 18818 raft_consensus.cc:493] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.103595 18818 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.103787 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:00.104498 18594 raft_consensus.cc:2468] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.105605 18636 leader_election.cc:304] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.106446 18793 raft_consensus.cc:2804] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.106887 18793 raft_consensus.cc:493] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.107263 18793 raft_consensus.cc:3060] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.110827 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:00.110809 18818 raft_consensus.cc:515] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.112121 18742 raft_consensus.cc:2468] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.113938 18793 raft_consensus.cc:515] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.114094 18818 leader_election.cc:290] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.114164 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.115015 18594 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.115260 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.115968 18743 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.116062 18793 leader_election.cc:290] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.116758 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.117395 18593 raft_consensus.cc:3060] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.117702 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.118263 18742 raft_consensus.cc:3060] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.123171 18594 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.123870 18743 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.124776 18636 leader_election.cc:304] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.125471 18742 raft_consensus.cc:2468] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.125744 18793 raft_consensus.cc:2804] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.126569 18593 raft_consensus.cc:2468] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.126724 18793 raft_consensus.cc:697] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.126837 18635 leader_election.cc:304] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.127923 18818 raft_consensus.cc:2804] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.128083 18793 consensus_queue.cc:237] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.128492 18818 raft_consensus.cc:697] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.129419 18818 consensus_queue.cc:237] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.136451 18492 catalog_manager.cc:5697] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.148242 18492 catalog_manager.cc:5697] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.176275 18786 consensus_queue.cc:1048] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.187592 18818 raft_consensus.cc:493] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.188194 18818 raft_consensus.cc:515] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.190699 18786 consensus_queue.cc:1048] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.195464 18818 leader_election.cc:290] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.195915 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:00.196619 18593 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.195941 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:00.197981 18743 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:00.199361 18636 leader_election.cc:304] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.200057 18818 raft_consensus.cc:2804] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.200439 18818 raft_consensus.cc:493] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.201434 18818 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.207653 18818 raft_consensus.cc:515] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.209971 18818 leader_election.cc:290] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.210424 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.210976 18593 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.211241 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.212105 18742 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.216238 18593 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.217216 18636 leader_election.cc:304] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.217906 18818 raft_consensus.cc:2804] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.218313 18818 raft_consensus.cc:697] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.219123 18818 consensus_queue.cc:237] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.219798 18742 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:00.225663 18493 catalog_manager.cc:5697] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.343919 18818 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.353757 18793 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.381871 18793 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.383359 18794 consensus_queue.cc:1048] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.395882 18793 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.408910 18813 consensus_queue.cc:1048] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.419094 18793 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.436046 18793 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.446832 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:00.447336 18669 raft_consensus.cc:606] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:00.452728 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:00.453452 18669 raft_consensus.cc:606] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:00.462205 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:00.462692 18669 raft_consensus.cc:606] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:00.473845 18793 consensus_queue.cc:1048] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.476850 18743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
mode: GRACEFUL
new_leader_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:44910
I20260709 13:19:00.477535 18743 raft_consensus.cc:606] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Received request to transfer leadership to TS 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:00.484331 18818 consensus_queue.cc:1048] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.497012 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88139800ee184027a6b58362b9b61516"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:00.497558 18669 raft_consensus.cc:606] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:00.558141 18818 consensus_queue.cc:1048] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.570037 18818 consensus_queue.cc:1048] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.577518 18818 consensus_queue.cc:1048] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.587354 18821 consensus_queue.cc:1048] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.657099 18821 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.667019 18821 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.675571 18818 raft_consensus.cc:993] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:00.676187 18821 raft_consensus.cc:1081] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:00.677639 18743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88139800ee184027a6b58362b9b61516"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:44898
I20260709 13:19:00.678092 18743 raft_consensus.cc:493] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.678375 18743 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.683609 18743 raft_consensus.cc:515] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.685500 18743 leader_election.cc:290] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:00.686080 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.686565 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:00.686717 18593 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.687173 18669 raft_consensus.cc:3055] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.687521 18669 raft_consensus.cc:740] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.688297 18669 consensus_queue.cc:260] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.689560 18669 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.693593 18593 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:00.694690 18710 leader_election.cc:304] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:00.695643 18813 raft_consensus.cc:2804] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.696053 18813 raft_consensus.cc:697] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:00.696731 18813 consensus_queue.cc:237] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.697073 18669 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:00.702680 18492 catalog_manager.cc:5697] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 2 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:00.834527 18818 raft_consensus.cc:993] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.835006 18821 raft_consensus.cc:1081] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.836447 18593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:00.836953 18593 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.837287 18593 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.841820 18593 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.843619 18593 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.844254 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:00.844723 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.844954 18669 raft_consensus.cc:3055] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.845283 18669 raft_consensus.cc:740] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.845353 18743 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.846256 18669 consensus_queue.cc:260] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.847514 18669 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.852216 18743 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:00.853531 18560 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:00.854368 18805 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.854264 18669 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:00.854892 18805 raft_consensus.cc:697] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:00.855746 18805 consensus_queue.cc:237] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.859383 18826 raft_consensus.cc:993] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: : Instructing follower 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:00.859892 18826 raft_consensus.cc:1081] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Signalling peer 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:00.861497 18669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:19:00.861910 18669 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.862174 18669 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.862607 18492 catalog_manager.cc:5697] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.866372 18669 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.868206 18669 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.868813 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:00.869230 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.869496 18593 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.869904 18743 raft_consensus.cc:3055] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.870239 18743 raft_consensus.cc:740] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:00.871121 18743 consensus_queue.cc:260] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.872026 18743 raft_consensus.cc:3060] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.874257 18593 raft_consensus.cc:2468] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:00.875216 18636 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:00.875903 18821 raft_consensus.cc:2804] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.876401 18821 raft_consensus.cc:697] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.877043 18743 raft_consensus.cc:2468] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:00.877204 18821 consensus_queue.cc:237] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.883216 18492 catalog_manager.cc:5697] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 1 to 2, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 2 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.952071 18818 raft_consensus.cc:993] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.952600 18821 raft_consensus.cc:1081] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.954362 18593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:00.954985 18593 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.955305 18593 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.961169 18593 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.963734 18593 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:00.963788 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:00.964603 18669 raft_consensus.cc:3055] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.964933 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.964964 18669 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.965688 18743 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.966125 18669 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.968708 18669 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.970355 18818 raft_consensus.cc:993] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.970830 18821 raft_consensus.cc:1081] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:00.972411 18593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:00.972980 18593 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.973402 18593 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.973539 18743 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:00.974656 18560 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:00.975440 18805 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.975919 18805 raft_consensus.cc:697] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:00.976722 18669 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:00.976874 18805 consensus_queue.cc:237] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:00.979902 18593 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:00.981801 18593 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:00.982931 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:00.983584 18743 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.983764 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:00.984701 18492 catalog_manager.cc:5697] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.985728 18669 raft_consensus.cc:3055] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.986129 18669 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:00.987005 18669 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:00.988168 18669 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.991739 18743 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:00.992614 18742 raft_consensus.cc:1240] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Rejecting Update request from peer 756c8d53c710434e8a243ac69e140dba for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.993008 18560 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:00.993723 18805 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.994217 18805 raft_consensus.cc:697] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:00.995023 18805 consensus_queue.cc:237] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:00.995438 18669 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:01.001405 18492 catalog_manager.cc:5697] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.144881 18593 raft_consensus.cc:1275] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.146370 18826 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.156750 18669 raft_consensus.cc:1275] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.158114 18826 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.296366 18742 raft_consensus.cc:1275] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.297772 18805 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.305748 18669 raft_consensus.cc:1275] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.307312 18805 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.337690 18742 raft_consensus.cc:1275] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.339001 18821 consensus_queue.cc:1048] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.346959 18593 raft_consensus.cc:1275] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.348582 18793 consensus_queue.cc:1048] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.407166 18669 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.408316 18805 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.417332 18742 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.418991 18869 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.453191 18742 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.454646 18869 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:01.463896 18669 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.465533 18805 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:03.529390 18492 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37698:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:03.531487 18492 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:03.583338 18583 tablet_service.cc:1511] Processing CreateTablet for tablet ba3309a976ea4ff5b3c4350e41f5695c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:03.584599 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3309a976ea4ff5b3c4350e41f5695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.585109 18658 tablet_service.cc:1511] Processing CreateTablet for tablet ba3309a976ea4ff5b3c4350e41f5695c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:03.586308 18658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3309a976ea4ff5b3c4350e41f5695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.586454 18731 tablet_service.cc:1511] Processing CreateTablet for tablet ba3309a976ea4ff5b3c4350e41f5695c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:03.587620 18731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3309a976ea4ff5b3c4350e41f5695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.593214 18585 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:03.594470 18585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.607174 18885 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.611003 18656 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:03.612546 18656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.612928 18883 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:03.612317 18731 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:03.614514 18731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.615296 18584 tablet_service.cc:1511] Processing CreateTablet for tablet be9282c852c54d30be5803d1186aca10 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:03.616554 18584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9282c852c54d30be5803d1186aca10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.617820 18658 tablet_service.cc:1511] Processing CreateTablet for tablet be9282c852c54d30be5803d1186aca10 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:03.619369 18658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9282c852c54d30be5803d1186aca10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.619660 18883 tablet_bootstrap.cc:654] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.627107 18730 tablet_service.cc:1511] Processing CreateTablet for tablet be9282c852c54d30be5803d1186aca10 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:03.627637 18884 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.628423 18730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9282c852c54d30be5803d1186aca10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.640545 18583 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a3532b12246858caf47243b4b5ccc (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:03.641494 18659 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a3532b12246858caf47243b4b5ccc (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:03.641906 18583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a3532b12246858caf47243b4b5ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.642724 18659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a3532b12246858caf47243b4b5ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.646710 18732 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a3532b12246858caf47243b4b5ccc (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:03.648367 18732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a3532b12246858caf47243b4b5ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.648403 18582 tablet_service.cc:1511] Processing CreateTablet for tablet 32a95c9092a144a098029f202eea1e9c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:03.650060 18582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a95c9092a144a098029f202eea1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.652556 18660 tablet_service.cc:1511] Processing CreateTablet for tablet 32a95c9092a144a098029f202eea1e9c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:03.653982 18660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a95c9092a144a098029f202eea1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.660717 18733 tablet_service.cc:1511] Processing CreateTablet for tablet 32a95c9092a144a098029f202eea1e9c (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:03.662158 18733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32a95c9092a144a098029f202eea1e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.662782 18657 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcc4cc3abde4ea480464c9a5d260be1 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:03.664049 18657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcc4cc3abde4ea480464c9a5d260be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.662853 18584 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcc4cc3abde4ea480464c9a5d260be1 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:03.666158 18584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcc4cc3abde4ea480464c9a5d260be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.666320 18734 tablet_service.cc:1511] Processing CreateTablet for tablet 9dcc4cc3abde4ea480464c9a5d260be1 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:03.667564 18734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcc4cc3abde4ea480464c9a5d260be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.668538 18885 tablet_bootstrap.cc:654] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.672237 18585 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd311c2dec941ce917bf471ec13d484 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:03.673928 18655 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd311c2dec941ce917bf471ec13d484 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:03.675215 18655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd311c2dec941ce917bf471ec13d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.675966 18729 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd311c2dec941ce917bf471ec13d484 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:03.677229 18729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd311c2dec941ce917bf471ec13d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.677990 18585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd311c2dec941ce917bf471ec13d484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.685114 18581 tablet_service.cc:1511] Processing CreateTablet for tablet 39320057629e4772923006cc806db450 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:03.686426 18581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39320057629e4772923006cc806db450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.687251 18654 tablet_service.cc:1511] Processing CreateTablet for tablet 39320057629e4772923006cc806db450 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:03.688535 18654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39320057629e4772923006cc806db450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.689179 18728 tablet_service.cc:1511] Processing CreateTablet for tablet 39320057629e4772923006cc806db450 (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:03.690462 18728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39320057629e4772923006cc806db450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.691614 18580 tablet_service.cc:1511] Processing CreateTablet for tablet 5400828c3bf94c0187309b6343e329ec (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:03.692847 18580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5400828c3bf94c0187309b6343e329ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.694212 18653 tablet_service.cc:1511] Processing CreateTablet for tablet 5400828c3bf94c0187309b6343e329ec (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:03.695482 18653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5400828c3bf94c0187309b6343e329ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.696717 18727 tablet_service.cc:1511] Processing CreateTablet for tablet 5400828c3bf94c0187309b6343e329ec (DEFAULT_TABLE table=soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:03.698361 18727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5400828c3bf94c0187309b6343e329ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.713613 18884 tablet_bootstrap.cc:654] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.781997 18883 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:03.782747 18883 ts_tablet_manager.cc:1403] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.170s	user 0.039s	sys 0.025s
I20260709 13:19:03.786473 18883 raft_consensus.cc:359] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.787074 18883 raft_consensus.cc:385] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.787318 18883 raft_consensus.cc:740] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.787974 18883 consensus_queue.cc:260] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.794170 18883 ts_tablet_manager.cc:1434] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:03.795171 18883 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:03.798736 18884 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.799324 18884 ts_tablet_manager.cc:1403] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.016s
I20260709 13:19:03.803252 18884 raft_consensus.cc:359] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.804569 18884 raft_consensus.cc:385] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.804921 18884 raft_consensus.cc:740] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.805099 18883 tablet_bootstrap.cc:654] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.806095 18885 tablet_bootstrap.cc:492] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.805830 18884 consensus_queue.cc:260] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.806695 18885 ts_tablet_manager.cc:1403] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.200s	user 0.007s	sys 0.014s
I20260709 13:19:03.808144 18884 ts_tablet_manager.cc:1434] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:03.809296 18884 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.809671 18885 raft_consensus.cc:359] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.810413 18885 raft_consensus.cc:385] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.810740 18885 raft_consensus.cc:740] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.811473 18885 consensus_queue.cc:260] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.813791 18885 ts_tablet_manager.cc:1434] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:19:03.814901 18885 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.822589 18885 tablet_bootstrap.cc:654] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.827796 18884 tablet_bootstrap.cc:654] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.846752 18883 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:03.846869 18884 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.847265 18883 ts_tablet_manager.cc:1403] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.033s
I20260709 13:19:03.847308 18885 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.847354 18884 ts_tablet_manager.cc:1403] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.007s
I20260709 13:19:03.848107 18885 ts_tablet_manager.cc:1403] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.018s
I20260709 13:19:03.850346 18883 raft_consensus.cc:359] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.851179 18883 raft_consensus.cc:385] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.851040 18885 raft_consensus.cc:359] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.851609 18883 raft_consensus.cc:740] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.851859 18885 raft_consensus.cc:385] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.851625 18884 raft_consensus.cc:359] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.852293 18885 raft_consensus.cc:740] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.852610 18884 raft_consensus.cc:385] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.852567 18883 consensus_queue.cc:260] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.853127 18884 raft_consensus.cc:740] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.853113 18885 consensus_queue.cc:260] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.854146 18884 consensus_queue.cc:260] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.855183 18883 ts_tablet_manager.cc:1434] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:03.855379 18885 ts_tablet_manager.cc:1434] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:03.856218 18883 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:03.856483 18885 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.856714 18884 ts_tablet_manager.cc:1434] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:03.857911 18884 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.863240 18883 tablet_bootstrap.cc:654] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.864333 18884 tablet_bootstrap.cc:654] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.866497 18885 tablet_bootstrap.cc:654] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.876955 18884 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.876999 18883 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:03.877632 18884 ts_tablet_manager.cc:1403] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:19:03.877723 18883 ts_tablet_manager.cc:1403] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:19:03.877738 18885 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.878593 18885 ts_tablet_manager.cc:1403] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
W20260709 13:19:03.880875 18541 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:03.881398 18884 raft_consensus.cc:359] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.881738 18885 raft_consensus.cc:359] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.882316 18884 raft_consensus.cc:385] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.882596 18885 raft_consensus.cc:385] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.882781 18884 raft_consensus.cc:740] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.883095 18885 raft_consensus.cc:740] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.883679 18883 raft_consensus.cc:359] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.883920 18884 consensus_queue.cc:260] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.884032 18885 consensus_queue.cc:260] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.884583 18883 raft_consensus.cc:385] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.885368 18883 raft_consensus.cc:740] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.886679 18885 ts_tablet_manager.cc:1434] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:19:03.886343 18883 consensus_queue.cc:260] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.886942 18884 ts_tablet_manager.cc:1434] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:19:03.887740 18885 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.887988 18884 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.888950 18883 ts_tablet_manager.cc:1434] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:03.890261 18883 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:03.896134 18884 tablet_bootstrap.cc:654] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.897545 18883 tablet_bootstrap.cc:654] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.899314 18885 tablet_bootstrap.cc:654] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.908810 18884 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.909403 18884 ts_tablet_manager.cc:1403] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:19:03.909792 18883 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:03.910369 18883 ts_tablet_manager.cc:1403] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 13:19:03.910732 18885 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.911259 18885 ts_tablet_manager.cc:1403] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:19:03.912333 18884 raft_consensus.cc:359] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.913216 18884 raft_consensus.cc:385] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.913605 18884 raft_consensus.cc:740] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.913307 18883 raft_consensus.cc:359] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.914211 18883 raft_consensus.cc:385] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.914150 18885 raft_consensus.cc:359] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.914762 18883 raft_consensus.cc:740] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.914584 18884 consensus_queue.cc:260] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.915174 18885 raft_consensus.cc:385] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.915616 18885 raft_consensus.cc:740] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.916379 18885 consensus_queue.cc:260] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.916989 18884 ts_tablet_manager.cc:1434] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:03.918098 18884 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.918713 18885 ts_tablet_manager.cc:1434] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:03.919693 18885 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.923940 18883 consensus_queue.cc:260] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.924486 18884 tablet_bootstrap.cc:654] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.926017 18885 tablet_bootstrap.cc:654] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.927059 18883 ts_tablet_manager.cc:1434] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:19:03.928256 18883 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:03.936496 18885 tablet_bootstrap.cc:492] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.936939 18885 ts_tablet_manager.cc:1403] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:19:03.937199 18883 tablet_bootstrap.cc:654] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.939715 18884 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.939736 18885 raft_consensus.cc:359] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.940346 18884 ts_tablet_manager.cc:1403] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:19:03.940655 18885 raft_consensus.cc:385] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.940969 18885 raft_consensus.cc:740] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.941730 18885 consensus_queue.cc:260] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.943392 18884 raft_consensus.cc:359] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.943986 18885 ts_tablet_manager.cc:1434] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:03.944113 18884 raft_consensus.cc:385] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.944463 18884 raft_consensus.cc:740] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.944973 18885 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:03.945739 18884 consensus_queue.cc:260] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.951992 18885 tablet_bootstrap.cc:654] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.952661 18884 ts_tablet_manager.cc:1434] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:03.953289 18818 raft_consensus.cc:493] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.954110 18884 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:03.953819 18818 raft_consensus.cc:515] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.956045 18818 leader_election.cc:290] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:03.957641 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:03.960107 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:03.960712 18593 raft_consensus.cc:2468] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
W20260709 13:19:03.962334 18635 leader_election.cc:343] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.963168 18636 leader_election.cc:304] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:03.965211 18826 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.965727 18826 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.967590 18826 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:03.968165 18818 raft_consensus.cc:2804] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.968581 18818 raft_consensus.cc:493] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.968863 18818 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.973955 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:03.974889 18884 tablet_bootstrap.cc:654] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:03.976518 18707 leader_election.cc:343] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.978922 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:03.980119 18883 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:03.979799 18818 raft_consensus.cc:515] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
W20260709 13:19:03.980595 18710 leader_election.cc:343] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.980609 18883 ts_tablet_manager.cc:1403] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.013s
I20260709 13:19:03.981235 18710 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:03.982841 18902 raft_consensus.cc:2749] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.982888 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:03.983800 18593 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.984050 18883 raft_consensus.cc:359] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.984745 18883 raft_consensus.cc:385] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.985029 18883 raft_consensus.cc:740] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.985783 18883 consensus_queue.cc:260] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.986466 18884 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:03.986999 18884 ts_tablet_manager.cc:1403] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.005s
I20260709 13:19:03.987506 18885 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:03.988030 18885 ts_tablet_manager.cc:1403] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.014s
I20260709 13:19:03.990175 18884 raft_consensus.cc:359] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.990942 18884 raft_consensus.cc:385] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.990938 18885 raft_consensus.cc:359] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.991456 18884 raft_consensus.cc:740] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.991892 18885 raft_consensus.cc:385] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.992105 18593 raft_consensus.cc:2468] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:03.993212 18818 leader_election.cc:290] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:03.992450 18884 consensus_queue.cc:260] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.994261 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:03.992341 18885 raft_consensus.cc:740] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.997076 18884 ts_tablet_manager.cc:1434] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:03.997455 18885 consensus_queue.cc:260] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:03.998312 18884 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:04.005669 18884 tablet_bootstrap.cc:654] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.006249 18885 ts_tablet_manager.cc:1434] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:19:03.994391 18636 leader_election.cc:304] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.007390 18885 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
W20260709 13:19:04.007599 18635 leader_election.cc:343] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.014487 18883 ts_tablet_manager.cc:1434] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.007s
I20260709 13:19:04.015911 18885 tablet_bootstrap.cc:654] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.017406 18904 raft_consensus.cc:2804] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.020733 18805 raft_consensus.cc:493] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.021288 18805 raft_consensus.cc:515] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.022950 18883 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:04.025580 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.026003 18805 leader_election.cc:290] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.027109 18904 raft_consensus.cc:697] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.027231 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
W20260709 13:19:04.027869 18558 leader_election.cc:343] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.028764 18560 leader_election.cc:343] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.029194 18560 leader_election.cc:304] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.028064 18904 consensus_queue.cc:237] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.030591 18805 raft_consensus.cc:2749] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.031535 18883 tablet_bootstrap.cc:654] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.036129 18884 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:04.037062 18884 ts_tablet_manager.cc:1403] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.015s
I20260709 13:19:04.038507 18885 tablet_bootstrap.cc:492] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:04.039096 18885 ts_tablet_manager.cc:1403] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.002s
I20260709 13:19:04.041214 18884 raft_consensus.cc:359] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.042121 18884 raft_consensus.cc:385] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.042488 18884 raft_consensus.cc:740] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.042691 18883 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:04.043329 18883 ts_tablet_manager.cc:1403] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:19:04.043212 18885 raft_consensus.cc:359] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.043421 18884 consensus_queue.cc:260] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.044165 18885 raft_consensus.cc:385] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.045058 18492 catalog_manager.cc:5697] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.045816 18884 ts_tablet_manager.cc:1434] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:19:04.046901 18884 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:04.046972 18883 raft_consensus.cc:359] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.047747 18883 raft_consensus.cc:385] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.050649 18883 raft_consensus.cc:740] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.050781 18904 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.051492 18883 consensus_queue.cc:260] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.051565 18904 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.054253 18883 ts_tablet_manager.cc:1434] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:04.054777 18904 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.055857 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:04.056525 18743 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:04.056681 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.057272 18593 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:04.057878 18635 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.059031 18883 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:04.060622 18904 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.061120 18904 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.061554 18904 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.064172 18884 tablet_bootstrap.cc:654] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.058046 18885 raft_consensus.cc:740] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.065649 18883 tablet_bootstrap.cc:654] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.065910 18885 consensus_queue.cc:260] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.068871 18885 ts_tablet_manager.cc:1434] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:19:04.069857 18885 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:04.069617 18904 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.071623 18904 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.072671 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.073259 18743 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.073964 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.074499 18593 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.079013 18885 tablet_bootstrap.cc:654] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.080596 18743 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:04.081943 18593 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:04.084786 18883 tablet_bootstrap.cc:492] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:04.086432 18883 ts_tablet_manager.cc:1403] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 13:19:04.086963 18636 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.087795 18904 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.089588 18885 tablet_bootstrap.cc:492] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:04.088398 18904 raft_consensus.cc:697] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.094149 18885 ts_tablet_manager.cc:1403] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 13:19:04.094789 18904 consensus_queue.cc:237] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.089646 18883 raft_consensus.cc:359] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.095909 18883 raft_consensus.cc:385] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.096238 18883 raft_consensus.cc:740] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.096963 18884 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:04.097587 18884 ts_tablet_manager.cc:1403] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.007s
I20260709 13:19:04.096967 18885 raft_consensus.cc:359] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.097108 18883 consensus_queue.cc:260] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.098062 18885 raft_consensus.cc:385] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.098407 18885 raft_consensus.cc:740] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.099135 18885 consensus_queue.cc:260] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.101261 18885 ts_tablet_manager.cc:1434] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:04.102273 18885 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: Bootstrap starting.
I20260709 13:19:04.103174 18883 ts_tablet_manager.cc:1434] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:19:04.104176 18883 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:04.108464 18885 tablet_bootstrap.cc:654] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.109531 18884 raft_consensus.cc:359] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.110474 18884 raft_consensus.cc:385] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.110787 18884 raft_consensus.cc:740] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.111764 18884 consensus_queue.cc:260] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.113766 18884 ts_tablet_manager.cc:1434] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:04.121122 18883 tablet_bootstrap.cc:654] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.124541 18885 tablet_bootstrap.cc:492] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: No bootstrap required, opened a new log
I20260709 13:19:04.124971 18885 ts_tablet_manager.cc:1403] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:19:04.126603 18883 tablet_bootstrap.cc:492] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:04.127276 18883 ts_tablet_manager.cc:1403] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:19:04.127625 18885 raft_consensus.cc:359] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.128309 18885 raft_consensus.cc:385] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.128564 18885 raft_consensus.cc:740] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.129223 18885 consensus_queue.cc:260] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.129662 18902 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.129997 18883 raft_consensus.cc:359] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.130200 18902 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.130690 18883 raft_consensus.cc:385] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.130967 18883 raft_consensus.cc:740] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.131219 18885 ts_tablet_manager.cc:1434] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:04.131369 18492 catalog_manager.cc:5697] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.132977 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.134794 18594 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.134157 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
W20260709 13:19:04.136178 18707 leader_election.cc:343] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.136893 18884 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: Bootstrap starting.
I20260709 13:19:04.132335 18902 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.131599 18883 consensus_queue.cc:260] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.136787 18710 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.138674 18902 raft_consensus.cc:2804] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.139061 18902 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.139441 18902 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.139492 18883 ts_tablet_manager.cc:1434] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:04.140501 18883 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: Bootstrap starting.
I20260709 13:19:04.144702 18883 tablet_bootstrap.cc:654] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.150615 18884 tablet_bootstrap.cc:654] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.150615 18902 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.152737 18826 raft_consensus.cc:493] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.153227 18826 raft_consensus.cc:515] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.153772 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.154518 18594 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.155299 18826 leader_election.cc:290] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.156062 18883 tablet_bootstrap.cc:492] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: No bootstrap required, opened a new log
I20260709 13:19:04.156484 18883 ts_tablet_manager.cc:1403] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:04.159067 18883 raft_consensus.cc:359] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.159659 18883 raft_consensus.cc:385] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.159896 18883 raft_consensus.cc:740] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.160316 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.160545 18883 consensus_queue.cc:260] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.161156 18669 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.162693 18883 ts_tablet_manager.cc:1434] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:04.163810 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.164584 18593 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.167131 18707 leader_election.cc:304] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.167904 18826 raft_consensus.cc:2804] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.168244 18826 raft_consensus.cc:493] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.168537 18826 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.174043 18826 raft_consensus.cc:515] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.174329 18594 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.175529 18710 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.176249 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.177000 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.177999 18670 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.177000 18902 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.179250 18902 raft_consensus.cc:2804] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.176999 18669 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.180576 18902 raft_consensus.cc:697] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.181275 18902 consensus_queue.cc:237] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.184149 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.184790 18594 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.178025 18884 tablet_bootstrap.cc:492] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: No bootstrap required, opened a new log
I20260709 13:19:04.187012 18884 ts_tablet_manager.cc:1403] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.015s
I20260709 13:19:04.187238 18670 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.188771 18707 leader_election.cc:304] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.189680 18902 raft_consensus.cc:2804] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.179770 18826 leader_election.cc:290] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.190217 18902 raft_consensus.cc:697] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.190451 18594 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.191370 18902 consensus_queue.cc:237] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.192381 18669 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.190212 18884 raft_consensus.cc:359] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.193301 18884 raft_consensus.cc:385] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.193651 18884 raft_consensus.cc:740] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.193912 18918 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.194303 18884 consensus_queue.cc:260] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.194420 18918 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.196762 18918 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.196204 18491 catalog_manager.cc:5697] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 1 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.197726 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.198491 18594 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.199025 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.199707 18670 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.199755 18710 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.201830 18826 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.202311 18826 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.202759 18826 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.204859 18884 ts_tablet_manager.cc:1434] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:19:04.210258 18904 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.210675 18904 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.211532 18826 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.212284 18904 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.213430 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:04.214076 18743 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:04.214264 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.214910 18594 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 0.
I20260709 13:19:04.215050 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.215293 18635 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.215608 18593 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.216245 18904 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.216259 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.216732 18904 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.216952 18670 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.217124 18904 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.221946 18593 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.223040 18710 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.223825 18918 raft_consensus.cc:493] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.224280 18918 raft_consensus.cc:515] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.225028 18904 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.226559 18918 leader_election.cc:290] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.227134 18918 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.227551 18918 raft_consensus.cc:697] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.227598 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.227932 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.228186 18904 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.228252 18669 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.228590 18594 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.228440 18918 consensus_queue.cc:237] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.229763 18707 leader_election.cc:304] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.230440 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.230443 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.231192 18743 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.231276 18595 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 0.
I20260709 13:19:04.230034 18670 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.233539 18826 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.234223 18826 raft_consensus.cc:2804] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.225755 18491 catalog_manager.cc:5697] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 1 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.234710 18826 raft_consensus.cc:493] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.235105 18826 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.240440 18594 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:04.241942 18636 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.242915 18904 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.242951 18826 raft_consensus.cc:515] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.243683 18904 raft_consensus.cc:697] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.243530 18743 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:04.244774 18904 consensus_queue.cc:237] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.247455 18826 leader_election.cc:290] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.249651 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.250242 18670 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.253085 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.253902 18594 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.256600 18670 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.256016 18492 catalog_manager.cc:5697] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 1 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.258805 18707 leader_election.cc:304] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.259344 18805 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.263113 18805 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.265091 18805 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.266906 18805 raft_consensus.cc:493] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.267405 18805 raft_consensus.cc:515] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.267879 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.268504 18670 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:19:04.269925 18805 leader_election.cc:290] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.270787 18918 raft_consensus.cc:2804] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.270990 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.269860 18558 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.271332 18918 raft_consensus.cc:697] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.271965 18669 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:19:04.272529 18918 consensus_queue.cc:237] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.273151 18558 leader_election.cc:304] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.274441 18805 raft_consensus.cc:2804] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.274839 18805 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.274673 18594 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:04.275331 18805 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.280198 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:04.281226 18743 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:19:04.283274 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:04.282788 18492 catalog_manager.cc:5697] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 0 to 1, leader changed from <none> to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 1 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.284207 18743 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 0.
I20260709 13:19:04.286082 18924 raft_consensus.cc:2804] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.286499 18924 raft_consensus.cc:493] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.286713 18924 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.285080 18805 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.292614 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.292884 18805 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.293211 18670 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.292455 18924 raft_consensus.cc:515] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.295353 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.295866 18743 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.298539 18491 catalog_manager.cc:5697] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 1 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.299532 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.300319 18669 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.306283 18743 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:19:04.306427 18670 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:19:04.307359 18560 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.307977 18924 leader_election.cc:290] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.308539 18924 raft_consensus.cc:2804] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.309051 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.309661 18742 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.309441 18669 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:19:04.313915 18558 leader_election.cc:304] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.314699 18805 raft_consensus.cc:2804] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.316526 18742 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 1.
I20260709 13:19:04.317592 18805 raft_consensus.cc:697] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.318427 18924 raft_consensus.cc:697] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.318657 18805 consensus_queue.cc:237] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.319226 18924 consensus_queue.cc:237] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.328377 18491 catalog_manager.cc:5697] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 1 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.339771 18491 catalog_manager.cc:5697] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 1 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.368222 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:04.368672 18669 raft_consensus.cc:606] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:04.375826 18742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9282c852c54d30be5803d1186aca10"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:44910
I20260709 13:19:04.376386 18742 raft_consensus.cc:606] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:04.381443 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:51952
I20260709 13:19:04.381902 18669 raft_consensus.cc:606] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:04.396577 18594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
mode: GRACEFUL
new_leader_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:49742
I20260709 13:19:04.397240 18594 raft_consensus.cc:606] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Received request to transfer leadership to TS 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.402946 18742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
mode: GRACEFUL
new_leader_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:44910
I20260709 13:19:04.403465 18742 raft_consensus.cc:606] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Received request to transfer leadership to TS 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.410856 18742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
mode: GRACEFUL
new_leader_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:44910
I20260709 13:19:04.411309 18742 raft_consensus.cc:606] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Received request to transfer leadership to TS 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.431495 18918 raft_consensus.cc:493] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.432065 18918 raft_consensus.cc:515] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.434221 18918 leader_election.cc:290] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:04.435042 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:04.435176 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:04.436141 18594 raft_consensus.cc:2393] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 1: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:19:04.437111 18710 leader_election.cc:304] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:04.437886 18918 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.444051 18918 raft_consensus.cc:2749] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.460807 18904 consensus_queue.cc:1048] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.473457 18904 consensus_queue.cc:1048] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.488078 18904 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.498217 18818 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.509222 18906 raft_consensus.cc:993] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.509773 18818 raft_consensus.cc:1081] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.511916 18593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:04.512487 18593 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.513490 18593 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.518805 18593 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.520893 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.521226 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.521533 18669 raft_consensus.cc:3055] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.521852 18742 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.522009 18669 raft_consensus.cc:740] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.522883 18669 consensus_queue.cc:260] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.523937 18669 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.525509 18593 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.528855 18742 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.529968 18560 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.530519 18669 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.530736 18924 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.531311 18924 raft_consensus.cc:697] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.532092 18924 consensus_queue.cc:237] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.538254 18492 catalog_manager.cc:5697] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.611497 18826 consensus_queue.cc:1048] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.617478 18918 raft_consensus.cc:993] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: : Instructing follower 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.618388 18921 raft_consensus.cc:1081] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Signalling peer 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.621167 18668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:19:04.624120 18921 consensus_queue.cc:1048] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.624897 18668 raft_consensus.cc:493] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.625370 18668 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.626335 18921 consensus_queue.cc:1048] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.632822 18668 raft_consensus.cc:515] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.637171 18668 leader_election.cc:290] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.638208 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.638859 18742 raft_consensus.cc:3055] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.639168 18742 raft_consensus.cc:740] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.639986 18742 consensus_queue.cc:260] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.641141 18742 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.642038 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.642649 18594 raft_consensus.cc:3060] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.649333 18921 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.649622 18594 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.651242 18636 leader_election.cc:304] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.652088 18818 raft_consensus.cc:2804] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.652537 18818 raft_consensus.cc:697] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.653007 18742 raft_consensus.cc:2468] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.653265 18818 consensus_queue.cc:237] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.654312 18921 consensus_queue.cc:1048] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.662617 18921 raft_consensus.cc:993] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.663019 18921 raft_consensus.cc:1081] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.668576 18918 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.668576 18595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be9282c852c54d30be5803d1186aca10"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49736
I20260709 13:19:04.670010 18921 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.670303 18595 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.671166 18595 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.679702 18492 catalog_manager.cc:5697] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 1 to 2, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 2 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.682310 18595 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.690344 18595 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.690583 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.691262 18670 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.693614 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.694204 18742 raft_consensus.cc:3055] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.694530 18742 raft_consensus.cc:740] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.695031 18921 raft_consensus.cc:993] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: : Instructing follower 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.695466 18921 raft_consensus.cc:1081] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Signalling peer 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.695292 18742 consensus_queue.cc:260] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.696594 18742 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.697769 18818 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.702890 18918 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.703763 18668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:51942
I20260709 13:19:04.706233 18668 raft_consensus.cc:493] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.706663 18668 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.712224 18668 raft_consensus.cc:515] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.713231 18742 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.714781 18560 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:04.715075 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.715284 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.715770 18593 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.715821 18743 raft_consensus.cc:3055] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.715968 18924 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.716801 18924 raft_consensus.cc:697] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.716284 18743 raft_consensus.cc:740] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:04.718500 18670 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.718626 18743 consensus_queue.cc:260] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.719308 18668 leader_election.cc:290] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.719662 18743 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.721570 18924 consensus_queue.cc:237] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.724859 18593 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.726171 18818 raft_consensus.cc:993] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.726120 18636 leader_election.cc:304] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.726652 18818 raft_consensus.cc:1081] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:04.727452 18818 raft_consensus.cc:2804] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.730899 18743 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.731632 18595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:04.732206 18595 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.732569 18595 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.733441 18906 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.738620 18491 catalog_manager.cc:5697] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.741117 18595 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.741209 18818 raft_consensus.cc:697] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.743228 18595 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.743813 18818 consensus_queue.cc:237] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.743995 18593 raft_consensus.cc:1240] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Rejecting Update request from peer 756c8d53c710434e8a243ac69e140dba for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:04.743947 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:04.744690 18668 raft_consensus.cc:3055] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.745013 18668 raft_consensus.cc:740] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.745970 18668 consensus_queue.cc:260] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.747341 18668 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.744896 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.752017 18744 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.756248 18668 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.758641 18558 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.758771 18744 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:04.759945 18805 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.760479 18805 raft_consensus.cc:697] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.760033 18491 catalog_manager.cc:5697] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 1 to 2, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 2 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.761250 18805 consensus_queue.cc:237] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.770030 18493 catalog_manager.cc:5697] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.791008 18805 consensus_queue.cc:1048] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.801347 18805 consensus_queue.cc:1048] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.809824 18924 raft_consensus.cc:993] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: : Instructing follower 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.810377 18924 raft_consensus.cc:1081] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Signalling peer 756c8d53c710434e8a243ac69e140dba to start an election
I20260709 13:19:04.812135 18668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
 from {username='slave'} at 127.0.0.1:51930
I20260709 13:19:04.812707 18668 raft_consensus.cc:493] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.813041 18668 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.817709 18668 raft_consensus.cc:515] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.819401 18668 leader_election.cc:290] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:04.820402 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:04.820461 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:04.821223 18593 raft_consensus.cc:3055] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.821305 18744 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.821686 18593 raft_consensus.cc:740] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:04.822708 18593 consensus_queue.cc:260] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.823670 18593 raft_consensus.cc:3060] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.827710 18744 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.828616 18635 leader_election.cc:304] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:04.829414 18818 raft_consensus.cc:2804] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.829803 18818 raft_consensus.cc:697] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:04.830499 18818 consensus_queue.cc:237] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:04.831123 18593 raft_consensus.cc:2468] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:04.836300 18492 catalog_manager.cc:5697] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 1 to 2, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 2 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.839543 18924 consensus_queue.cc:1048] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.850725 18805 consensus_queue.cc:1048] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.937290 18743 raft_consensus.cc:1275] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:04.938802 18926 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:04.946163 18668 raft_consensus.cc:1275] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:04.947674 18927 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.036921 18743 raft_consensus.cc:1275] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.038170 18906 consensus_queue.cc:1048] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.045027 18593 raft_consensus.cc:1275] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.046391 18948 consensus_queue.cc:1048] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.180373 18743 raft_consensus.cc:1275] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.181672 18948 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.190183 18593 raft_consensus.cc:1275] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.191704 18906 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.194882 18668 raft_consensus.cc:1275] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.196228 18927 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.205137 18743 raft_consensus.cc:1275] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.206496 18926 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.260787 18668 raft_consensus.cc:1275] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.262089 18926 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.271553 18743 raft_consensus.cc:1275] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.271997 18593 raft_consensus.cc:1275] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.272807 18926 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.273415 18904 consensus_queue.cc:1048] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:05.282016 18743 raft_consensus.cc:1275] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.283329 18906 consensus_queue.cc:1048] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.048768 18960 raft_consensus.cc:493] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.050525 18960 raft_consensus.cc:515] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.270334 18960 leader_election.cc:290] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.271132 18960 raft_consensus.cc:493] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.272135 18960 raft_consensus.cc:515] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.374109 18960 leader_election.cc:290] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.377751 18961 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.378911 18961 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.382239 18962 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.382685 18961 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.384366 18962 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.384649 18961 raft_consensus.cc:493] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.386121 18961 raft_consensus.cc:515] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.387722 18962 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.388339 18962 raft_consensus.cc:493] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.388711 18961 leader_election.cc:290] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.389161 18962 raft_consensus.cc:515] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.391767 18962 leader_election.cc:290] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.435165 18960 raft_consensus.cc:493] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.436280 18960 raft_consensus.cc:515] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.438509 18960 leader_election.cc:290] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.439262 18965 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.440223 18965 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:07.440932 18962 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.441993 18962 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.443186 18961 raft_consensus.cc:493] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.443517 18965 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733), 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973)
I20260709 13:19:07.444108 18961 raft_consensus.cc:515] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.446281 18962 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.442462 18963 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.454679 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.455694 18963 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.460409 18961 leader_election.cc:290] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.469907 18965 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.471105 18965 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.473021 18971 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.476823 18961 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.477617 18961 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.480027 18971 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.489756 18969 raft_consensus.cc:493] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e2ec72689e54d81868d5956afecf07c)
I20260709 13:19:07.490808 18969 raft_consensus.cc:515] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.494273 18965 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.497269 18969 leader_election.cc:290] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.505856 18962 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.506891 18962 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.479527 18963 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.528638 18960 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2ec72689e54d81868d5956afecf07c)
I20260709 13:19:07.530287 18963 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.531162 18959 raft_consensus.cc:493] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.531298 18963 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.532114 18959 raft_consensus.cc:515] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.533706 18960 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.550809 18962 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.554615 18962 raft_consensus.cc:493] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.555466 18962 raft_consensus.cc:515] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.559286 18959 leader_election.cc:290] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.561549 18968 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.562706 18968 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:07.564452 18960 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.536689 18965 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.566768 18965 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.567358 18964 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.567950 18967 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.568226 18960 raft_consensus.cc:493] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.568547 18964 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.570715 18960 raft_consensus.cc:515] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.571527 18965 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.553186 18961 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.572302 18964 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.572448 18961 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.573001 18960 leader_election.cc:290] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.568849 18967 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.579109 18968 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.537392 18969 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e2ec72689e54d81868d5956afecf07c)
I20260709 13:19:07.580233 18969 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.581053 18967 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.583086 18962 leader_election.cc:290] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.583244 18972 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.584074 18971 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.573187 18961 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.589462 18964 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.590969 18964 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.593700 18964 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.594892 18973 raft_consensus.cc:493] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 756c8d53c710434e8a243ac69e140dba)
I20260709 13:19:07.595800 18973 raft_consensus.cc:515] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
W20260709 13:19:07.596537 18636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:44973, user_credentials={real_user=slave}} blocked reactor thread for 57699.4us
I20260709 13:19:07.598992 18972 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.600153 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.601002 18744 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.602183 18972 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.603304 18963 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.604935 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.607339 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.608412 18595 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.611064 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.612705 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.583101 18969 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.614606 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.622529 18740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.615886 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.616040 18592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.617854 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.622409 18973 leader_election.cc:290] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.624312 18740 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.617866 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.618919 18590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.618916 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.627030 18740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.627553 18743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.628134 18743 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.628309 18739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.628860 18744 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.629058 18739 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.619782 18961 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.620690 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.631135 18741 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:07.631286 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.621949 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.631981 18738 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:07.632079 18742 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:07.615765 18636 leader_election.cc:304] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:07.625204 18595 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 1.
I20260709 13:19:07.630070 18635 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.633911 18964 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.634254 18964 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.634610 18964 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.635187 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.636108 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.638041 18971 raft_consensus.cc:2804] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.638439 18971 raft_consensus.cc:493] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e2ec72689e54d81868d5956afecf07c)
I20260709 13:19:07.638811 18971 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.643579 18636 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:07.644115 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.644557 18966 raft_consensus.cc:2804] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:07.644763 18668 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:07.644927 18966 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e2ec72689e54d81868d5956afecf07c)
I20260709 13:19:07.645335 18966 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.646037 18964 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:07.647022 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.647679 18668 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:07.649467 18964 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733), 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973)
I20260709 13:19:07.649627 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.650707 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.651103 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.651640 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.654026 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.654419 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.655992 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.656550 18665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.656666 18669 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
I20260709 13:19:07.657450 18665 raft_consensus.cc:2393] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 3: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:19:07.657708 18662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.658281 18662 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:07.658505 18664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.659457 18662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.660027 18663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.655303 18666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.661384 18666 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:07.662873 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dcc4cc3abde4ea480464c9a5d260be1" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.663071 18635 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.664029 18964 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.664433 18964 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.664608 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.664880 18964 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.664773 18635 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.666332 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.667234 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.667832 18738 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.669510 18969 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.669802 18969 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.670043 18969 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.670734 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.671173 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.672932 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:07.666785 18635 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.675457 18707 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:07.677289 18635 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.678117 18961 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.678340 18975 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.678511 18961 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.678752 18975 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.678926 18961 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.679140 18975 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.679559 18971 raft_consensus.cc:515] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.680531 18670 raft_consensus.cc:1240] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 1e2ec72689e54d81868d5956afecf07c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.682940 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.683797 18595 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.686414 18590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.687126 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32a95c9092a144a098029f202eea1e9c" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.687490 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43238fe01e2a492896103417790df294" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.687742 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.688771 18635 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.673023 18966 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.689504 18972 raft_consensus.cc:2804] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:07.689666 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.694664 18668 raft_consensus.cc:1240] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Rejecting Update request from peer 1e2ec72689e54d81868d5956afecf07c for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:07.695080 18972 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.692857 18664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.695815 18666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.696409 18972 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.695154 18661 raft_consensus.cc:1240] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.698232 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.699834 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.695984 18971 leader_election.cc:290] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.692973 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c9b14be4cd437a9312ded80f9b7641" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:07.696951 18967 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.701713 18967 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.702124 18967 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.702327 18969 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.704600 18969 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.705174 18667 raft_consensus.cc:1240] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.705365 18590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.697295 18635 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.701406 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.697449 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.709296 18635 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.692245 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.711316 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.711902 18971 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:07.712357 18971 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.712757 18971 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.695815 18966 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.693344 18738 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 3.
I20260709 13:19:07.713593 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.713024 18967 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.714156 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.714900 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.713693 18966 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.715916 18966 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.716305 18966 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.716775 18590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.717022 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.717985 18975 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.719019 18662 raft_consensus.cc:1240] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.719714 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:07.718894 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
W20260709 13:19:07.723079 18707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.66:35973, user_credentials={real_user=slave}} blocked reactor thread for 47883.3us
I20260709 13:19:07.723598 18739 raft_consensus.cc:1240] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.724674 18967 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.724908 18975 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.726475 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88139800ee184027a6b58362b9b61516" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.726795 18558 leader_election.cc:304] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.727553 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.727746 18977 raft_consensus.cc:2749] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.728845 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.729033 18558 leader_election.cc:304] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.729836 18977 raft_consensus.cc:2749] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.730247 18961 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.731137 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.723904 18595 raft_consensus.cc:2468] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 3.
I20260709 13:19:07.732035 18592 raft_consensus.cc:1240] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Rejecting Update request from peer 1e2ec72689e54d81868d5956afecf07c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.733199 18739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.733089 18972 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.734174 18636 leader_election.cc:304] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:07.734885 18558 leader_election.cc:304] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.735072 18635 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.735684 18977 raft_consensus.cc:2749] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.736011 18592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.736243 18635 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.736392 18969 raft_consensus.cc:2804] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.737051 18965 raft_consensus.cc:2749] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.730034 18707 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.737761 18965 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.738234 18635 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.738572 18978 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.738881 18965 raft_consensus.cc:697] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:07.739010 18978 raft_consensus.cc:493] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.723515 18966 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.739526 18978 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.739931 18707 leader_election.cc:304] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.740068 18965 consensus_queue.cc:237] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:07.741813 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.743103 18971 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.739542 18635 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.741076 18967 raft_consensus.cc:2749] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.744663 18635 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.745821 18975 raft_consensus.cc:2749] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.745952 18592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.723632 18964 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.745433 18967 raft_consensus.cc:2749] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.746981 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.747711 18663 raft_consensus.cc:1240] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.748247 18976 raft_consensus.cc:2749] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.749157 18966 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.741284 18961 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.749234 18707 leader_election.cc:304] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.750800 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.751760 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.735193 18972 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.752525 18961 raft_consensus.cc:2749] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.752269 18971 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.753859 18558 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.752127 18707 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.751824 18964 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:07.754674 18977 raft_consensus.cc:2749] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.754927 18635 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.755088 18558 leader_election.cc:304] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.755834 18961 raft_consensus.cc:2749] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.755865 18977 raft_consensus.cc:2749] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.756441 18964 raft_consensus.cc:2749] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.756273 18635 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.751160 18978 raft_consensus.cc:515] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.758544 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.758879 18978 leader_election.cc:290] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.761298 18738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:07.762359 18960 consensus_queue.cc:1059] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:07.762295 18965 raft_consensus.cc:2749] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.763195 18635 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.758776 18707 leader_election.cc:304] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.764249 18965 raft_consensus.cc:2749] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.764639 18635 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:07.765026 18960 raft_consensus.cc:3055] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.765431 18960 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.765430 18707 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.765869 18965 raft_consensus.cc:2749] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.766484 18961 raft_consensus.cc:2749] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.763866 18974 consensus_queue.cc:1059] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:19:07.767212 18961 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:07.767609 18961 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.768026 18970 raft_consensus.cc:3055] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.766748 18960 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:07.768590 18970 raft_consensus.cc:740] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.768842 18707 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.769495 18960 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.769757 18976 raft_consensus.cc:2749] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.769618 18970 consensus_queue.cc:260] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.767939 18961 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.774029 18977 consensus_queue.cc:1059] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.774897 18959 consensus_queue.cc:1059] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.776685 18970 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.776880 18961 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.777618 18977 raft_consensus.cc:3055] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.778031 18977 raft_consensus.cc:740] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.778478 18969 raft_consensus.cc:697] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:07.778999 18961 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.770442 18707 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:07.779610 18969 consensus_queue.cc:237] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.780301 18707 leader_election.cc:304] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.778909 18977 consensus_queue.cc:260] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.781893 18976 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.781993 18977 raft_consensus.cc:3060] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.782230 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.783423 18592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.783582 18973 consensus_queue.cc:1059] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:07.782377 18976 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.784849 18963 raft_consensus.cc:3055] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.784965 18976 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.785197 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.785275 18963 raft_consensus.cc:740] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:07.787174 18963 consensus_queue.cc:260] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.788456 18963 raft_consensus.cc:3060] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.781915 18707 leader_election.cc:304] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
W20260709 13:19:07.793476 18710 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.794044 18973 raft_consensus.cc:2749] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.794436 18707 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.795699 18707 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:07.795802 18973 raft_consensus.cc:2749] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.796816 18974 raft_consensus.cc:3055] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.797242 18974 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.798187 18974 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.799091 18974 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.782191 18961 raft_consensus.cc:2749] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.801327 18707 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.803905 18978 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:07.804386 18978 raft_consensus.cc:493] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:07.804894 18978 raft_consensus.cc:3060] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.812176 18961 raft_consensus.cc:2749] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.814725 18961 consensus_queue.cc:1059] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:07.806188 18492 catalog_manager.cc:5697] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 2 to 3, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 3 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.818202 18976 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.821475 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.818215 18961 raft_consensus.cc:3055] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.822551 18961 raft_consensus.cc:740] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:07.823552 18961 consensus_queue.cc:260] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.824625 18976 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.821705 18560 leader_election.cc:304] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead; no voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.827183 18592 raft_consensus.cc:2468] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:07.827266 18738 raft_consensus.cc:1240] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.827423 18974 raft_consensus.cc:2749] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.828066 18663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:07.828869 18961 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.829008 18738 raft_consensus.cc:1240] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.830303 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:07.829452 18662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9282c852c54d30be5803d1186aca10" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:07.830626 18738 raft_consensus.cc:1240] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.830582 18710 leader_election.cc:304] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:07.831233 18662 raft_consensus.cc:2393] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 3: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:19:07.831594 18976 raft_consensus.cc:2804] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.832083 18976 raft_consensus.cc:697] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:07.832967 18976 consensus_queue.cc:237] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.833475 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:07.833837 18974 consensus_queue.cc:1059] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.834298 18667 raft_consensus.cc:2393] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 3: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:19:07.835143 18981 raft_consensus.cc:3055] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.835505 18981 raft_consensus.cc:740] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.836609 18981 consensus_queue.cc:260] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.837828 18981 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.838781 18595 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:07.840161 18710 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:07.841079 18963 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.841691 18963 raft_consensus.cc:697] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:07.842715 18963 consensus_queue.cc:237] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.843484 18707 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.845005 18978 raft_consensus.cc:515] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.845259 18707 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.845479 18961 raft_consensus.cc:2749] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:07.846797 18976 raft_consensus.cc:2749] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.848306 18978 leader_election.cc:290] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:07.848829 18595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:07.849931 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a3532b12246858caf47243b4b5ccc" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:07.851191 18667 raft_consensus.cc:2393] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 3: Already voted for candidate 756c8d53c710434e8a243ac69e140dba in this term.
I20260709 13:19:07.852694 18491 catalog_manager.cc:5697] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 2 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 3 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.856881 18595 raft_consensus.cc:2468] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:07.857970 18710 leader_election.cc:304] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:07.859082 18963 raft_consensus.cc:2804] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.859669 18963 raft_consensus.cc:697] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:07.860714 18963 consensus_queue.cc:237] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.880050 18491 catalog_manager.cc:5697] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 2 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 3 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.884498 18492 catalog_manager.cc:5697] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 2 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 3 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.885838 18492 catalog_manager.cc:5697] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 2 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 3 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.941176 18667 raft_consensus.cc:1240] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.942538 18981 consensus_queue.cc:1059] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:07.943270 18974 raft_consensus.cc:3055] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:07.943701 18974 raft_consensus.cc:740] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:07.944453 18974 consensus_queue.cc:260] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:07.945462 18974 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.002243 18739 raft_consensus.cc:1240] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:08.003611 18974 consensus_queue.cc:1059] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.004390 18981 raft_consensus.cc:3055] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:08.004799 18981 raft_consensus.cc:740] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:08.005707 18981 consensus_queue.cc:260] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:08.006956 18981 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.153750 18595 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.154930 18969 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.164471 18739 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.166689 18964 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.261171 18667 raft_consensus.cc:1240] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Rejecting Update request from peer 0b07f0363858493c83d7b3fea5327ead for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:08.262549 18981 consensus_queue.cc:1059] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.263489 18974 raft_consensus.cc:3055] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:08.263801 18974 raft_consensus.cc:740] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:08.264580 18974 consensus_queue.cc:260] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:08.265688 18974 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:08.283704 18765 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9e20 after lost signal to thread 9492
W20260709 13:19:08.284693 18765 debug-util.cc:398] Leaking SignalData structure 0x7b080000b020 after lost signal to thread 18527
W20260709 13:19:08.285887 18765 debug-util.cc:398] Leaking SignalData structure 0x7b08001dbda0 after lost signal to thread 18619
W20260709 13:19:08.286839 18765 debug-util.cc:398] Leaking SignalData structure 0x7b0800403020 after lost signal to thread 18694
W20260709 13:19:08.287776 18765 debug-util.cc:398] Leaking SignalData structure 0x7b08002930c0 after lost signal to thread 18768
I20260709 13:19:08.344898 18595 raft_consensus.cc:1275] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.346351 18965 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.346657 18739 raft_consensus.cc:1275] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.348232 18965 consensus_queue.cc:1048] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.353106 18667 raft_consensus.cc:1275] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.354651 18963 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.366173 18592 raft_consensus.cc:1275] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.372654 18963 consensus_queue.cc:1048] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.399196 18592 raft_consensus.cc:1275] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.405340 18963 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.422370 18667 raft_consensus.cc:1275] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.423894 19001 consensus_queue.cc:1048] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.436379 18595 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.437953 19003 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.448400 18667 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.451363 19000 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.794526 18492 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37698:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:08.815532 18492 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37698:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:08.827514 18491 catalog_manager.cc:5789] TS 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733) does not have the latest schema for tablet be9282c852c54d30be5803d1186aca10 (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
W20260709 13:19:08.830175 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
W20260709 13:19:08.832413 18480 catalog_manager.cc:5107] TS 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): alter failed for tablet ba3309a976ea4ff5b3c4350e41f5695c (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]): Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
W20260709 13:19:08.843439 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:08.844349  9489 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:19:08.857630 18734 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44880: Illegal state: replica 1e2ec72689e54d81868d5956afecf07c is not leader of this config: current role FOLLOWER
W20260709 13:19:08.921788 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:08.930600 19018 tablet.cc:1724] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:08.936394 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:08.966599 19022 tablet.cc:1724] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:08.953193 18728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44880: Illegal state: replica 1e2ec72689e54d81868d5956afecf07c is not leader of this config: current role FOLLOWER
I20260709 13:19:08.984967 19025 tablet.cc:1724] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:08.989751 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.004949 18662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:19:08.974139 19024 tablet.cc:1724] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.024549 18662 raft_consensus.cc:606] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
W20260709 13:19:09.041085 18728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44880: Illegal state: replica 1e2ec72689e54d81868d5956afecf07c is not leader of this config: current role FOLLOWER
W20260709 13:19:09.048550 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.060956 19038 tablet.cc:1724] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.061913 19035 tablet.cc:1724] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.069221  9489 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 13:19:09.069906  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:09.115976 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:19:09.116580 18669 raft_consensus.cc:606] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
W20260709 13:19:09.117756 18770 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:7a0a3532b12246858caf47243b4b5ccc)
I20260709 13:19:09.119542 19029 raft_consensus.cc:993] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:09.119972 19029 raft_consensus.cc:1081] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:09.124825 19024 tablet.cc:1724] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.126080 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54e722465c234305a3815e9e9b66a066"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:19:09.125537 19042 tablet.cc:1724] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.126684 18669 raft_consensus.cc:606] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 1e2ec72689e54d81868d5956afecf07c
W20260709 13:19:09.133527 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.131417 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:19:09.136809 18669 raft_consensus.cc:606] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Received request to transfer leadership to TS 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:09.138667 18594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:09.138796  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:09.139374 18594 raft_consensus.cc:493] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:09.139801 18594 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.139910  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:09.143169 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.144032 19030 raft_consensus.cc:993] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:09.144642 19027 raft_consensus.cc:1081] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:09.146586 18738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54e722465c234305a3815e9e9b66a066"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:44898
I20260709 13:19:09.147246 18738 raft_consensus.cc:493] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:09.147598 18738 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:09.153194 18728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44880: Illegal state: replica 1e2ec72689e54d81868d5956afecf07c is not leader of this config: current role FOLLOWER
I20260709 13:19:09.166504 19018 tablet.cc:1724] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:09.172477 18770 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:7a0a3532b12246858caf47243b4b5ccc)
W20260709 13:19:09.177508 18770 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:7a0a3532b12246858caf47243b4b5ccc)
I20260709 13:19:09.188730 19022 tablet.cc:1724] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.192236 18594 raft_consensus.cc:515] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.197166 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.197798 18669 raft_consensus.cc:3055] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:09.198086 18669 raft_consensus.cc:740] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:09.199076 18669 consensus_queue.cc:260] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.200198 18669 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.200495 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd311c2dec941ce917bf471ec13d484" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:09.202549 18594 leader_election.cc:290] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.202234 19040 tablet.cc:1724] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.181180 18738 raft_consensus.cc:515] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.213748 18669 raft_consensus.cc:2468] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 3.
I20260709 13:19:09.215504 18558 leader_election.cc:304] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:09.215867 19040 tablet.cc:1724] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.218327 19018 tablet.cc:1724] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.222837 19042 tablet.cc:1724] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.225987 18738 leader_election.cc:290] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.231019 18492 catalog_manager.cc:5789] TS 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973) does not have the latest schema for tablet 32a95c9092a144a098029f202eea1e9c (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.236245 19039 tablet.cc:1724] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.236263 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.242455 18669 raft_consensus.cc:3055] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.242753 18669 raft_consensus.cc:740] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:09.243476 18669 consensus_queue.cc:260] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.244771 18669 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.243170 19042 tablet.cc:1724] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.246623 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e722465c234305a3815e9e9b66a066" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.247524 18594 raft_consensus.cc:3060] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.253543 19038 tablet.cc:1724] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.262173 19003 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.235026 19045 tablet.cc:1724] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.262646 19003 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.264627 19003 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.265626 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.266356 18667 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:09.267771 18707 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.268782 19003 raft_consensus.cc:2804] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.270710 19003 raft_consensus.cc:493] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.271116 19003 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.276499 18979 raft_consensus.cc:993] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:09.277046 19030 raft_consensus.cc:1081] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Signalling peer 1e2ec72689e54d81868d5956afecf07c to start an election
I20260709 13:19:09.279299 18741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
 from {username='slave'} at 127.0.0.1:44898
I20260709 13:19:09.280058 18741 raft_consensus.cc:493] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:09.280491 18741 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.286118 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:09.286877 18593 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 1.
W20260709 13:19:09.291855 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.291992 18669 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:09.293358 18707 leader_election.cc:304] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.294253 19001 raft_consensus.cc:2804] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:09.294742 19001 raft_consensus.cc:697] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 2 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:09.294538 19003 raft_consensus.cc:515] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.295688 19001 consensus_queue.cc:237] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.296610 19003 leader_election.cc:290] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.297298 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.297855 18593 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.301864 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5400828c3bf94c0187309b6343e329ec" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.302389 18669 raft_consensus.cc:3060] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:09.302596 18728 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44880: Illegal state: replica 1e2ec72689e54d81868d5956afecf07c is not leader of this config: current role FOLLOWER
I20260709 13:19:09.307668 18594 raft_consensus.cc:2468] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:09.308192 18669 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:09.309303 18707 leader_election.cc:304] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.310621 19000 raft_consensus.cc:2804] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:09.311101 19000 raft_consensus.cc:697] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:09.292017 18741 raft_consensus.cc:515] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:09.312007 19000 consensus_queue.cc:237] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.240078 19046 raft_consensus.cc:2804] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:09.316191 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.316962 18594 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.322759 18593 raft_consensus.cc:2468] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
W20260709 13:19:09.324635 18583 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49724: Illegal state: replica 0b07f0363858493c83d7b3fea5327ead is not leader of this config: current role FOLLOWER
I20260709 13:19:09.324939 18741 leader_election.cc:290] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.328513 18594 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 4.
I20260709 13:19:09.329609 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c88af3f7644808b8bc8d09fbd926a4" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.329772 18710 leader_election.cc:304] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:09.330147 19049 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.330267 18669 raft_consensus.cc:3055] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:09.330730 19000 raft_consensus.cc:2804] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:09.331499 19000 raft_consensus.cc:697] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 4 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:09.330646 19049 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.332507 19000 consensus_queue.cc:237] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:09.330780 18669 raft_consensus.cc:740] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:09.334614 18669 consensus_queue.cc:260] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } }
I20260709 13:19:09.335790 18669 raft_consensus.cc:3060] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.339666 18492 catalog_manager.cc:5697] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 2 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.342217 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.343806 19046 raft_consensus.cc:697] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 3 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:09.344530 19049 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.345764 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:09.348237 19046 consensus_queue.cc:237] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.348642 18741 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:09.347833 18667 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 3.
I20260709 13:19:09.349858 18560 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:09.342320 18669 raft_consensus.cc:2468] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 4.
I20260709 13:19:09.351148 19049 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.351742 19049 raft_consensus.cc:493] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.352138 19049 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.358493 18491 catalog_manager.cc:5697] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 2 to 3, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 3 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.363251 19049 raft_consensus.cc:515] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.366180 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.366758 18669 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.368768 19049 leader_election.cc:290] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.369374 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3309a976ea4ff5b3c4350e41f5695c" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:09.370021 18741 raft_consensus.cc:3060] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.373988 18669 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 4.
I20260709 13:19:09.375093 18558 leader_election.cc:304] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.375944 19049 raft_consensus.cc:2804] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:09.376600 19049 raft_consensus.cc:697] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:09.377475 19049 consensus_queue.cc:237] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.379662 18741 raft_consensus.cc:2468] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 4.
I20260709 13:19:09.395471 18491 catalog_manager.cc:5697] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.396270 18491 catalog_manager.cc:5789] TS 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733) does not have the latest schema for tablet 5400828c3bf94c0187309b6343e329ec (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.396575 18492 catalog_manager.cc:5697] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.396742 18491 catalog_manager.cc:5697] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 3 to 4, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 4 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.397953 18492 catalog_manager.cc:5789] TS 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973) does not have the latest schema for tablet ba3309a976ea4ff5b3c4350e41f5695c (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.410162 19030 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.410705 19030 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.412344 19030 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.413051 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:09.413300 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:09.413739 18594 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 2.
I20260709 13:19:09.414844 18636 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:09.415428 19030 raft_consensus.cc:2804] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.415791 19030 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.416059 19030 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.421967 19030 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.424517 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.424726 19030 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.425046 18594 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.425669 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "756c8d53c710434e8a243ac69e140dba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:09.432428 18594 raft_consensus.cc:2468] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 756c8d53c710434e8a243ac69e140dba in term 3.
I20260709 13:19:09.433507 18636 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
I20260709 13:19:09.434307 18979 raft_consensus.cc:2804] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:09.434727 18979 raft_consensus.cc:697] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Becoming Leader. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:09.435492 18979 consensus_queue.cc:237] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.442801 18492 catalog_manager.cc:5697] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba reported cstate change: term changed from 1 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 756c8d53c710434e8a243ac69e140dba (127.9.68.66). New cstate: current_term: 3 leader_uuid: "756c8d53c710434e8a243ac69e140dba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.443717 18492 catalog_manager.cc:5789] TS 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973) does not have the latest schema for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.468554 19000 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.469154 19000 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.471371 19000 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.471998 18594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:09.472589 18594 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:09.473423 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.474051 18669 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 2.
I20260709 13:19:09.475137 18707 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.476275 19000 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.476615 19000 raft_consensus.cc:493] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.476967 19000 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.477684 19030 raft_consensus.cc:993] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:09.478192 18979 raft_consensus.cc:1081] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:09.479832 18594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:09.480346 18594 raft_consensus.cc:493] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:09.480657 18594 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.485210 19000 raft_consensus.cc:515] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.488056 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.488337 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfad3994192648c3ad66d610f9ce4c28" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.488617 18593 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.488906 18669 raft_consensus.cc:3060] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.488713 18594 raft_consensus.cc:515] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.491605 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.491714 18594 leader_election.cc:290] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.492175 18667 raft_consensus.cc:3055] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.492527 18667 raft_consensus.cc:740] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:09.492800 18741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e2caf4bc94b8ca5a5b022f3c25cf0" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:09.493449 18741 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.493424 18667 consensus_queue.cc:260] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.494771 18667 raft_consensus.cc:3060] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.496013 18669 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:09.497153 18707 leader_election.cc:304] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.498082 19000 leader_election.cc:290] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 3 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.498415 19001 raft_consensus.cc:2804] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:09.499015 19001 raft_consensus.cc:697] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Leader. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:09.499830 19001 consensus_queue.cc:237] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.501271 18741 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:09.502388 18560 leader_election.cc:304] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:09.503175 19049 raft_consensus.cc:2804] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:09.503645 19049 raft_consensus.cc:697] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:09.504504 19049 consensus_queue.cc:237] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.509341 18593 raft_consensus.cc:2468] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:09.514832 18667 raft_consensus.cc:2468] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:09.520205 18492 catalog_manager.cc:5697] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.522627 18491 catalog_manager.cc:5697] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c reported cstate change: term changed from 1 to 3, leader changed from 0b07f0363858493c83d7b3fea5327ead (127.9.68.65) to 1e2ec72689e54d81868d5956afecf07c (127.9.68.67). New cstate: current_term: 3 leader_uuid: "1e2ec72689e54d81868d5956afecf07c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.594127 18667 raft_consensus.cc:1275] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.594461 18593 raft_consensus.cc:1275] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.595530 19001 consensus_queue.cc:1048] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.596467 19000 consensus_queue.cc:1048] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.628353 19003 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.624392 19000 raft_consensus.cc:493] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b07f0363858493c83d7b3fea5327ead)
I20260709 13:19:09.626317 19049 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.630676 19000 raft_consensus.cc:515] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.630198 18593 raft_consensus.cc:1275] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.634883 19030 consensus_queue.cc:1048] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.636942 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.640059 18744 raft_consensus.cc:1275] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:09.639918 19049 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.641731 19047 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:09.642084 19049 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.647017 18491 catalog_manager.cc:5789] TS 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973) does not have the latest schema for tablet 5400828c3bf94c0187309b6343e329ec (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.628882 19003 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.632493 18741 raft_consensus.cc:3060] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.645840 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34b3fb8ba46f3b2c0cc01a6248e36" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:09.649196 18492 catalog_manager.cc:5789] TS 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973) does not have the latest schema for tablet 5400828c3bf94c0187309b6343e329ec (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.644776 19060 mvcc.cc:204] Tried to move back new op lower bound from 7305638500724453376 to 7305638499591970816. Current Snapshot: MvccSnapshot[applied={T|T < 7305638500724453376}]
I20260709 13:19:09.652544 18667 raft_consensus.cc:1275] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:09.655071 19022 tablet.cc:1724] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.655534 18591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead" is_pre_election: true
I20260709 13:19:09.655789 18710 leader_election.cc:304] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:09.656451 18591 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:09.658238 18710 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 1e2ec72689e54d81868d5956afecf07c; no voters: 
I20260709 13:19:09.661690 19003 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.661839 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.662715 18667 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 3.
I20260709 13:19:09.663866 18963 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.665269 18963 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.664490 19049 consensus_queue.cc:1048] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:09.665786 18744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c" is_pre_election: true
I20260709 13:19:09.632910 19000 leader_election.cc:290] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.665807 18963 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.669234 19042 tablet.cc:1724] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.671797 18667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba" is_pre_election: true
I20260709 13:19:09.672372 18667 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e2ec72689e54d81868d5956afecf07c in term 3.
I20260709 13:19:09.675761 18558 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:09.687467 18741 raft_consensus.cc:1275] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Refusing update from remote peer 756c8d53c710434e8a243ac69e140dba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.688053 19047 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.688135 19003 raft_consensus.cc:2749] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.688593 19047 raft_consensus.cc:493] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.689041 19047 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.697297 19040 tablet.cc:1724] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.702951 19030 consensus_queue.cc:1048] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.703231 19047 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.706013 19047 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:09.706287 18742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:09.706583 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.707156 18669 raft_consensus.cc:3060] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.724555 18669 raft_consensus.cc:2468] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 4.
I20260709 13:19:09.726516 18963 raft_consensus.cc:515] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.727757 18744 raft_consensus.cc:2393] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b07f0363858493c83d7b3fea5327ead in current term 4: Already voted for candidate 1e2ec72689e54d81868d5956afecf07c in this term.
I20260709 13:19:09.729084 18963 leader_election.cc:290] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 election: Requested vote from peers 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973), 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973)
I20260709 13:19:09.733681 18558 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 1e2ec72689e54d81868d5956afecf07c
W20260709 13:19:09.746953 18710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.65:44973, user_credentials={real_user=slave}} blocked reactor thread for 88841.6us
I20260709 13:19:09.748762 18593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
I20260709 13:19:09.753067 18491 catalog_manager.cc:5789] TS 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973) does not have the latest schema for tablet 5400828c3bf94c0187309b6343e329ec (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.756551 18492 catalog_manager.cc:5789] TS 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973) does not have the latest schema for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.743502 19047 raft_consensus.cc:2804] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:09.767807 18662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a025dd52e04dcdb2512536a3c3ef21" candidate_uuid: "1e2ec72689e54d81868d5956afecf07c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:09.771759 19047 raft_consensus.cc:697] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:09.772907 19047 consensus_queue.cc:237] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:09.779827 18662 raft_consensus.cc:2393] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e2ec72689e54d81868d5956afecf07c in current term 4: Already voted for candidate 0b07f0363858493c83d7b3fea5327ead in this term.
I20260709 13:19:09.779824 18741 raft_consensus.cc:3060] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.782228 18669 raft_consensus.cc:1275] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:09.782572 19038 tablet.cc:1724] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.786123 19049 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:09.787465 19042 tablet.cc:1724] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.805457 18491 catalog_manager.cc:5789] TS 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733) does not have the latest schema for tablet ba3309a976ea4ff5b3c4350e41f5695c (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.816027 19022 tablet.cc:1724] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.817883 19042 tablet.cc:1724] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.821422 19040 tablet.cc:1724] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.832796 18492 catalog_manager.cc:5789] TS 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973) does not have the latest schema for tablet ba3309a976ea4ff5b3c4350e41f5695c (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.845383 18594 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:09.845970 18710 leader_election.cc:304] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e2ec72689e54d81868d5956afecf07c; no voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba
I20260709 13:19:09.846666 18593 raft_consensus.cc:1275] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:09.847878 19001 raft_consensus.cc:2749] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.852777 18491 catalog_manager.cc:5697] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.854125 18741 raft_consensus.cc:1275] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:09.857175 19001 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:09.858448 19001 consensus_queue.cc:1048] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.859798 19074 consensus_queue.cc:1048] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:09.880393 18493 catalog_manager.cc:5789] TS 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733) does not have the latest schema for tablet 3fa34b3fb8ba46f3b2c0cc01a6248e36 (table soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b]). Expected version 1 got 0
I20260709 13:19:09.881769 19022 tablet.cc:1724] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:09.883131 18662 raft_consensus.cc:1275] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:09.888780 19067 consensus_queue.cc:1048] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.895768 18744 raft_consensus.cc:1275] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:09.897226 19074 consensus_queue.cc:1048] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.909504 18667 raft_consensus.cc:1275] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:09.911090 19067 consensus_queue.cc:1048] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:09.906065 18493 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: soft_deleted_table [id=e96b491401104cfe95e5813b43ad5e4b] alter complete (version 1)
I20260709 13:19:09.919224 18669 raft_consensus.cc:1275] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:09.921020 19047 consensus_queue.cc:1048] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:10.003006 18593 raft_consensus.cc:1275] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:10.004079 19067 consensus_queue.cc:1048] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:10.012449 18669 raft_consensus.cc:1275] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Refusing update from remote peer 1e2ec72689e54d81868d5956afecf07c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:10.013972 18963 consensus_queue.cc:1048] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:10.163357 18669 raft_consensus.cc:1275] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:10.164603 19047 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:10.178831 18739 raft_consensus.cc:1275] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:10.180617 19075 consensus_queue.cc:1048] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:10.185491  9489 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:10.201293 18669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39320057629e4772923006cc806db450"
dest_uuid: "756c8d53c710434e8a243ac69e140dba"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:19:10.201929 18669 raft_consensus.cc:606] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:10.203138  9489 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 13:19:10.203714  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:10.228648 18739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d"
dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
mode: GRACEFUL
new_leader_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:55576
I20260709 13:19:10.229589 18739 raft_consensus.cc:606] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Received request to transfer leadership to TS 0b07f0363858493c83d7b3fea5327ead
I20260709 13:19:10.231127  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:10.231765  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:10.422910 19067 raft_consensus.cc:993] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:10.423512 18963 raft_consensus.cc:1081] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:10.425024 18591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49736
I20260709 13:19:10.425668 18591 raft_consensus.cc:493] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.426082 18591 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.432590 18591 raft_consensus.cc:515] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.434553 18591 leader_election.cc:290] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:10.435631 18739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:10.436364 18739 raft_consensus.cc:3055] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.436730 18739 raft_consensus.cc:740] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e2ec72689e54d81868d5956afecf07c, State: Running, Role: LEADER
I20260709 13:19:10.437937 18739 consensus_queue.cc:260] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.439028 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cf3061175f497c99a8d0974bd86b1d" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:10.439343 18739 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.439656 18669 raft_consensus.cc:3060] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.445850 18669 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 4.
I20260709 13:19:10.445850 18739 raft_consensus.cc:2468] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 4.
I20260709 13:19:10.447124 18558 leader_election.cc:304] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:10.447734 19047 raft_consensus.cc:2804] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:10.448125 19047 raft_consensus.cc:697] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:10.448838 19047 consensus_queue.cc:237] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.456524 18492 catalog_manager.cc:5697] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 3 to 4, leader changed from 1e2ec72689e54d81868d5956afecf07c (127.9.68.67) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 4 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.708317 18979 raft_consensus.cc:993] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: : Instructing follower 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:10.708762 18979 raft_consensus.cc:1081] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Signalling peer 0b07f0363858493c83d7b3fea5327ead to start an election
I20260709 13:19:10.710127 18591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39320057629e4772923006cc806db450"
dest_uuid: "0b07f0363858493c83d7b3fea5327ead"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:10.710582 18591 raft_consensus.cc:493] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:10.710875 18591 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.715687 18591 raft_consensus.cc:515] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.717682 18591 leader_election.cc:290] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Requested vote from peers 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973), 1e2ec72689e54d81868d5956afecf07c (127.9.68.67:37733)
I20260709 13:19:10.719655 18669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "756c8d53c710434e8a243ac69e140dba"
I20260709 13:19:10.720260 18669 raft_consensus.cc:3055] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:10.720690 18669 raft_consensus.cc:740] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 756c8d53c710434e8a243ac69e140dba, State: Running, Role: LEADER
I20260709 13:19:10.721799 18669 consensus_queue.cc:260] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.722970 18669 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.720153 18739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39320057629e4772923006cc806db450" candidate_uuid: "0b07f0363858493c83d7b3fea5327ead" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1e2ec72689e54d81868d5956afecf07c"
I20260709 13:19:10.729274 18739 raft_consensus.cc:3060] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:10.731464 18669 raft_consensus.cc:2468] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:10.733510 18558 leader_election.cc:304] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b07f0363858493c83d7b3fea5327ead, 756c8d53c710434e8a243ac69e140dba; no voters: 
I20260709 13:19:10.734330 19047 raft_consensus.cc:2804] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:10.735023 19047 raft_consensus.cc:697] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Becoming Leader. State: Replica: 0b07f0363858493c83d7b3fea5327ead, State: Running, Role: LEADER
I20260709 13:19:10.735867 19047 consensus_queue.cc:237] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } }
I20260709 13:19:10.737049 18739 raft_consensus.cc:2468] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b07f0363858493c83d7b3fea5327ead in term 2.
I20260709 13:19:10.743908 18492 catalog_manager.cc:5697] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead reported cstate change: term changed from 1 to 2, leader changed from 756c8d53c710434e8a243ac69e140dba (127.9.68.66) to 0b07f0363858493c83d7b3fea5327ead (127.9.68.65). New cstate: current_term: 2 leader_uuid: "0b07f0363858493c83d7b3fea5327ead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b07f0363858493c83d7b3fea5327ead" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 44973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.877502 18669 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:10.878739 19047 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:10.899550 18739 raft_consensus.cc:1275] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:10.901540 19049 consensus_queue.cc:1048] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:11.291842 18669 raft_consensus.cc:1275] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:19:11.292994 19049 consensus_queue.cc:1048] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "756c8d53c710434e8a243ac69e140dba" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 35973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:11.300266  9489 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:11.308507  9489 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:19:11.309029  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.316919 18739 raft_consensus.cc:1275] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Refusing update from remote peer 0b07f0363858493c83d7b3fea5327ead: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:19:11.318610 19075 consensus_queue.cc:1048] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e2ec72689e54d81868d5956afecf07c" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 37733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:11.336571  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:19:11.337136  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:12.368109  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:19:12.401947  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:12.402812  9489 tablet_replica.cc:333] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.403867  9489 raft_consensus.cc:2243] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.404470  9489 raft_consensus.cc:2272] T 7a0a3532b12246858caf47243b4b5ccc P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.406462  9489 tablet_replica.cc:333] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.406997  9489 raft_consensus.cc:2243] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.407374  9489 raft_consensus.cc:2272] T 32a95c9092a144a098029f202eea1e9c P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.409178  9489 tablet_replica.cc:333] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.409783  9489 raft_consensus.cc:2243] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.410451  9489 raft_consensus.cc:2272] T 39320057629e4772923006cc806db450 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.412313  9489 tablet_replica.cc:333] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.412987  9489 raft_consensus.cc:2243] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.413740  9489 raft_consensus.cc:2272] T 5cd311c2dec941ce917bf471ec13d484 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.415884  9489 tablet_replica.cc:333] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.416646  9489 raft_consensus.cc:2243] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.417155  9489 raft_consensus.cc:2272] T 5400828c3bf94c0187309b6343e329ec P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.419656  9489 tablet_replica.cc:333] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.420491  9489 raft_consensus.cc:2243] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.421008  9489 raft_consensus.cc:2272] T 9dcc4cc3abde4ea480464c9a5d260be1 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.423372  9489 tablet_replica.cc:333] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.423962  9489 raft_consensus.cc:2243] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.424544  9489 raft_consensus.cc:2272] T be9282c852c54d30be5803d1186aca10 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.427229  9489 tablet_replica.cc:333] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.427914  9489 raft_consensus.cc:2243] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.428437  9489 raft_consensus.cc:2272] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.430721  9489 tablet_replica.cc:333] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.431347  9489 raft_consensus.cc:2243] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.432188  9489 raft_consensus.cc:2272] T ba3309a976ea4ff5b3c4350e41f5695c P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.434396  9489 tablet_replica.cc:333] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.434993  9489 raft_consensus.cc:2243] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.435424  9489 raft_consensus.cc:2272] T 88139800ee184027a6b58362b9b61516 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.438334  9489 tablet_replica.cc:333] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.439062  9489 raft_consensus.cc:2243] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.440131  9489 raft_consensus.cc:2272] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.443068  9489 tablet_replica.cc:333] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.443730  9489 raft_consensus.cc:2243] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.444187  9489 raft_consensus.cc:2272] T 06c9b14be4cd437a9312ded80f9b7641 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.446350  9489 tablet_replica.cc:333] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.446861  9489 raft_consensus.cc:2243] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.447332  9489 raft_consensus.cc:2272] T 54e722465c234305a3815e9e9b66a066 P 0b07f0363858493c83d7b3fea5327ead [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.449095  9489 tablet_replica.cc:333] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.449795  9489 raft_consensus.cc:2243] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.450172  9489 raft_consensus.cc:2272] T 98c88af3f7644808b8bc8d09fbd926a4 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.452102  9489 tablet_replica.cc:333] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.452785  9489 raft_consensus.cc:2243] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:19:12.453585 18636 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:19:12.453698  9489 raft_consensus.cc:2272] T 30cf3061175f497c99a8d0974bd86b1d P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.456662  9489 tablet_replica.cc:333] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
W20260709 13:19:12.456930 18636 consensus_peers.cc:597] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.457391  9489 raft_consensus.cc:2243] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.457823  9489 raft_consensus.cc:2272] T 43238fe01e2a492896103417790df294 P 0b07f0363858493c83d7b3fea5327ead [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.459703  9489 tablet_replica.cc:333] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.460143  9489 raft_consensus.cc:2243] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.460810  9489 raft_consensus.cc:2272] T 44a025dd52e04dcdb2512536a3c3ef21 P 0b07f0363858493c83d7b3fea5327ead [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.463032  9489 tablet_replica.cc:333] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead: stopping tablet replica
I20260709 13:19:12.463689  9489 raft_consensus.cc:2243] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.464083  9489 raft_consensus.cc:2272] T bfad3994192648c3ad66d610f9ce4c28 P 0b07f0363858493c83d7b3fea5327ead [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.503407  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
I20260709 13:19:12.542902  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
W20260709 13:19:12.555521 18707 consensus_peers.cc:597] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c -> Peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Couldn't send request to peer 756c8d53c710434e8a243ac69e140dba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.558646 18707 consensus_peers.cc:597] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c -> Peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Couldn't send request to peer 756c8d53c710434e8a243ac69e140dba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.569262 18710 consensus_peers.cc:597] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.577858 18710 consensus_peers.cc:597] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.580132 18707 consensus_peers.cc:597] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c -> Peer 756c8d53c710434e8a243ac69e140dba (127.9.68.66:35973): Couldn't send request to peer 756c8d53c710434e8a243ac69e140dba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.583159  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:12.583930  9489 tablet_replica.cc:333] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.584640  9489 raft_consensus.cc:2243] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.585487  9489 raft_consensus.cc:2272] T 32a95c9092a144a098029f202eea1e9c P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.587466  9489 tablet_replica.cc:333] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.588025  9489 raft_consensus.cc:2243] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.588449  9489 raft_consensus.cc:2272] T be9282c852c54d30be5803d1186aca10 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.590306  9489 tablet_replica.cc:333] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.590822  9489 raft_consensus.cc:2243] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.591411  9489 raft_consensus.cc:2272] T 7a0a3532b12246858caf47243b4b5ccc P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.593896  9489 tablet_replica.cc:333] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.594908  9489 raft_consensus.cc:2243] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.595521  9489 raft_consensus.cc:2272] T 39320057629e4772923006cc806db450 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.597944  9489 tablet_replica.cc:333] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.598488  9489 raft_consensus.cc:2243] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.598903  9489 raft_consensus.cc:2272] T 5400828c3bf94c0187309b6343e329ec P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.600739  9489 tablet_replica.cc:333] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.601227  9489 raft_consensus.cc:2243] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.601904  9489 raft_consensus.cc:2272] T 9dcc4cc3abde4ea480464c9a5d260be1 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.603569  9489 tablet_replica.cc:333] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.604007  9489 raft_consensus.cc:2243] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.604368  9489 raft_consensus.cc:2272] T 5cd311c2dec941ce917bf471ec13d484 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.605975  9489 tablet_replica.cc:333] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.606483  9489 raft_consensus.cc:2243] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.607131  9489 raft_consensus.cc:2272] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.608906  9489 tablet_replica.cc:333] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.609630  9489 raft_consensus.cc:2243] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.610170  9489 raft_consensus.cc:2272] T ba3309a976ea4ff5b3c4350e41f5695c P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.612310  9489 tablet_replica.cc:333] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.612814  9489 raft_consensus.cc:2243] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.613603  9489 raft_consensus.cc:2272] T 88139800ee184027a6b58362b9b61516 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.615649  9489 tablet_replica.cc:333] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.616189  9489 raft_consensus.cc:2243] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.616556  9489 raft_consensus.cc:2272] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.618548  9489 tablet_replica.cc:333] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.619041  9489 raft_consensus.cc:2243] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.619835  9489 raft_consensus.cc:2272] T 06c9b14be4cd437a9312ded80f9b7641 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.622112  9489 tablet_replica.cc:333] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.622751  9489 raft_consensus.cc:2243] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.623553  9489 raft_consensus.cc:2272] T 43238fe01e2a492896103417790df294 P 756c8d53c710434e8a243ac69e140dba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.625739  9489 tablet_replica.cc:333] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.626268  9489 raft_consensus.cc:2243] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.626664  9489 raft_consensus.cc:2272] T bfad3994192648c3ad66d610f9ce4c28 P 756c8d53c710434e8a243ac69e140dba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.628539  9489 tablet_replica.cc:333] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.629069  9489 raft_consensus.cc:2243] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.629522  9489 raft_consensus.cc:2272] T 44a025dd52e04dcdb2512536a3c3ef21 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.631333  9489 tablet_replica.cc:333] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.631750  9489 raft_consensus.cc:2243] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.632085  9489 raft_consensus.cc:2272] T 54e722465c234305a3815e9e9b66a066 P 756c8d53c710434e8a243ac69e140dba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.634829  9489 tablet_replica.cc:333] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.635689  9489 raft_consensus.cc:2243] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.636528  9489 raft_consensus.cc:2272] T 30cf3061175f497c99a8d0974bd86b1d P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:12.639308 18710 consensus_peers.cc:597] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.639523  9489 tablet_replica.cc:333] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba: stopping tablet replica
I20260709 13:19:12.640134  9489 raft_consensus.cc:2243] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.640588  9489 raft_consensus.cc:2272] T 98c88af3f7644808b8bc8d09fbd926a4 P 756c8d53c710434e8a243ac69e140dba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:12.664836 18710 consensus_peers.cc:597] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.680542  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
W20260709 13:19:12.696406 18710 consensus_peers.cc:597] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c -> Peer 0b07f0363858493c83d7b3fea5327ead (127.9.68.65:44973): Couldn't send request to peer 0b07f0363858493c83d7b3fea5327ead. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:44973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.715576  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:19:12.746371  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:12.747135  9489 tablet_replica.cc:333] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.748052  9489 raft_consensus.cc:2243] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.748687  9489 raft_consensus.cc:2272] T 39320057629e4772923006cc806db450 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.751647  9489 tablet_replica.cc:333] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.752179  9489 raft_consensus.cc:2243] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.752846  9489 raft_consensus.cc:2272] T be9282c852c54d30be5803d1186aca10 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.754755  9489 tablet_replica.cc:333] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.755218  9489 raft_consensus.cc:2243] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.755592  9489 raft_consensus.cc:2272] T 3fa34b3fb8ba46f3b2c0cc01a6248e36 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.757360  9489 tablet_replica.cc:333] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.757849  9489 raft_consensus.cc:2243] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.758514  9489 raft_consensus.cc:2272] T 7a0a3532b12246858caf47243b4b5ccc P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.760306  9489 tablet_replica.cc:333] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.760840  9489 raft_consensus.cc:2243] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.761250  9489 raft_consensus.cc:2272] T 32a95c9092a144a098029f202eea1e9c P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.763103  9489 tablet_replica.cc:333] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.763633  9489 raft_consensus.cc:2243] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.764047  9489 raft_consensus.cc:2272] T 9dcc4cc3abde4ea480464c9a5d260be1 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.765887  9489 tablet_replica.cc:333] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.766445  9489 raft_consensus.cc:2243] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.766901  9489 raft_consensus.cc:2272] T 5cd311c2dec941ce917bf471ec13d484 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.768765  9489 tablet_replica.cc:333] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.769302  9489 raft_consensus.cc:2243] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.770053  9489 raft_consensus.cc:2272] T 5400828c3bf94c0187309b6343e329ec P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.771970  9489 tablet_replica.cc:333] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.772485  9489 raft_consensus.cc:2243] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.772948  9489 raft_consensus.cc:2272] T ba3309a976ea4ff5b3c4350e41f5695c P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.774777  9489 tablet_replica.cc:333] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.775353  9489 raft_consensus.cc:2243] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.775764  9489 raft_consensus.cc:2272] T 259e2caf4bc94b8ca5a5b022f3c25cf0 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.777781  9489 tablet_replica.cc:333] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.778563  9489 raft_consensus.cc:2243] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.779003  9489 raft_consensus.cc:2272] T 88139800ee184027a6b58362b9b61516 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.780905  9489 tablet_replica.cc:333] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.781523  9489 raft_consensus.cc:2243] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.781975  9489 raft_consensus.cc:2272] T 06c9b14be4cd437a9312ded80f9b7641 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.784063  9489 tablet_replica.cc:333] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.784595  9489 raft_consensus.cc:2243] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.784992  9489 raft_consensus.cc:2272] T 43238fe01e2a492896103417790df294 P 1e2ec72689e54d81868d5956afecf07c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.786854  9489 tablet_replica.cc:333] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.787356  9489 raft_consensus.cc:2243] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.787757  9489 raft_consensus.cc:2272] T 44a025dd52e04dcdb2512536a3c3ef21 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.789637  9489 tablet_replica.cc:333] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.790138  9489 raft_consensus.cc:2243] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.790870  9489 raft_consensus.cc:2272] T bfad3994192648c3ad66d610f9ce4c28 P 1e2ec72689e54d81868d5956afecf07c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.792891  9489 tablet_replica.cc:333] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.793424  9489 raft_consensus.cc:2243] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:12.793828  9489 raft_consensus.cc:2272] T 30cf3061175f497c99a8d0974bd86b1d P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.796255  9489 tablet_replica.cc:333] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.796842  9489 raft_consensus.cc:2243] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.797646  9489 raft_consensus.cc:2272] T 98c88af3f7644808b8bc8d09fbd926a4 P 1e2ec72689e54d81868d5956afecf07c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.799592  9489 tablet_replica.cc:333] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c: stopping tablet replica
I20260709 13:19:12.800057  9489 raft_consensus.cc:2243] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.800778  9489 raft_consensus.cc:2272] T 54e722465c234305a3815e9e9b66a066 P 1e2ec72689e54d81868d5956afecf07c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.864785  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:19:12.897886  9489 master.cc:562] Master@127.9.68.126:36901 shutting down...
I20260709 13:19:12.923097  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:12.923578  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:12.923848  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P 557e225848f840b9acf32003d59a999a: stopping tablet replica
I20260709 13:19:12.944223  9489 master.cc:584] Master@127.9.68.126:36901 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14300 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:19:13.000072  9489 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.68.126:37551
I20260709 13:19:13.001083  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:13.006384 19107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.007123 19110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.007229 19108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:13.008682  9489 server_base.cc:1061] running on GCE node
I20260709 13:19:13.009969  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:13.010177  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:13.010372  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603153010355 us; error 0 us; skew 500 ppm
I20260709 13:19:13.010963  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:13.013880  9489 webserver.cc:533] Webserver started at http://127.9.68.126:34125/ using document root <none> and password file <none>
I20260709 13:19:13.014357  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:13.014510  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:13.014842  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:13.015895  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/master-0-root/instance:
uuid: "7609b9e3acbf47e3a030b6b0b4f3b149"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.019989  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:19:13.023135 19115 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.023993  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:13.024533  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/master-0-root
uuid: "7609b9e3acbf47e3a030b6b0b4f3b149"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.024772  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:13.052186  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:13.053226  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:13.091138  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.126:37551
I20260709 13:19:13.091246 19166 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.126:37551 every 8 connection(s)
I20260709 13:19:13.095942 19167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.106302 19167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: Bootstrap starting.
I20260709 13:19:13.110853 19167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.114796 19167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: No bootstrap required, opened a new log
I20260709 13:19:13.117064 19167 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER }
I20260709 13:19:13.117471 19167 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.117669 19167 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7609b9e3acbf47e3a030b6b0b4f3b149, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.118216 19167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER }
I20260709 13:19:13.118600 19167 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:13.118793 19167 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:13.118991 19167 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.123126 19167 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER }
I20260709 13:19:13.123538 19167 leader_election.cc:304] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7609b9e3acbf47e3a030b6b0b4f3b149; no voters: 
I20260709 13:19:13.124545 19167 leader_election.cc:290] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:13.125275 19170 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.126932 19170 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 1 LEADER]: Becoming Leader. State: Replica: 7609b9e3acbf47e3a030b6b0b4f3b149, State: Running, Role: LEADER
I20260709 13:19:13.127588 19170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER }
I20260709 13:19:13.127815 19167 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:13.132304 19172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7609b9e3acbf47e3a030b6b0b4f3b149. Latest consensus state: current_term: 1 leader_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER } }
I20260709 13:19:13.132216 19171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7609b9e3acbf47e3a030b6b0b4f3b149" member_type: VOTER } }
I20260709 13:19:13.132982 19172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:13.133083 19171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:13.136513 19177 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:13.142069 19177 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:13.144953  9489 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:13.151544 19177 catalog_manager.cc:1383] Generated new cluster ID: 4b19660c92f642bd978083a5be2af46f
I20260709 13:19:13.151883 19177 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:13.171978 19177 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:13.173453 19177 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:13.187515 19177 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: Generated new TSK 0
I20260709 13:19:13.188099 19177 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:13.214175  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:13.220552 19188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.221690 19189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.223204 19191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:13.223495  9489 server_base.cc:1061] running on GCE node
I20260709 13:19:13.224444  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:13.224629  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:13.224748  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603153224737 us; error 0 us; skew 500 ppm
I20260709 13:19:13.225169  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:13.227411  9489 webserver.cc:533] Webserver started at http://127.9.68.65:40825/ using document root <none> and password file <none>
I20260709 13:19:13.227819  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:13.227967  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:13.228169  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:13.229190  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-0-root/instance:
uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.233876  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:13.237179 19196 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.238085  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:13.238344  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-0-root
uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.238562  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:13.255017  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:13.256053  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:13.257431  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:13.259541  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:13.259738  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.259974  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:13.260133  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.301620  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.65:38549
I20260709 13:19:13.301716 19258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.65:38549 every 8 connection(s)
I20260709 13:19:13.307238  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:13.314477 19263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.316308 19264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.318653 19266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:13.321400 19259 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37551
I20260709 13:19:13.321795 19259 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:13.322059  9489 server_base.cc:1061] running on GCE node
I20260709 13:19:13.322572 19259 heartbeater.cc:507] Master 127.9.68.126:37551 requested a full tablet report, sending...
I20260709 13:19:13.323132  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:13.323392  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:13.323582  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603153323565 us; error 0 us; skew 500 ppm
I20260709 13:19:13.324136  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:13.324584 19132 ts_manager.cc:194] Registered new tserver with Master: 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549)
I20260709 13:19:13.326740  9489 webserver.cc:533] Webserver started at http://127.9.68.66:36869/ using document root <none> and password file <none>
I20260709 13:19:13.326815 19132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48650
I20260709 13:19:13.327294  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:13.327538  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:13.327800  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:13.328965  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-1-root/instance:
uuid: "dbc70ce0a780449ca165da665d801c28"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.334157  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:13.338460 19271 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.339298  9489 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:13.339605  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-1-root
uuid: "dbc70ce0a780449ca165da665d801c28"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.339895  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:13.358126  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:13.359272  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:13.360837  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:13.363031  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:13.363245  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.363497  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:13.363667  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.404654  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.66:41119
I20260709 13:19:13.404765 19333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.66:41119 every 8 connection(s)
I20260709 13:19:13.409509  9489 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:13.416703 19337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.417564 19338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:13.419651 19340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:13.422278  9489 server_base.cc:1061] running on GCE node
I20260709 13:19:13.422436 19334 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37551
I20260709 13:19:13.422966 19334 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:13.423533  9489 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:13.423872  9489 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:13.424057 19334 heartbeater.cc:507] Master 127.9.68.126:37551 requested a full tablet report, sending...
I20260709 13:19:13.424115  9489 hybrid_clock.cc:648] HybridClock initialized: now 1783603153424093 us; error 0 us; skew 500 ppm
I20260709 13:19:13.425222  9489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:13.426719 19132 ts_manager.cc:194] Registered new tserver with Master: dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:13.427999  9489 webserver.cc:533] Webserver started at http://127.9.68.67:45075/ using document root <none> and password file <none>
I20260709 13:19:13.428685  9489 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:13.428583 19132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48656
I20260709 13:19:13.429054  9489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:13.429427  9489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:13.431001  9489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-2-root/instance:
uuid: "8ae08b51234945efa1d044e10e39b769"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.435413  9489 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:19:13.439678 19345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.440593  9489 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:19:13.440915  9489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-2-root
uuid: "8ae08b51234945efa1d044e10e39b769"
format_stamp: "Formatted at 2026-07-09 13:19:13 on dist-test-slave-9s6w"
I20260709 13:19:13.441193  9489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskA1VLFv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602879041690-9489-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:13.455963  9489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:13.457021  9489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:13.458462  9489 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:13.460500  9489 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:13.460701  9489 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.460947  9489 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:13.461083  9489 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:13.505111  9489 rpc_server.cc:307] RPC server started. Bound to: 127.9.68.67:44781
I20260709 13:19:13.505234 19407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.68.67:44781 every 8 connection(s)
I20260709 13:19:13.519408 19408 heartbeater.cc:344] Connected to a master server at 127.9.68.126:37551
I20260709 13:19:13.519851 19408 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:13.520517 19408 heartbeater.cc:507] Master 127.9.68.126:37551 requested a full tablet report, sending...
I20260709 13:19:13.522931 19132 ts_manager.cc:194] Registered new tserver with Master: 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:13.523566  9489 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015062741s
I20260709 13:19:13.524685 19132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48670
I20260709 13:19:13.549849 19132 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48678:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:13.552284 19132 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:13.629405 19371 tablet_service.cc:1511] Processing CreateTablet for tablet f9bed843100342a0b7f4c92f2e8f5e12 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:13.630090 19298 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c95abb261437c9399f639f98fa4f9 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:13.630873 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bed843100342a0b7f4c92f2e8f5e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.631402 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c95abb261437c9399f639f98fa4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.634701 19370 tablet_service.cc:1511] Processing CreateTablet for tablet fbc482433c0c43a7a8610404f96e98da (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:13.635205 19224 tablet_service.cc:1511] Processing CreateTablet for tablet ba9ce0657a4c43e4b19af73ca6c703a8 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:13.636399 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc482433c0c43a7a8610404f96e98da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.636236 19220 tablet_service.cc:1511] Processing CreateTablet for tablet db302b1d7e144f29aa8c22d5051751b6 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:13.636636 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9ce0657a4c43e4b19af73ca6c703a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.638446 19222 tablet_service.cc:1511] Processing CreateTablet for tablet f9bed843100342a0b7f4c92f2e8f5e12 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:13.638576 19297 tablet_service.cc:1511] Processing CreateTablet for tablet f9bed843100342a0b7f4c92f2e8f5e12 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:13.639850 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db302b1d7e144f29aa8c22d5051751b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.640183 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bed843100342a0b7f4c92f2e8f5e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.640332 19223 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c95abb261437c9399f639f98fa4f9 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:13.641746 19223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c95abb261437c9399f639f98fa4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.641836 19369 tablet_service.cc:1511] Processing CreateTablet for tablet db302b1d7e144f29aa8c22d5051751b6 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:13.635205 19221 tablet_service.cc:1511] Processing CreateTablet for tablet fbc482433c0c43a7a8610404f96e98da (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:13.644366 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc482433c0c43a7a8610404f96e98da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.644977 19296 tablet_service.cc:1511] Processing CreateTablet for tablet fbc482433c0c43a7a8610404f96e98da (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:13.643391 19369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db302b1d7e144f29aa8c22d5051751b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.647985 19373 tablet_service.cc:1511] Processing CreateTablet for tablet ba9ce0657a4c43e4b19af73ca6c703a8 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:13.648051 19294 tablet_service.cc:1511] Processing CreateTablet for tablet 0992462a7ceb4556993aa6fb613f7a36 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:13.650785 19368 tablet_service.cc:1511] Processing CreateTablet for tablet 0992462a7ceb4556993aa6fb613f7a36 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:13.652161 19368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0992462a7ceb4556993aa6fb613f7a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.646270 19222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bed843100342a0b7f4c92f2e8f5e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.655503 19219 tablet_service.cc:1511] Processing CreateTablet for tablet 0992462a7ceb4556993aa6fb613f7a36 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:13.655658 19299 tablet_service.cc:1511] Processing CreateTablet for tablet ba9ce0657a4c43e4b19af73ca6c703a8 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:13.655848 19372 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c95abb261437c9399f639f98fa4f9 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:13.657197 19219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0992462a7ceb4556993aa6fb613f7a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.648366 19295 tablet_service.cc:1511] Processing CreateTablet for tablet db302b1d7e144f29aa8c22d5051751b6 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:13.659824 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9ce0657a4c43e4b19af73ca6c703a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.662293 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db302b1d7e144f29aa8c22d5051751b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.663856 19373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9ce0657a4c43e4b19af73ca6c703a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.667590 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbc482433c0c43a7a8610404f96e98da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.669641 19372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c95abb261437c9399f639f98fa4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.685987 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0992462a7ceb4556993aa6fb613f7a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.688793 19218 tablet_service.cc:1511] Processing CreateTablet for tablet 0fda761d40a040739c7b22fe93c99a29 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:13.690135 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fda761d40a040739c7b22fe93c99a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.693674 19293 tablet_service.cc:1511] Processing CreateTablet for tablet 0fda761d40a040739c7b22fe93c99a29 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:13.694988 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fda761d40a040739c7b22fe93c99a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.707047 19367 tablet_service.cc:1511] Processing CreateTablet for tablet 0fda761d40a040739c7b22fe93c99a29 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:13.708770 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fda761d40a040739c7b22fe93c99a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.729023 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 573610e34f184a6bb129a115635a5472 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:13.729418 19217 tablet_service.cc:1511] Processing CreateTablet for tablet 573610e34f184a6bb129a115635a5472 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:13.730657 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573610e34f184a6bb129a115635a5472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.731122 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573610e34f184a6bb129a115635a5472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.748334 19372 tablet_service.cc:1511] Processing CreateTablet for tablet 573610e34f184a6bb129a115635a5472 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:13.749679 19372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573610e34f184a6bb129a115635a5472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.754119 19424 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:13.772208 19291 tablet_service.cc:1511] Processing CreateTablet for tablet 277996d8c6a54315b6fe22b05f5e39a3 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:13.773689 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277996d8c6a54315b6fe22b05f5e39a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.782290 19218 tablet_service.cc:1511] Processing CreateTablet for tablet 277996d8c6a54315b6fe22b05f5e39a3 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:13.790735 19424 tablet_bootstrap.cc:654] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.793906 19425 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:13.799485 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277996d8c6a54315b6fe22b05f5e39a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.801450 19423 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:13.808873 19371 tablet_service.cc:1511] Processing CreateTablet for tablet 277996d8c6a54315b6fe22b05f5e39a3 (DEFAULT_TABLE table=test-workload [id=8c7b04da95474e3b99024bf1704614b4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:13.810214 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277996d8c6a54315b6fe22b05f5e39a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:13.816558 19425 tablet_bootstrap.cc:654] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.826872 19423 tablet_bootstrap.cc:654] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.827910 19425 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:13.828408 19425 ts_tablet_manager.cc:1403] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.006s
I20260709 13:19:13.831256 19425 raft_consensus.cc:359] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.831931 19425 raft_consensus.cc:385] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.832244 19425 raft_consensus.cc:740] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.832938 19425 consensus_queue.cc:260] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.839326 19334 heartbeater.cc:499] Master 127.9.68.126:37551 was elected leader, sending a full tablet report...
I20260709 13:19:13.839783 19425 ts_tablet_manager.cc:1434] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:19:13.840935 19425 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:13.847271 19425 tablet_bootstrap.cc:654] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.852284 19424 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:13.852340 19423 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:13.852818 19423 ts_tablet_manager.cc:1403] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.011s
I20260709 13:19:13.852821 19424 ts_tablet_manager.cc:1403] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.011s
I20260709 13:19:13.855014 19425 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:13.855506 19425 ts_tablet_manager.cc:1403] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.015s	user 0.000s	sys 0.010s
I20260709 13:19:13.855535 19424 raft_consensus.cc:359] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.855885 19423 raft_consensus.cc:359] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.856467 19424 raft_consensus.cc:385] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.856693 19423 raft_consensus.cc:385] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.856881 19424 raft_consensus.cc:740] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.857098 19423 raft_consensus.cc:740] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.857908 19424 consensus_queue.cc:260] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.858032 19423 consensus_queue.cc:260] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.858491 19425 raft_consensus.cc:359] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.859220 19425 raft_consensus.cc:385] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.859577 19425 raft_consensus.cc:740] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.860620 19425 consensus_queue.cc:260] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.863318 19425 ts_tablet_manager.cc:1434] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:13.864517 19425 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:13.868096 19423 ts_tablet_manager.cc:1434] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:19:13.868861 19408 heartbeater.cc:499] Master 127.9.68.126:37551 was elected leader, sending a full tablet report...
I20260709 13:19:13.871035 19425 tablet_bootstrap.cc:654] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.882638 19259 heartbeater.cc:499] Master 127.9.68.126:37551 was elected leader, sending a full tablet report...
I20260709 13:19:13.883173 19424 ts_tablet_manager.cc:1434] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.030s	user 0.013s	sys 0.015s
I20260709 13:19:13.884054 19423 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:13.884132 19424 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:13.890733 19424 tablet_bootstrap.cc:654] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.893801 19423 tablet_bootstrap.cc:654] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.900302 19425 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:13.900777 19425 ts_tablet_manager.cc:1403] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.020s
I20260709 13:19:13.903708 19425 raft_consensus.cc:359] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.904438 19425 raft_consensus.cc:385] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.904734 19425 raft_consensus.cc:740] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.905575 19425 consensus_queue.cc:260] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.909813 19425 ts_tablet_manager.cc:1434] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.007s
I20260709 13:19:13.910774 19425 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:13.916837 19425 tablet_bootstrap.cc:654] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.934762 19429 raft_consensus.cc:493] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.935335 19429 raft_consensus.cc:515] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.946298 19429 leader_election.cc:290] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:13.950521 19423 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:13.951092 19423 ts_tablet_manager.cc:1403] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.034s
I20260709 13:19:13.953999 19423 raft_consensus.cc:359] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.954713 19423 raft_consensus.cc:385] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.955004 19423 raft_consensus.cc:740] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.957533 19423 consensus_queue.cc:260] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.959255 19425 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:13.959584 19423 ts_tablet_manager.cc:1434] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:19:13.959793 19425 ts_tablet_manager.cc:1403] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.049s	user 0.001s	sys 0.020s
I20260709 13:19:13.960273 19424 tablet_bootstrap.cc:492] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:13.960613 19423 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:13.960783 19424 ts_tablet_manager.cc:1403] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.059s
I20260709 13:19:13.961511 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:13.962853 19425 raft_consensus.cc:359] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.963565 19425 raft_consensus.cc:385] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.963874 19425 raft_consensus.cc:740] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.963658 19424 raft_consensus.cc:359] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.964406 19424 raft_consensus.cc:385] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.964712 19424 raft_consensus.cc:740] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.965538 19424 consensus_queue.cc:260] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.967377 19423 tablet_bootstrap.cc:654] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.969698 19424 ts_tablet_manager.cc:1434] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:19:13.970674 19424 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:13.972664 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:13.974519 19425 consensus_queue.cc:260] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.976640 19424 tablet_bootstrap.cc:654] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.976837 19425 ts_tablet_manager.cc:1434] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:13.977895 19425 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
W20260709 13:19:13.967293 19272 leader_election.cc:343] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.986336 19425 tablet_bootstrap.cc:654] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:13.986711 19274 leader_election.cc:343] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.990180 19274 leader_election.cc:304] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:13.992657 19423 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:13.993155 19423 ts_tablet_manager.cc:1403] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.015s
I20260709 13:19:13.993080 19429 raft_consensus.cc:2749] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.996026 19424 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:13.996702 19424 ts_tablet_manager.cc:1403] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:19:13.996279 19423 raft_consensus.cc:359] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.997150 19423 raft_consensus.cc:385] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.997467 19423 raft_consensus.cc:740] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.998368 19423 consensus_queue.cc:260] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:13.999882 19424 raft_consensus.cc:359] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.000586 19424 raft_consensus.cc:385] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.000699 19425 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:14.000918 19424 raft_consensus.cc:740] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.001231 19425 ts_tablet_manager.cc:1403] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:19:14.001713 19424 consensus_queue.cc:260] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.002676 19423 ts_tablet_manager.cc:1434] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:14.003654 19423 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.004164 19425 raft_consensus.cc:359] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.004887 19425 raft_consensus.cc:385] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.005182 19425 raft_consensus.cc:740] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.006098 19425 consensus_queue.cc:260] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.006989 19424 ts_tablet_manager.cc:1434] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:19:14.007931 19424 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.011651 19425 ts_tablet_manager.cc:1434] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:14.012697 19425 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:14.013417 19423 tablet_bootstrap.cc:654] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.013782 19424 tablet_bootstrap.cc:654] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.019989 19425 tablet_bootstrap.cc:654] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.026348 19424 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.026991 19424 ts_tablet_manager.cc:1403] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 13:19:14.029768 19425 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:14.030269 19425 ts_tablet_manager.cc:1403] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
I20260709 13:19:14.030104 19424 raft_consensus.cc:359] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.030860 19424 raft_consensus.cc:385] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.031155 19424 raft_consensus.cc:740] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.031865 19424 consensus_queue.cc:260] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.033293 19425 raft_consensus.cc:359] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.034032 19425 raft_consensus.cc:385] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.034226 19424 ts_tablet_manager.cc:1434] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:14.034340 19425 raft_consensus.cc:740] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.035310 19424 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.035311 19425 consensus_queue.cc:260] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.037915 19423 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.038425 19423 ts_tablet_manager.cc:1403] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.004s
I20260709 13:19:14.038969 19425 ts_tablet_manager.cc:1434] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:14.040109 19425 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:14.041281 19423 raft_consensus.cc:359] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.042276 19424 tablet_bootstrap.cc:654] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.042636 19423 raft_consensus.cc:385] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.042986 19423 raft_consensus.cc:740] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.043918 19423 consensus_queue.cc:260] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.048198 19425 tablet_bootstrap.cc:654] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.049124 19423 ts_tablet_manager.cc:1434] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:19:14.050208 19423 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.056185 19423 tablet_bootstrap.cc:654] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.062029 19424 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.062024 19425 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:14.062696 19424 ts_tablet_manager.cc:1403] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
I20260709 13:19:14.062726 19425 ts_tablet_manager.cc:1403] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 13:19:14.065858 19423 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.065817 19425 raft_consensus.cc:359] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.066036 19424 raft_consensus.cc:359] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.066679 19425 raft_consensus.cc:385] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.066797 19424 raft_consensus.cc:385] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.067047 19425 raft_consensus.cc:740] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.067121 19424 raft_consensus.cc:740] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.066411 19423 ts_tablet_manager.cc:1403] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:19:14.067909 19425 consensus_queue.cc:260] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.067893 19424 consensus_queue.cc:260] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.070701 19425 ts_tablet_manager.cc:1434] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:19:14.070586 19423 raft_consensus.cc:359] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.071436 19423 raft_consensus.cc:385] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.071746 19423 raft_consensus.cc:740] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.072450 19423 consensus_queue.cc:260] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.073614 19424 ts_tablet_manager.cc:1434] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:19:14.074667 19423 ts_tablet_manager.cc:1434] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:19:14.074826 19424 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.075795 19423 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.075814 19431 raft_consensus.cc:493] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.076426 19431 raft_consensus.cc:515] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.079746 19425 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:14.082453 19424 tablet_bootstrap.cc:654] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.082702 19431 leader_election.cc:290] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.083236 19431 raft_consensus.cc:493] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.083635 19431 raft_consensus.cc:515] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.084019 19423 tablet_bootstrap.cc:654] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.089226 19425 tablet_bootstrap.cc:654] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.092708 19423 tablet_bootstrap.cc:492] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.093164 19423 ts_tablet_manager.cc:1403] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:19:14.096460 19423 raft_consensus.cc:359] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.097333 19423 raft_consensus.cc:385] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.097684 19423 raft_consensus.cc:740] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.099784 19423 consensus_queue.cc:260] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.101552 19424 tablet_bootstrap.cc:492] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.102290 19424 ts_tablet_manager.cc:1403] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 13:19:14.102329 19423 ts_tablet_manager.cc:1434] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:14.103703 19423 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.106556 19424 raft_consensus.cc:359] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.107537 19424 raft_consensus.cc:385] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.107985 19424 raft_consensus.cc:740] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.108894 19424 consensus_queue.cc:260] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.109560 19432 raft_consensus.cc:493] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.110131 19432 raft_consensus.cc:515] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.112046 19424 ts_tablet_manager.cc:1434] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:14.112716 19432 leader_election.cc:290] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.114269 19424 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.120502 19423 tablet_bootstrap.cc:654] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.121264 19431 leader_election.cc:290] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.127467 19424 tablet_bootstrap.cc:654] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:14.140632 19180 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:14.147260 19423 tablet_bootstrap.cc:492] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.147814 19423 ts_tablet_manager.cc:1403] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.006s
I20260709 13:19:14.148161 19424 tablet_bootstrap.cc:492] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.148919 19424 ts_tablet_manager.cc:1403] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.006s
I20260709 13:19:14.150337 19429 raft_consensus.cc:493] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.151037 19429 raft_consensus.cc:515] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.155707 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
W20260709 13:19:14.157588 19272 leader_election.cc:343] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.159998 19429 leader_election.cc:290] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.161118 19429 raft_consensus.cc:493] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.163674 19432 raft_consensus.cc:493] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.164301 19432 raft_consensus.cc:515] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.165649 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.166308 19432 leader_election.cc:290] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.166325 19234 raft_consensus.cc:2468] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:14.162668 19429 raft_consensus.cc:515] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.165761 19423 raft_consensus.cc:359] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.169793 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.170006 19423 raft_consensus.cc:385] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.170348 19423 raft_consensus.cc:740] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.170747 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.171371 19234 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.172672 19348 leader_election.cc:304] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.173759 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.173830 19274 leader_election.cc:304] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:14.173884 19308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.173599 19432 raft_consensus.cc:2804] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.174669 19309 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.175058 19308 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.175058 19432 raft_consensus.cc:493] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.166633 19448 raft_consensus.cc:493] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.175858 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.176860 19348 leader_election.cc:304] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.177016 19448 raft_consensus.cc:515] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.177977 19432 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.178289 19233 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.178527 19423 consensus_queue.cc:260] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.181915 19429 leader_election.cc:290] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.182483 19429 raft_consensus.cc:2804] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.182829 19429 raft_consensus.cc:493] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.183175 19429 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.183779 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
W20260709 13:19:14.185220 19272 leader_election.cc:343] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.185845 19448 leader_election.cc:290] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.185726 19424 raft_consensus.cc:359] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.186316 19461 raft_consensus.cc:493] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.186548 19424 raft_consensus.cc:385] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.186944 19424 raft_consensus.cc:740] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.186843 19461 raft_consensus.cc:515] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.187295 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.187994 19382 raft_consensus.cc:2468] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:14.187777 19424 consensus_queue.cc:260] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.188513 19461 leader_election.cc:290] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.189023 19461 raft_consensus.cc:2804] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.189090 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.194895 19461 raft_consensus.cc:493] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.190013 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.195334 19461 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.196275 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.197063 19233 raft_consensus.cc:2468] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.198432 19348 leader_election.cc:304] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.199421 19462 raft_consensus.cc:2804] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.199208 19429 raft_consensus.cc:515] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.199821 19462 raft_consensus.cc:493] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.200150 19462 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.194561 19424 ts_tablet_manager.cc:1434] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:19:14.202296 19424 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.202708 19461 raft_consensus.cc:515] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.203837 19381 raft_consensus.cc:2393] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.207105 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.207170 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.207731 19309 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.190971 19197 leader_election.cc:304] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.191507 19423 ts_tablet_manager.cc:1434] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 13:19:14.208453 19424 tablet_bootstrap.cc:654] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.209177 19423 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.201277 19429 leader_election.cc:290] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.193529 19308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
W20260709 13:19:14.214514 19348 leader_election.cc:343] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:14.215862 19272 leader_election.cc:343] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.216590 19309 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.215291 19448 raft_consensus.cc:2804] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.217751 19348 leader_election.cc:304] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.217941 19448 raft_consensus.cc:493] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.218796 19448 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.223156 19461 leader_election.cc:290] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.223754 19461 raft_consensus.cc:2804] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.224157 19461 raft_consensus.cc:697] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.217535 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.225365 19461 consensus_queue.cc:237] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
W20260709 13:19:14.227190 19274 leader_election.cc:343] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.227516 19425 tablet_bootstrap.cc:492] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:14.228042 19425 ts_tablet_manager.cc:1403] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.156s	user 0.036s	sys 0.059s
I20260709 13:19:14.227864 19274 leader_election.cc:304] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.228826 19429 raft_consensus.cc:2749] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.230682 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.231603 19233 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.231199 19425 raft_consensus.cc:359] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.233520 19425 raft_consensus.cc:385] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.233871 19425 raft_consensus.cc:740] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.234701 19425 consensus_queue.cc:260] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.236967 19425 ts_tablet_manager.cc:1434] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:19:14.225930 19234 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.238987 19425 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:14.232968 19448 raft_consensus.cc:515] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.245710 19425 tablet_bootstrap.cc:654] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.245980 19234 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.247175 19423 tablet_bootstrap.cc:654] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.249436 19448 leader_election.cc:290] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.251082 19424 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.250833 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.252581 19130 catalog_manager.cc:5697] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.253907 19424 ts_tablet_manager.cc:1403] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.013s
I20260709 13:19:14.256677 19424 raft_consensus.cc:359] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.257535 19424 raft_consensus.cc:385] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.257881 19424 raft_consensus.cc:740] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.258723 19424 consensus_queue.cc:260] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.264278 19424 ts_tablet_manager.cc:1434] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:19:14.265153 19424 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:14.270761 19424 tablet_bootstrap.cc:654] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.245502 19462 raft_consensus.cc:515] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.272411 19381 raft_consensus.cc:2393] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.280714 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.281755 19234 raft_consensus.cc:2393] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in this term.
I20260709 13:19:14.285288 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.285880 19309 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.287573 19424 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:14.288095 19424 ts_tablet_manager.cc:1403] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.014s
I20260709 13:19:14.288605 19429 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.289597 19459 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.290046 19429 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.290552 19459 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.293222 19460 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.293843 19460 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.295208 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.295735 19309 raft_consensus.cc:2468] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.296141 19381 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:14.296970 19348 leader_election.cc:304] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.297025 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.297468 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.297878 19232 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.298010 19461 raft_consensus.cc:2804] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.300863 19348 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.301072 19272 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.298923 19462 leader_election.cc:290] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.288936 19432 raft_consensus.cc:515] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.308002 19462 raft_consensus.cc:2804] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.308386 19462 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.308708 19462 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.309535 19432 leader_election.cc:290] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.310293 19383 raft_consensus.cc:2393] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.313428 19461 raft_consensus.cc:697] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.299700 19429 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.314004 19448 raft_consensus.cc:493] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.314545 19429 raft_consensus.cc:2804] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.314916 19429 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.314788 19448 raft_consensus.cc:515] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.315256 19429 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.315310 19425 tablet_bootstrap.cc:492] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:14.315986 19425 ts_tablet_manager.cc:1403] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.020s
I20260709 13:19:14.321730 19424 raft_consensus.cc:359] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.322656 19424 raft_consensus.cc:385] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.322999 19424 raft_consensus.cc:740] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.323823 19424 consensus_queue.cc:260] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.324433 19308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.326406 19308 raft_consensus.cc:2393] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.326696 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.327402 19305 raft_consensus.cc:2468] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:14.328316 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.328760 19199 leader_election.cc:304] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.329130 19306 raft_consensus.cc:2393] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.329308 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.330868 19307 raft_consensus.cc:2393] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.322672 19448 leader_election.cc:290] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.331076 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.331651 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.331666 19431 raft_consensus.cc:2804] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.332301 19309 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:14.332427 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.332867 19431 raft_consensus.cc:493] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.333266 19431 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.333427 19461 consensus_queue.cc:237] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.333194 19232 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:14.331813 19234 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.336926 19424 ts_tablet_manager.cc:1434] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.001s
I20260709 13:19:14.336606 19233 raft_consensus.cc:2468] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:14.339064 19448 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.332515 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.340171 19448 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.332473 19460 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.342734 19448 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.343940 19199 leader_election.cc:304] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.344897 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.345570 19309 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:14.346146 19448 raft_consensus.cc:2749] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.345651 19429 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.345630 19199 leader_election.cc:304] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.348979 19429 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.349671 19429 raft_consensus.cc:493] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.350193 19448 raft_consensus.cc:2749] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.350175 19429 raft_consensus.cc:515] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.349998 19199 leader_election.cc:304] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:14.352213 19274 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.353143 19429 leader_election.cc:290] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.353381 19274 leader_election.cc:304] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:14.353982 19429 raft_consensus.cc:2804] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.354501 19429 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.354912 19429 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.356956 19425 raft_consensus.cc:359] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.358649 19425 raft_consensus.cc:385] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.358878 19234 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.359920 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.361553 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.358155 19459 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.362496 19425 raft_consensus.cc:740] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
W20260709 13:19:14.367772 19272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.68.67:44781, user_credentials={real_user=slave}} blocked reactor thread for 66776.1us
I20260709 13:19:14.366842 19425 consensus_queue.cc:260] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.364418 19448 raft_consensus.cc:2764] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:14.366701 19309 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.375280 19307 raft_consensus.cc:2393] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:14.370455 19459 raft_consensus.cc:2804] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.378260 19199 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.378695 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.379174 19348 leader_election.cc:304] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.380378 19448 raft_consensus.cc:2804] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.381210 19448 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.380729 19462 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.381632 19448 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.381896 19423 tablet_bootstrap.cc:492] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.382367 19383 raft_consensus.cc:2393] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc70ce0a780449ca165da665d801c28 in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:14.382545 19423 ts_tablet_manager.cc:1403] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.014s
I20260709 13:19:14.384055 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.384699 19234 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.385262 19423 raft_consensus.cc:359] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.385951 19423 raft_consensus.cc:385] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.386241 19423 raft_consensus.cc:740] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.386905 19423 consensus_queue.cc:260] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.387840 19460 raft_consensus.cc:2804] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.388303 19460 raft_consensus.cc:697] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.388787 19423 ts_tablet_manager.cc:1434] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:19:14.389106 19460 consensus_queue.cc:237] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.389822 19423 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:14.391382 19448 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.392694 19309 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.395205 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.395721 19423 tablet_bootstrap.cc:654] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.396461 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0992462a7ceb4556993aa6fb613f7a36" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.397650 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.402385 19459 raft_consensus.cc:697] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
W20260709 13:19:14.403923 19197 leader_election.cc:343] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.403733 19431 raft_consensus.cc:515] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.397100 19232 raft_consensus.cc:2468] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:14.408521 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0992462a7ceb4556993aa6fb613f7a36" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.409178 19448 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.409464 19383 raft_consensus.cc:2468] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:14.411037 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.411933 19381 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:14.412331 19274 leader_election.cc:304] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.414572 19462 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.414795 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.415067 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.415934 19306 raft_consensus.cc:2393] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:14.415380 19462 raft_consensus.cc:493] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.415917 19381 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.416638 19462 raft_consensus.cc:515] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.419307 19459 consensus_queue.cc:237] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.420285 19234 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.421591 19425 ts_tablet_manager.cc:1434] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.002s
I20260709 13:19:14.410140 19429 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.423990 19307 raft_consensus.cc:2393] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:14.422293 19348 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.425181 19429 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.425899 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:14.428294 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.429816 19272 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.430042 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.430828 19234 raft_consensus.cc:2393] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbc70ce0a780449ca165da665d801c28 in current term 1: Already voted for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in this term.
I20260709 13:19:14.432101 19476 raft_consensus.cc:2804] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.432539 19476 raft_consensus.cc:493] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.432957 19476 raft_consensus.cc:3060] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.432582 19274 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.433992 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.434342 19130 catalog_manager.cc:5697] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.435998 19429 raft_consensus.cc:2749] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.436540 19381 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 1.
I20260709 13:19:14.439075 19472 raft_consensus.cc:2749] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.437505 19461 raft_consensus.cc:2804] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.440819 19423 tablet_bootstrap.cc:492] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:14.440351 19130 catalog_manager.cc:5697] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.443053 19462 leader_election.cc:290] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.443895 19431 leader_election.cc:290] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.445714 19423 ts_tablet_manager.cc:1403] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.020s
I20260709 13:19:14.444451 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.449749 19307 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.446632 19461 raft_consensus.cc:697] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.450950 19348 leader_election.cc:304] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.447300 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.444485 19309 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.450779 19423 raft_consensus.cc:359] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.451231 19461 consensus_queue.cc:237] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.451807 19423 raft_consensus.cc:385] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.451828 19462 raft_consensus.cc:2804] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.452220 19423 raft_consensus.cc:740] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.452288 19462 raft_consensus.cc:493] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.452674 19462 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.453080 19423 consensus_queue.cc:260] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.453539 19476 raft_consensus.cc:515] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.453980 19383 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.455623 19476 leader_election.cc:290] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.456745 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0992462a7ceb4556993aa6fb613f7a36" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.445063 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.457333 19382 raft_consensus.cc:3060] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.458552 19234 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:14.461903 19197 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.468833 19131 catalog_manager.cc:5697] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.470733 19309 raft_consensus.cc:2468] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 1.
I20260709 13:19:14.471834 19199 leader_election.cc:304] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.472640 19383 raft_consensus.cc:2468] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 1.
I20260709 13:19:14.473053 19382 raft_consensus.cc:2468] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:14.473677 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0992462a7ceb4556993aa6fb613f7a36" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.474264 19234 raft_consensus.cc:3060] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.474184 19272 leader_election.cc:304] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.474584 19448 raft_consensus.cc:2804] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.475081 19448 raft_consensus.cc:697] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.475158 19476 raft_consensus.cc:2804] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.475317 19473 raft_consensus.cc:2804] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.475704 19476 raft_consensus.cc:697] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:14.475960 19448 consensus_queue.cc:237] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.476593 19476 consensus_queue.cc:237] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.488629 19423 ts_tablet_manager.cc:1434] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:19:14.494053 19130 catalog_manager.cc:5697] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.489286 19234 raft_consensus.cc:2468] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:14.498993 19473 raft_consensus.cc:697] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.503127 19473 consensus_queue.cc:237] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.499392 19462 raft_consensus.cc:515] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.505012 19131 catalog_manager.cc:5697] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 1 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.508457 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.505764 19132 catalog_manager.cc:5697] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.509107 19309 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.516117 19309 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.517189 19348 leader_election.cc:304] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.518028 19461 raft_consensus.cc:2804] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.518460 19461 raft_consensus.cc:697] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.507328 19462 leader_election.cc:290] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.508085 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.519232 19461 consensus_queue.cc:237] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.519933 19234 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.526693 19234 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:14.530323 19132 catalog_manager.cc:5697] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 1 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.531944 19131 catalog_manager.cc:5697] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.579510 19309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:49738
I20260709 13:19:14.580026 19309 raft_consensus.cc:606] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.592711 19383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:19:14.593417 19383 raft_consensus.cc:606] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.599174 19383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:19:14.599884 19383 raft_consensus.cc:606] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.605180 19383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:19:14.605851 19383 raft_consensus.cc:606] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:14.618204 19234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
mode: GRACEFUL
new_leader_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:40674
I20260709 13:19:14.618695 19234 raft_consensus.cc:606] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Received request to transfer leadership to TS dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.626845 19383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
mode: GRACEFUL
new_leader_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:19:14.627452 19383 raft_consensus.cc:606] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Received request to transfer leadership to TS dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.632372 19383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "573610e34f184a6bb129a115635a5472"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
mode: GRACEFUL
new_leader_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:34268
I20260709 13:19:14.632839 19383 raft_consensus.cc:606] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Received request to transfer leadership to TS dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.637547 19234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
mode: GRACEFUL
new_leader_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:40674
I20260709 13:19:14.638019 19234 raft_consensus.cc:606] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Received request to transfer leadership to TS 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:14.644716 19461 consensus_queue.cc:1048] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.650954 19462 raft_consensus.cc:993] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: : Instructing follower dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:14.651450 19460 raft_consensus.cc:1081] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Signalling peer dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:14.653082 19307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:14.656102 19460 consensus_queue.cc:1048] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.659376 19307 raft_consensus.cc:493] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.659916 19307 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.666935 19307 raft_consensus.cc:515] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.670727 19307 leader_election.cc:290] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.672079 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.672672 19383 raft_consensus.cc:3055] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.672987 19383 raft_consensus.cc:740] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.673797 19383 consensus_queue.cc:260] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.674883 19383 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.678174 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fda761d40a040739c7b22fe93c99a29" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.678944 19234 raft_consensus.cc:3060] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.682651 19383 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:14.683677 19272 leader_election.cc:304] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.684331 19476 raft_consensus.cc:2804] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:14.684728 19476 raft_consensus.cc:697] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:14.685483 19476 consensus_queue.cc:237] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.685792 19234 raft_consensus.cc:2468] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:14.691440 19132 catalog_manager.cc:5697] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 1 to 2, leader changed from 8ae08b51234945efa1d044e10e39b769 (127.9.68.67) to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.715065 19460 consensus_queue.cc:1048] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.721591 19462 raft_consensus.cc:993] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.722028 19461 raft_consensus.cc:1081] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.723774 19232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40658
I20260709 13:19:14.725257 19232 raft_consensus.cc:493] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.725649 19232 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.728529 19461 consensus_queue.cc:1048] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.733657 19232 raft_consensus.cc:515] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.737326 19232 leader_election.cc:290] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.738667 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.739269 19383 raft_consensus.cc:3055] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.739431 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbc482433c0c43a7a8610404f96e98da" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.739681 19383 raft_consensus.cc:740] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.740097 19307 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.740557 19383 consensus_queue.cc:260] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.741791 19383 raft_consensus.cc:3060] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.745217 19307 raft_consensus.cc:2468] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:14.746243 19199 leader_election.cc:304] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:14.746954 19473 raft_consensus.cc:2804] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:14.747226 19383 raft_consensus.cc:2468] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:14.747373 19473 raft_consensus.cc:697] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.748313 19473 consensus_queue.cc:237] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.755136 19131 catalog_manager.cc:5697] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from 8ae08b51234945efa1d044e10e39b769 (127.9.68.67) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.820363 19461 raft_consensus.cc:493] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.820847 19461 raft_consensus.cc:515] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.822592 19461 leader_election.cc:290] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:14.823432 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:14.823925 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:14.824124 19232 raft_consensus.cc:2393] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:14.825492 19348 leader_election.cc:304] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.826181 19461 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.831156 19461 raft_consensus.cc:2749] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.839205 19461 consensus_queue.cc:1048] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.846515 19462 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.846973 19470 raft_consensus.cc:993] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.847462 19470 raft_consensus.cc:1081] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.849228 19460 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.849540 19234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40658
I20260709 13:19:14.850178 19234 raft_consensus.cc:493] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.850584 19234 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.854737 19461 consensus_queue.cc:1048] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.864733 19234 raft_consensus.cc:515] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.866304 19233 raft_consensus.cc:1240] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Rejecting Update request from peer 8ae08b51234945efa1d044e10e39b769 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:14.868042 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.869740 19461 consensus_queue.cc:1059] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.870476 19234 leader_election.cc:290] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.871418 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c95abb261437c9399f639f98fa4f9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.870491 19460 raft_consensus.cc:3055] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.872818 19460 raft_consensus.cc:740] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.874040 19460 consensus_queue.cc:260] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.875279 19460 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.879606 19470 raft_consensus.cc:993] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.880034 19470 raft_consensus.cc:1081] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.882383 19233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40658
I20260709 13:19:14.883512 19233 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.883895 19233 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.889851 19383 raft_consensus.cc:2468] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:14.888978 19233 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.893450 19476 consensus_queue.cc:1048] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.894472 19233 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.895569 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.896329 19382 raft_consensus.cc:3055] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.896649 19382 raft_consensus.cc:740] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:14.897498 19382 consensus_queue.cc:260] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.898943 19382 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.898974 19197 leader_election.cc:304] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: dbc70ce0a780449ca165da665d801c28
I20260709 13:19:14.900319 19473 raft_consensus.cc:2804] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:14.900820 19473 raft_consensus.cc:697] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.901682 19473 consensus_queue.cc:237] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.897929 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.902649 19307 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.904531 19481 consensus_queue.cc:1048] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.910996 19382 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:14.911795 19429 consensus_queue.cc:1048] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.914364 19197 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:14.917577 19307 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:14.917613 19481 raft_consensus.cc:2804] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:14.921667 19481 raft_consensus.cc:697] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.922497 19481 consensus_queue.cc:237] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.922333 19130 catalog_manager.cc:5697] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from 8ae08b51234945efa1d044e10e39b769 (127.9.68.67) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.931260 19472 consensus_queue.cc:1048] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.938938 19448 consensus_queue.cc:1048] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.939642 19473 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.950045 19473 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:14.954080 19473 raft_consensus.cc:993] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: : Instructing follower 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:14.954478 19473 raft_consensus.cc:1081] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Signalling peer 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:14.955325 19472 consensus_queue.cc:1048] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.958292 19383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:19:14.958920 19383 raft_consensus.cc:493] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.959285 19383 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.960892 19476 raft_consensus.cc:993] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.961328 19472 raft_consensus.cc:1081] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:14.964490 19232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40654
I20260709 13:19:14.965184 19232 raft_consensus.cc:493] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.965691 19232 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.970549 19383 raft_consensus.cc:515] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.974324 19232 raft_consensus.cc:515] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.974318 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.971477 19431 raft_consensus.cc:993] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: : Instructing follower dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:14.975538 19233 raft_consensus.cc:3055] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.975690 19431 raft_consensus.cc:1081] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Signalling peer dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:14.976049 19233 raft_consensus.cc:740] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.977097 19233 consensus_queue.cc:260] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.978274 19307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:49726
I20260709 13:19:14.978590 19233 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.978943 19307 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:14.979440 19307 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.978189 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.983170 19306 raft_consensus.cc:3055] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.983582 19306 raft_consensus.cc:740] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:14.984593 19306 consensus_queue.cc:260] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.985862 19306 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.987468 19234 raft_consensus.cc:1240] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Rejecting Update request from peer dbc70ce0a780449ca165da665d801c28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:14.989511 19307 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.991321 19307 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:14.991922 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:14.992758 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:14.993296 19234 raft_consensus.cc:3055] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.993659 19234 raft_consensus.cc:740] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:14.994506 19234 consensus_queue.cc:260] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:14.995220 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277996d8c6a54315b6fe22b05f5e39a3" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:14.995443 19234 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.995813 19309 raft_consensus.cc:3060] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.995942 19383 leader_election.cc:290] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 2 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:15.002988 19234 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:15.003161 19306 raft_consensus.cc:2468] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:15.003516 19309 raft_consensus.cc:2468] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 2.
I20260709 13:19:15.004979 19348 leader_election.cc:304] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:15.005740 19233 raft_consensus.cc:2468] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 2.
I20260709 13:19:15.005833 19461 raft_consensus.cc:2804] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.006529 19461 raft_consensus.cc:697] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:15.006462 19199 leader_election.cc:304] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:15.007548 19461 consensus_queue.cc:237] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.008486 19274 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:15.009503 19431 raft_consensus.cc:2804] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.010008 19431 raft_consensus.cc:697] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:15.010232 19232 leader_election.cc:290] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:15.010790 19431 consensus_queue.cc:237] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.011736 19459 raft_consensus.cc:2804] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.012250 19459 raft_consensus.cc:697] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:15.013011 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9ce0657a4c43e4b19af73ca6c703a8" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:15.013655 19382 raft_consensus.cc:3060] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.013031 19459 consensus_queue.cc:237] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.017812 19131 catalog_manager.cc:5697] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from 8ae08b51234945efa1d044e10e39b769 (127.9.68.67) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.020671 19382 raft_consensus.cc:2468] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:15.021582 19132 catalog_manager.cc:5697] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 1 to 2, leader changed from 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65) to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.025235 19461 consensus_queue.cc:1048] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:15.037693 19130 catalog_manager.cc:5697] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.038468 19132 catalog_manager.cc:5697] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 1 to 2, leader changed from 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65) to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 2 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.039026 19470 consensus_queue.cc:1048] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:15.049212 19470 raft_consensus.cc:993] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: : Instructing follower dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:15.049670 19470 raft_consensus.cc:1081] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Signalling peer dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:15.051766 19309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "573610e34f184a6bb129a115635a5472"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:49730
I20260709 13:19:15.052294 19309 raft_consensus.cc:493] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:15.052661 19309 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.059057 19309 raft_consensus.cc:515] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.060890 19309 leader_election.cc:290] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:15.062186 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:15.062220 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573610e34f184a6bb129a115635a5472" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:15.062786 19382 raft_consensus.cc:3055] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:15.063108 19234 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.063172 19382 raft_consensus.cc:740] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:15.064234 19382 consensus_queue.cc:260] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.065189 19382 raft_consensus.cc:3060] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.069685 19234 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:15.070670 19382 raft_consensus.cc:2468] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:15.070729 19274 leader_election.cc:304] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:15.071523 19459 raft_consensus.cc:2804] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.071911 19459 raft_consensus.cc:697] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:15.072643 19459 consensus_queue.cc:237] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:15.078313 19130 catalog_manager.cc:5697] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 1 to 2, leader changed from 8ae08b51234945efa1d044e10e39b769 (127.9.68.67) to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.099717 19234 raft_consensus.cc:1275] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.100921 19459 consensus_queue.cc:1048] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.108333 19382 raft_consensus.cc:1275] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.109688 19429 consensus_queue.cc:1048] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.179802 19382 raft_consensus.cc:1275] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.180965 19431 consensus_queue.cc:1048] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.188320 19309 raft_consensus.cc:1275] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.190022 19431 consensus_queue.cc:1048] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.306298 19309 raft_consensus.cc:3060] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.311200 19309 raft_consensus.cc:1275] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.312319 19431 consensus_queue.cc:1048] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.321627 19382 raft_consensus.cc:1275] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.323383 19481 consensus_queue.cc:1048] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.332803 19382 raft_consensus.cc:1275] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.334134 19481 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.344036 19309 raft_consensus.cc:1275] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.345289 19431 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.406008 19382 raft_consensus.cc:1275] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.407248 19431 consensus_queue.cc:1048] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.416571 19309 raft_consensus.cc:1275] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.418660 19431 consensus_queue.cc:1048] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.537508 19382 raft_consensus.cc:1275] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.537740 19383 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.539222 19429 consensus_queue.cc:1048] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.544528 19383 raft_consensus.cc:1275] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.545964 19429 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:15.548382 19234 raft_consensus.cc:1275] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.551088 19429 consensus_queue.cc:1048] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.557972 19232 raft_consensus.cc:1275] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.559914 19429 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.567459 19309 raft_consensus.cc:1275] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.568660 19461 consensus_queue.cc:1048] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:15.572234 19232 raft_consensus.cc:1275] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.573764 19461 consensus_queue.cc:1048] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.676471 19131 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48690:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:17.679738 19131 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:17.737624 19217 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5b10db3974b0f838c271dbf55022f (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:17.739177 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5b10db3974b0f838c271dbf55022f (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:17.739604 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5b10db3974b0f838c271dbf55022f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.740911 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5b10db3974b0f838c271dbf55022f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.747452 19222 tablet_service.cc:1511] Processing CreateTablet for tablet 00b2dc74db7c4ce185cce35c3b5ef86e (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:17.748966 19222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b2dc74db7c4ce185cce35c3b5ef86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.749400 19295 tablet_service.cc:1511] Processing CreateTablet for tablet 00b2dc74db7c4ce185cce35c3b5ef86e (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:17.750779 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b2dc74db7c4ce185cce35c3b5ef86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.740746 19371 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5b10db3974b0f838c271dbf55022f (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:17.743233 19218 tablet_service.cc:1511] Processing CreateTablet for tablet b6e67ceef5b54352b377cd42cb199b2b (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:17.751822 19368 tablet_service.cc:1511] Processing CreateTablet for tablet 00b2dc74db7c4ce185cce35c3b5ef86e (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:17.753549 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e67ceef5b54352b377cd42cb199b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.753672 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5b10db3974b0f838c271dbf55022f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.754551 19368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b2dc74db7c4ce185cce35c3b5ef86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.745115 19373 tablet_service.cc:1511] Processing CreateTablet for tablet b6e67ceef5b54352b377cd42cb199b2b (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:17.758272 19373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e67ceef5b54352b377cd42cb199b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.746695 19296 tablet_service.cc:1511] Processing CreateTablet for tablet b6e67ceef5b54352b377cd42cb199b2b (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:17.762494 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e67ceef5b54352b377cd42cb199b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.766517 19220 tablet_service.cc:1511] Processing CreateTablet for tablet ac1b8af44ba2443a9b6e042da3be38a3 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:17.768211 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1b8af44ba2443a9b6e042da3be38a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.784704 19294 tablet_service.cc:1511] Processing CreateTablet for tablet ac1b8af44ba2443a9b6e042da3be38a3 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:17.786157 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1b8af44ba2443a9b6e042da3be38a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.788491 19367 tablet_service.cc:1511] Processing CreateTablet for tablet ac1b8af44ba2443a9b6e042da3be38a3 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:17.789371 19219 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0a033232924cbda1452db8eb7af2c9 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:17.790009 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac1b8af44ba2443a9b6e042da3be38a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.790771 19219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0a033232924cbda1452db8eb7af2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.807631 19299 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0a033232924cbda1452db8eb7af2c9 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:17.809058 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0a033232924cbda1452db8eb7af2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.809448 19370 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0a033232924cbda1452db8eb7af2c9 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:17.810806 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0a033232924cbda1452db8eb7af2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.813937 19221 tablet_service.cc:1511] Processing CreateTablet for tablet da8212c78ea0494699dac84d10a159b2 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:17.815289 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8212c78ea0494699dac84d10a159b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.819684 19298 tablet_service.cc:1511] Processing CreateTablet for tablet da8212c78ea0494699dac84d10a159b2 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:17.820987 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8212c78ea0494699dac84d10a159b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.822520 19372 tablet_service.cc:1511] Processing CreateTablet for tablet da8212c78ea0494699dac84d10a159b2 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:17.823863 19372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8212c78ea0494699dac84d10a159b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.829273 19224 tablet_service.cc:1511] Processing CreateTablet for tablet b80ffa2003a049d8901fdf757fddbaca (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:17.830947 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ffa2003a049d8901fdf757fddbaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.831321 19291 tablet_service.cc:1511] Processing CreateTablet for tablet b80ffa2003a049d8901fdf757fddbaca (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:17.832705 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ffa2003a049d8901fdf757fddbaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.836000 19369 tablet_service.cc:1511] Processing CreateTablet for tablet b80ffa2003a049d8901fdf757fddbaca (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:17.856009 19369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80ffa2003a049d8901fdf757fddbaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.859027 19219 tablet_service.cc:1511] Processing CreateTablet for tablet edd2620b5516408e93cba32aab1b3368 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:17.861960 19219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2620b5516408e93cba32aab1b3368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.862895 19525 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:17.862553 19293 tablet_service.cc:1511] Processing CreateTablet for tablet edd2620b5516408e93cba32aab1b3368 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:17.864053 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2620b5516408e93cba32aab1b3368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.890618 19373 tablet_service.cc:1511] Processing CreateTablet for tablet edd2620b5516408e93cba32aab1b3368 (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:17.891960 19373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2620b5516408e93cba32aab1b3368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.900316 19525 tablet_bootstrap.cc:654] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.900132 19217 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:17.910210 19371 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:17.910447 19217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.911433 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.906682 19296 tablet_service.cc:1511] Processing CreateTablet for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c (DEFAULT_TABLE table=soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:17.947049 19526 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:17.967785 19526 tablet_bootstrap.cc:654] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.973868 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2e9ed4bf6a4bfda492e11249ff1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:17.980232 19525 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:17.980764 19525 ts_tablet_manager.cc:1403] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.014s
I20260709 13:19:17.983501 19527 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:17.984057 19525 raft_consensus.cc:359] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:17.985023 19525 raft_consensus.cc:385] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.988816 19525 raft_consensus.cc:740] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.989648 19525 consensus_queue.cc:260] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:17.991101 19527 tablet_bootstrap.cc:654] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.991228 19526 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:17.991761 19526 ts_tablet_manager.cc:1403] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.000s
I20260709 13:19:17.994577 19526 raft_consensus.cc:359] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:17.995273 19526 raft_consensus.cc:385] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.995558 19526 raft_consensus.cc:740] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.995641 19525 ts_tablet_manager.cc:1434] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:19:17.996419 19526 consensus_queue.cc:260] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:17.997036 19525 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:17.999037 19526 ts_tablet_manager.cc:1434] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:18.000180 19526 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.006528 19526 tablet_bootstrap.cc:654] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.006776 19525 tablet_bootstrap.cc:654] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.011960 19429 raft_consensus.cc:493] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.012588 19429 raft_consensus.cc:515] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.015364 19429 leader_election.cc:290] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.019131 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.020335 19234 raft_consensus.cc:2468] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.024405 19274 leader_election.cc:304] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.025883 19525 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.026636 19525 ts_tablet_manager.cc:1403] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.000s
I20260709 13:19:18.027781 19533 raft_consensus.cc:2804] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.028260 19533 raft_consensus.cc:493] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.028559 19533 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.031463 19525 raft_consensus.cc:359] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.033052 19525 raft_consensus.cc:385] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.033737 19525 raft_consensus.cc:740] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.032938 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.034972 19525 consensus_queue.cc:260] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.038758 19525 ts_tablet_manager.cc:1434] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:19:18.040488 19525 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.042318 19526 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.042829 19526 ts_tablet_manager.cc:1403] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 13:19:18.049764 19525 tablet_bootstrap.cc:654] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.050930 19533 raft_consensus.cc:515] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.055013 19526 raft_consensus.cc:359] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.055763 19526 raft_consensus.cc:385] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.056041 19526 raft_consensus.cc:740] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.056718 19526 consensus_queue.cc:260] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.062671 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.063339 19232 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.053061 19533 leader_election.cc:290] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.067811 19525 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.068555 19525 ts_tablet_manager.cc:1403] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.011s
I20260709 13:19:18.065289 19526 ts_tablet_manager.cc:1434] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:19:18.069936 19526 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.072930 19525 raft_consensus.cc:359] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.073977 19525 raft_consensus.cc:385] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.074635 19525 raft_consensus.cc:740] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.076046 19525 consensus_queue.cc:260] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.080508 19525 ts_tablet_manager.cc:1434] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:19:18.081875 19525 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.076417 19526 tablet_bootstrap.cc:654] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.090502 19525 tablet_bootstrap.cc:654] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.101984 19526 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.102458 19526 ts_tablet_manager.cc:1403] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:19:18.104615 19525 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.105336 19525 ts_tablet_manager.cc:1403] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:19:18.109443 19525 raft_consensus.cc:359] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.110383 19525 raft_consensus.cc:385] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.105513 19526 raft_consensus.cc:359] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.110849 19525 raft_consensus.cc:740] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.111893 19525 consensus_queue.cc:260] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.111038 19526 raft_consensus.cc:385] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.113570 19526 raft_consensus.cc:740] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.114542 19526 consensus_queue.cc:260] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.117497 19526 ts_tablet_manager.cc:1434] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:19:18.118294 19533 raft_consensus.cc:493] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.119028 19533 raft_consensus.cc:515] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.119696 19525 ts_tablet_manager.cc:1434] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:19:18.121110 19525 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.122234 19533 leader_election.cc:290] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.124416 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.125303 19234 raft_consensus.cc:2468] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.127511 19274 leader_election.cc:304] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.129941 19525 tablet_bootstrap.cc:654] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.135252 19533 raft_consensus.cc:2804] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.136446 19533 raft_consensus.cc:493] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.137463 19533 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.142321 19526 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.144137 19525 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.151345 19525 ts_tablet_manager.cc:1403] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.008s
I20260709 13:19:18.155424 19526 tablet_bootstrap.cc:654] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:18.156780 19272 leader_election.cc:343] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.159293 19525 raft_consensus.cc:359] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.160223 19525 raft_consensus.cc:385] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.160504 19525 raft_consensus.cc:740] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.161276 19525 consensus_queue.cc:260] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.162277 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.163038 19525 ts_tablet_manager.cc:1434] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:18.163064 19232 raft_consensus.cc:2468] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.164324 19525 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.166612 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.172084 19274 leader_election.cc:304] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.172540 19525 tablet_bootstrap.cc:654] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.174520 19534 raft_consensus.cc:2804] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.175135 19534 raft_consensus.cc:697] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.168738 19533 raft_consensus.cc:515] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.176309 19534 consensus_queue.cc:237] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
W20260709 13:19:18.177559 19180 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:18.174944 19272 leader_election.cc:343] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.178624 19533 leader_election.cc:290] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
W20260709 13:19:18.179785 19272 leader_election.cc:343] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.173566 19527 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.182570 19527 ts_tablet_manager.cc:1403] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.199s	user 0.078s	sys 0.098s
I20260709 13:19:18.183449 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.184072 19232 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.185488 19525 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.185972 19525 ts_tablet_manager.cc:1403] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:19:18.186558 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.188941 19525 raft_consensus.cc:359] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.189721 19525 raft_consensus.cc:385] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.190013 19525 raft_consensus.cc:740] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
W20260709 13:19:18.190441 19272 leader_election.cc:343] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.195370 19526 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.195907 19526 ts_tablet_manager.cc:1403] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.015s
I20260709 13:19:18.190776 19525 consensus_queue.cc:260] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.192006 19527 raft_consensus.cc:359] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.198781 19527 raft_consensus.cc:385] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.199147 19527 raft_consensus.cc:740] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.198794 19526 raft_consensus.cc:359] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.199843 19526 raft_consensus.cc:385] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.200184 19526 raft_consensus.cc:740] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.200505 19525 ts_tablet_manager.cc:1434] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:19:18.200089 19527 consensus_queue.cc:260] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.201586 19525 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.201236 19526 consensus_queue.cc:260] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.204438 19526 ts_tablet_manager.cc:1434] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:18.205462 19526 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.205729 19527 ts_tablet_manager.cc:1434] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:19:18.206794 19527 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.198362 19232 raft_consensus.cc:2468] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.210878 19274 leader_election.cc:304] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.212301 19526 tablet_bootstrap.cc:654] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.212311 19533 raft_consensus.cc:2804] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.213070 19533 raft_consensus.cc:697] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.213485 19525 tablet_bootstrap.cc:654] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.214063 19533 consensus_queue.cc:237] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.227025 19527 tablet_bootstrap.cc:654] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.228107 19131 catalog_manager.cc:5697] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.233726 19526 tablet_bootstrap.cc:492] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.234354 19526 ts_tablet_manager.cc:1403] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:19:18.236634 19525 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.237149 19525 ts_tablet_manager.cc:1403] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.012s
I20260709 13:19:18.238093 19526 raft_consensus.cc:359] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.238886 19526 raft_consensus.cc:385] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.239235 19526 raft_consensus.cc:740] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.240221 19526 consensus_queue.cc:260] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.240468 19525 raft_consensus.cc:359] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.241197 19525 raft_consensus.cc:385] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.241806 19525 raft_consensus.cc:740] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.242319 19526 ts_tablet_manager.cc:1434] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:18.243535 19526 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.242550 19525 consensus_queue.cc:260] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.245496 19527 tablet_bootstrap.cc:492] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.246084 19527 ts_tablet_manager.cc:1403] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.002s
I20260709 13:19:18.248966 19525 ts_tablet_manager.cc:1434] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:18.249979 19525 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.249881 19527 raft_consensus.cc:359] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.251036 19527 raft_consensus.cc:385] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.251482 19527 raft_consensus.cc:740] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.252431 19527 consensus_queue.cc:260] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.255227 19527 ts_tablet_manager.cc:1434] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:19:18.256155 19527 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.253383 19526 tablet_bootstrap.cc:654] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.259527 19525 tablet_bootstrap.cc:654] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.263751 19527 tablet_bootstrap.cc:654] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.276598 19525 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.277194 19525 ts_tablet_manager.cc:1403] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.013s
I20260709 13:19:18.280639 19525 raft_consensus.cc:359] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.281280 19525 raft_consensus.cc:385] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.281567 19525 raft_consensus.cc:740] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.281697 19526 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.282277 19525 consensus_queue.cc:260] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.282779 19526 ts_tablet_manager.cc:1403] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.014s
I20260709 13:19:18.284168 19527 tablet_bootstrap.cc:492] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.284330 19525 ts_tablet_manager.cc:1434] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:18.284775 19527 ts_tablet_manager.cc:1403] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.009s
I20260709 13:19:18.285852 19526 raft_consensus.cc:359] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.286623 19526 raft_consensus.cc:385] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.286726 19525 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: Bootstrap starting.
I20260709 13:19:18.286968 19526 raft_consensus.cc:740] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.288859 19526 consensus_queue.cc:260] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.288553 19527 raft_consensus.cc:359] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.291208 19527 raft_consensus.cc:385] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.291534 19527 raft_consensus.cc:740] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.292233 19534 raft_consensus.cc:493] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.292356 19527 consensus_queue.cc:260] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.292982 19534 raft_consensus.cc:515] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.291843 19526 ts_tablet_manager.cc:1434] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:19:18.296017 19525 tablet_bootstrap.cc:654] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.296447 19526 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.299427 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.300163 19232 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.301262 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.302008 19381 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.303555 19274 leader_election.cc:304] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.303906 19526 tablet_bootstrap.cc:654] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.304448 19533 raft_consensus.cc:2804] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.304837 19533 raft_consensus.cc:493] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.305203 19533 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.306335 19527 ts_tablet_manager.cc:1434] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:19:18.307423 19527 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.297089 19534 leader_election.cc:290] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.313839 19527 tablet_bootstrap.cc:654] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.316285 19533 raft_consensus.cc:515] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.293717 19131 catalog_manager.cc:5697] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.320544 19525 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: No bootstrap required, opened a new log
I20260709 13:19:18.321171 19525 ts_tablet_manager.cc:1403] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.006s
I20260709 13:19:18.324765 19525 raft_consensus.cc:359] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.325713 19525 raft_consensus.cc:385] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.326404 19525 raft_consensus.cc:740] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.327057 19525 consensus_queue.cc:260] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.329025 19525 ts_tablet_manager.cc:1434] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:18.334946 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.335314 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.335794 19381 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.335907 19232 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.345491 19533 leader_election.cc:290] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.347541 19381 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.345048 19232 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.349056 19274 leader_election.cc:304] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.350302 19533 raft_consensus.cc:2804] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.351512 19533 raft_consensus.cc:697] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.352488 19533 consensus_queue.cc:237] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.354072 19512 raft_consensus.cc:493] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.354568 19512 raft_consensus.cc:515] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.355715 19526 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.356264 19526 ts_tablet_manager.cc:1403] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.060s	user 0.035s	sys 0.015s
I20260709 13:19:18.356753 19514 raft_consensus.cc:493] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.356945 19512 leader_election.cc:290] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.357270 19514 raft_consensus.cc:515] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.359112 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.359295 19526 raft_consensus.cc:359] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.360073 19526 raft_consensus.cc:385] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.359309 19514 leader_election.cc:290] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.360603 19526 raft_consensus.cc:740] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.360771 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.361430 19526 consensus_queue.cc:260] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
W20260709 13:19:18.362695 19199 leader_election.cc:343] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.363284 19527 tablet_bootstrap.cc:492] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.363790 19527 ts_tablet_manager.cc:1403] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.011s
I20260709 13:19:18.363817 19526 ts_tablet_manager.cc:1434] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:18.364203 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.364992 19526 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
W20260709 13:19:18.365926 19197 leader_election.cc:343] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.366534 19197 leader_election.cc:304] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.366989 19527 raft_consensus.cc:359] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.367754 19527 raft_consensus.cc:385] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.367964 19514 raft_consensus.cc:2749] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.368947 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.359964 19306 raft_consensus.cc:2468] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:18.368062 19527 raft_consensus.cc:740] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.370607 19527 consensus_queue.cc:260] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
W20260709 13:19:18.371146 19197 leader_election.cc:343] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.371817 19526 tablet_bootstrap.cc:654] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.372283 19199 leader_election.cc:304] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.372927 19527 ts_tablet_manager.cc:1434] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:18.373971 19527 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.373999 19514 raft_consensus.cc:2804] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.374501 19514 raft_consensus.cc:493] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.374816 19514 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.382174 19514 raft_consensus.cc:515] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.383858 19527 tablet_bootstrap.cc:654] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.384640 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:18.385183 19306 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.399511 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
W20260709 13:19:18.400878 19197 leader_election.cc:343] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.401506 19526 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.402137 19526 ts_tablet_manager.cc:1403] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.019s
I20260709 13:19:18.401718 19131 catalog_manager.cc:5697] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.403028 19306 raft_consensus.cc:2468] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 1.
I20260709 13:19:18.404119 19199 leader_election.cc:304] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.404965 19512 raft_consensus.cc:2804] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.405689 19526 raft_consensus.cc:359] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.406605 19526 raft_consensus.cc:385] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.406920 19526 raft_consensus.cc:740] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.407791 19526 consensus_queue.cc:260] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.410482 19526 ts_tablet_manager.cc:1434] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:18.411135 19514 leader_election.cc:290] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.411607 19526 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: Bootstrap starting.
I20260709 13:19:18.419497 19512 raft_consensus.cc:697] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:18.419792 19526 tablet_bootstrap.cc:654] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.420413 19512 consensus_queue.cc:237] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.434123 19533 raft_consensus.cc:493] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.435107 19533 raft_consensus.cc:515] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.437757 19130 catalog_manager.cc:5697] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 1 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.438710 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.439519 19232 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.441144 19274 leader_election.cc:304] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.442335 19534 raft_consensus.cc:2804] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.442735 19534 raft_consensus.cc:493] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.443054 19534 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.444340 19527 tablet_bootstrap.cc:492] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.444998 19527 ts_tablet_manager.cc:1403] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.027s
I20260709 13:19:18.454767 19429 raft_consensus.cc:493] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.455425 19533 leader_election.cc:290] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.455472 19429 raft_consensus.cc:515] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.456432 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.457123 19381 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.457240 19527 raft_consensus.cc:359] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.458029 19527 raft_consensus.cc:385] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.459319 19527 raft_consensus.cc:740] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.459815 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.460089 19527 consensus_queue.cc:260] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.460995 19526 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: No bootstrap required, opened a new log
I20260709 13:19:18.461560 19526 ts_tablet_manager.cc:1403] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.019s
I20260709 13:19:18.462778 19527 ts_tablet_manager.cc:1434] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:18.463792 19527 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.463960 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.464640 19232 raft_consensus.cc:2468] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.464825 19526 raft_consensus.cc:359] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.465591 19526 raft_consensus.cc:385] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.465868 19526 raft_consensus.cc:740] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.466538 19526 consensus_queue.cc:260] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.465883 19274 leader_election.cc:304] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.468685 19526 ts_tablet_manager.cc:1434] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:18.469287 19533 raft_consensus.cc:2804] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.458464 19429 leader_election.cc:290] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.469699 19533 raft_consensus.cc:493] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.470156 19533 raft_consensus.cc:3060] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.471038 19527 tablet_bootstrap.cc:654] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.472854 19511 raft_consensus.cc:493] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.473361 19511 raft_consensus.cc:515] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.475998 19511 leader_election.cc:290] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.454809 19534 raft_consensus.cc:515] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.478956 19534 leader_election.cc:290] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.479576 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.478958 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.480204 19380 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.480862 19381 raft_consensus.cc:2468] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.481925 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.485740 19232 raft_consensus.cc:2468] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:18.484869 19533 raft_consensus.cc:515] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.488310 19533 leader_election.cc:290] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.488947 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.489326 19306 raft_consensus.cc:2393] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:18.489643 19348 leader_election.cc:304] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:18.490511 19511 raft_consensus.cc:2804] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.490923 19511 raft_consensus.cc:493] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.491230 19511 raft_consensus.cc:3060] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.493875 19380 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.495098 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.495669 19232 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.495554 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.496234 19234 raft_consensus.cc:3060] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.497500 19527 tablet_bootstrap.cc:492] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.497995 19527 ts_tablet_manager.cc:1403] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.017s
I20260709 13:19:18.500851 19533 raft_consensus.cc:493] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.501297 19533 raft_consensus.cc:515] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.502538 19232 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.503232 19533 leader_election.cc:290] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.504664 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.499467 19511 raft_consensus.cc:515] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.505213 19274 leader_election.cc:304] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
W20260709 13:19:18.505918 19272 leader_election.cc:343] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.506570 19533 raft_consensus.cc:2804] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.507085 19533 raft_consensus.cc:697] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.507686 19234 raft_consensus.cc:2468] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.507905 19533 consensus_queue.cc:237] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.508186 19527 raft_consensus.cc:359] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.508666 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.508881 19527 raft_consensus.cc:385] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.508949 19274 leader_election.cc:304] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.510007 19534 raft_consensus.cc:2804] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.509287 19527 raft_consensus.cc:740] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.510578 19534 raft_consensus.cc:697] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.510852 19511 leader_election.cc:290] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.511030 19527 consensus_queue.cc:260] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.511442 19534 consensus_queue.cc:237] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.512177 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:18.513607 19527 ts_tablet_manager.cc:1434] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:19:18.514621 19527 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.515533 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8212c78ea0494699dac84d10a159b2" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.516268 19234 raft_consensus.cc:2393] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:18.509379 19232 raft_consensus.cc:2468] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
I20260709 13:19:18.517246 19348 leader_election.cc:304] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.518401 19274 leader_election.cc:304] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.518919 19511 raft_consensus.cc:2749] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.519860 19429 raft_consensus.cc:2804] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.520300 19429 raft_consensus.cc:493] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.520658 19429 raft_consensus.cc:3060] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.522418 19534 raft_consensus.cc:493] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.522881 19534 raft_consensus.cc:515] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.524603 19527 tablet_bootstrap.cc:654] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.524866 19534 leader_election.cc:290] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.528952 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.529897 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.531944 19234 raft_consensus.cc:2468] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 0.
W20260709 13:19:18.532927 19272 leader_election.cc:343] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.533427 19429 raft_consensus.cc:515] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.535501 19429 leader_election.cc:290] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.540119 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.540652 19234 raft_consensus.cc:3060] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.541540 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
W20260709 13:19:18.543048 19272 leader_election.cc:343] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.544051 19274 leader_election.cc:304] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.544947 19533 raft_consensus.cc:2804] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.545467 19533 raft_consensus.cc:493] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.545879 19533 raft_consensus.cc:3060] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.547394 19234 raft_consensus.cc:2468] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.551061 19274 leader_election.cc:304] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.551864 19534 raft_consensus.cc:2804] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.552338 19534 raft_consensus.cc:697] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.549141 19131 catalog_manager.cc:5697] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.553150 19534 consensus_queue.cc:237] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.553401 19131 catalog_manager.cc:5697] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.554827 19533 raft_consensus.cc:515] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.555764 19527 tablet_bootstrap.cc:492] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.556298 19527 ts_tablet_manager.cc:1403] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.014s
I20260709 13:19:18.557679 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.558164 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
W20260709 13:19:18.559485 19272 leader_election.cc:343] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.558331 19234 raft_consensus.cc:3060] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.559573 19527 raft_consensus.cc:359] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.560627 19527 raft_consensus.cc:385] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.560992 19527 raft_consensus.cc:740] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.561829 19527 consensus_queue.cc:260] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.564865 19527 ts_tablet_manager.cc:1434] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:19:18.565914 19527 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.566438 19533 leader_election.cc:290] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.570730 19234 raft_consensus.cc:2468] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 1.
I20260709 13:19:18.571882 19274 leader_election.cc:304] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:18.572899 19429 raft_consensus.cc:2804] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.572954 19527 tablet_bootstrap.cc:654] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.573498 19429 raft_consensus.cc:697] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:18.574316 19429 consensus_queue.cc:237] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.586622 19527 tablet_bootstrap.cc:492] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.587026 19527 ts_tablet_manager.cc:1403] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:19:18.588948 19527 raft_consensus.cc:359] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.588897 19130 catalog_manager.cc:5697] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.589586 19527 raft_consensus.cc:385] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.589915 19527 raft_consensus.cc:740] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.590435 19527 consensus_queue.cc:260] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.590313 19130 catalog_manager.cc:5697] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 1 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.591962 19527 ts_tablet_manager.cc:1434] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:18.592983 19527 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: Bootstrap starting.
I20260709 13:19:18.598155 19527 tablet_bootstrap.cc:654] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.603021 19527 tablet_bootstrap.cc:492] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: No bootstrap required, opened a new log
I20260709 13:19:18.603461 19527 ts_tablet_manager.cc:1403] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:19:18.605966 19527 raft_consensus.cc:359] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.606391 19527 raft_consensus.cc:385] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.606551 19527 raft_consensus.cc:740] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.606971 19527 consensus_queue.cc:260] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.608560 19527 ts_tablet_manager.cc:1434] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:19:18.611907 19429 consensus_queue.cc:1048] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.617025 19565 raft_consensus.cc:493] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.617543 19565 raft_consensus.cc:515] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.619602 19565 leader_election.cc:290] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.621663 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.622460 19306 raft_consensus.cc:2393] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in this term.
I20260709 13:19:18.623466 19380 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.623981 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.625747 19565 raft_consensus.cc:493] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.626219 19565 raft_consensus.cc:515] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.629016 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.629858 19233 raft_consensus.cc:2393] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:18.630123 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.629609 19348 leader_election.cc:304] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.630934 19511 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.631605 19348 leader_election.cc:304] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.629038 19565 leader_election.cc:290] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.633890 19534 consensus_queue.cc:1048] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.634346 19565 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.637907 19511 raft_consensus.cc:2749] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.642788 19565 raft_consensus.cc:2749] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.674824 19574 raft_consensus.cc:493] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.675252 19574 raft_consensus.cc:515] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.676196 19512 raft_consensus.cc:493] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.676681 19512 raft_consensus.cc:515] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.677033 19574 leader_election.cc:290] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.677827 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.678284 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.678473 19232 raft_consensus.cc:2468] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:18.678793 19512 leader_election.cc:290] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.678928 19306 raft_consensus.cc:2468] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 0.
I20260709 13:19:18.679965 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.679757 19348 leader_election.cc:304] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:18.680678 19309 raft_consensus.cc:2468] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 0.
I20260709 13:19:18.680886 19574 raft_consensus.cc:2804] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.681265 19574 raft_consensus.cc:493] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.681615 19574 raft_consensus.cc:3060] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.681759 19199 leader_election.cc:304] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:18.682133 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769" is_pre_election: true
I20260709 13:19:18.682899 19512 raft_consensus.cc:2804] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.683283 19512 raft_consensus.cc:493] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.683563 19512 raft_consensus.cc:3060] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.687460 19574 raft_consensus.cc:515] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.688426 19380 raft_consensus.cc:2393] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:18.688508 19512 raft_consensus.cc:515] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.689404 19574 leader_election.cc:290] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.690136 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.690876 19232 raft_consensus.cc:2393] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in this term.
I20260709 13:19:18.691089 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:18.691207 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:18.691699 19309 raft_consensus.cc:3060] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.691816 19512 leader_election.cc:290] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.691998 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f2e9ed4bf6a4bfda492e11249ff1c3c" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.692771 19380 raft_consensus.cc:2393] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ebe4ab7532476c99d7b42c3ad9a53a in current term 1: Already voted for candidate 8ae08b51234945efa1d044e10e39b769 in this term.
I20260709 13:19:18.693655 19197 leader_election.cc:304] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.694624 19512 raft_consensus.cc:2749] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.697278 19309 raft_consensus.cc:2468] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 1.
I20260709 13:19:18.698554 19348 leader_election.cc:304] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:18.699304 19574 raft_consensus.cc:2804] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.699734 19574 raft_consensus.cc:697] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:18.700414 19574 consensus_queue.cc:237] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.707873 19130 catalog_manager.cc:5697] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 1 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.743654 19534 consensus_queue.cc:1048] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.756153 19579 consensus_queue.cc:1048] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:18.806337 19533 consensus_queue.cc:1048] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.807214 19579 consensus_queue.cc:1048] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.904865 19574 raft_consensus.cc:493] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.905398 19574 raft_consensus.cc:515] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.907051 19574 leader_election.cc:290] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.908200 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.908166 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80ffa2003a049d8901fdf757fddbaca" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.909310 19232 raft_consensus.cc:2393] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:18.910483 19348 leader_election.cc:304] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.911216 19574 raft_consensus.cc:3060] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.916567 19309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:49738
I20260709 13:19:18.917275 19309 raft_consensus.cc:606] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:18.918004 19574 raft_consensus.cc:2749] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.922847 19309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:49738
I20260709 13:19:18.923472 19309 raft_consensus.cc:606] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:18.925163 19574 raft_consensus.cc:493] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.925733 19574 raft_consensus.cc:515] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.927700 19574 leader_election.cc:290] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:18.928865 19233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" is_pre_election: true
I20260709 13:19:18.929265 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2620b5516408e93cba32aab1b3368" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbc70ce0a780449ca165da665d801c28" is_pre_election: true
I20260709 13:19:18.929734 19233 raft_consensus.cc:2393] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ae08b51234945efa1d044e10e39b769 in current term 1: Already voted for candidate dbc70ce0a780449ca165da665d801c28 in this term.
I20260709 13:19:18.929608 19306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:49738
I20260709 13:19:18.930315 19306 raft_consensus.cc:606] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:18.932137 19348 leader_election.cc:304] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769; no voters: 99ebe4ab7532476c99d7b42c3ad9a53a, dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.932200 19533 consensus_queue.cc:1048] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.933029 19574 raft_consensus.cc:3060] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.935734 19309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:49738
I20260709 13:19:18.936317 19309 raft_consensus.cc:606] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Received request to transfer leadership to TS 99ebe4ab7532476c99d7b42c3ad9a53a
I20260709 13:19:18.937237 19559 consensus_queue.cc:1048] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.940439 19574 raft_consensus.cc:2749] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.944703 19232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
mode: GRACEFUL
new_leader_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:40674
I20260709 13:19:18.945366 19232 raft_consensus.cc:606] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Received request to transfer leadership to TS dbc70ce0a780449ca165da665d801c28
I20260709 13:19:18.950958 19534 consensus_queue.cc:1048] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.952617 19559 raft_consensus.cc:993] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: : Instructing follower dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:18.953097 19512 raft_consensus.cc:1081] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Signalling peer dbc70ce0a780449ca165da665d801c28 to start an election
I20260709 13:19:18.954806 19306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
 from {username='slave'} at 127.0.0.1:49726
I20260709 13:19:18.956949 19306 raft_consensus.cc:493] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:18.958112 19306 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.962406 19512 consensus_queue.cc:1048] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.971666 19429 consensus_queue.cc:1048] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.981280 19534 consensus_queue.cc:1048] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:18.989104 19306 raft_consensus.cc:515] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:18.993697 19309 raft_consensus.cc:1240] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Rejecting Update request from peer 99ebe4ab7532476c99d7b42c3ad9a53a for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:18.994840 19306 leader_election.cc:290] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:18.996073 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:18.996722 19232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0a033232924cbda1452db8eb7af2c9" candidate_uuid: "dbc70ce0a780449ca165da665d801c28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:18.996742 19383 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.997394 19232 raft_consensus.cc:3055] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:18.997573 19512 consensus_queue.cc:1059] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:18.998216 19232 raft_consensus.cc:740] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:18.999224 19232 consensus_queue.cc:260] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.000849 19232 raft_consensus.cc:3060] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.005004 19534 raft_consensus.cc:993] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.005573 19534 raft_consensus.cc:1081] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.007438 19234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40654
I20260709 13:19:19.007925 19234 raft_consensus.cc:493] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.008273 19234 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.009971 19383 raft_consensus.cc:2468] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
I20260709 13:19:19.011524 19272 leader_election.cc:304] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:19.014385 19234 raft_consensus.cc:515] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.014761 19579 raft_consensus.cc:2804] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.015260 19579 raft_consensus.cc:697] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Becoming Leader. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:19.016079 19579 consensus_queue.cc:237] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.016950 19232 raft_consensus.cc:2468] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbc70ce0a780449ca165da665d801c28 in term 2.
W20260709 13:19:19.017520 19559 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:19:19.017590 19234 leader_election.cc:290] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:19.018352 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:19.018630 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b2dc74db7c4ce185cce35c3b5ef86e" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:19.019003 19381 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.019292 19309 raft_consensus.cc:3055] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.019692 19309 raft_consensus.cc:740] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:19.020511 19309 consensus_queue.cc:260] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.021545 19309 raft_consensus.cc:3060] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.026234 19381 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.027688 19197 leader_election.cc:304] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:19.028537 19512 raft_consensus.cc:2804] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.029711 19309 raft_consensus.cc:2468] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.035692 19383 raft_consensus.cc:1240] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Rejecting Update request from peer dbc70ce0a780449ca165da665d801c28 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:19.038187 19429 consensus_queue.cc:1048] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.040333 19512 raft_consensus.cc:697] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:19.041412 19512 consensus_queue.cc:237] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.044091 19129 catalog_manager.cc:5697] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 reported cstate change: term changed from 1 to 2, leader changed from 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65) to dbc70ce0a780449ca165da665d801c28 (127.9.68.66). New cstate: current_term: 2 leader_uuid: "dbc70ce0a780449ca165da665d801c28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.051782 19579 consensus_queue.cc:1048] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.054190 19131 catalog_manager.cc:5697] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.086809 19579 consensus_queue.cc:1048] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.097572 19429 consensus_queue.cc:1048] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.100682 19574 consensus_queue.cc:1048] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.114921 19574 consensus_queue.cc:1048] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.134346 19429 raft_consensus.cc:993] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.134797 19579 raft_consensus.cc:1081] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.136457 19232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40654
I20260709 13:19:19.136981 19232 raft_consensus.cc:493] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.137401 19232 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.144114 19232 raft_consensus.cc:515] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.145565 19232 leader_election.cc:290] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:19.146340 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:19.146656 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b5b10db3974b0f838c271dbf55022f" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:19.147112 19309 raft_consensus.cc:3055] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.147502 19309 raft_consensus.cc:740] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:19.148141 19383 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.148293 19309 consensus_queue.cc:260] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.149721 19309 raft_consensus.cc:3060] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.154359 19383 raft_consensus.cc:2468] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.155558 19197 leader_election.cc:304] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:19.156373 19512 raft_consensus.cc:2804] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.156452 19309 raft_consensus.cc:2468] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.156891 19512 raft_consensus.cc:697] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:19.157747 19512 consensus_queue.cc:237] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.163617 19129 catalog_manager.cc:5697] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.201412 19429 raft_consensus.cc:993] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.201843 19579 raft_consensus.cc:1081] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.203644 19232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40654
I20260709 13:19:19.204191 19232 raft_consensus.cc:493] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.204506 19232 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.209690 19232 raft_consensus.cc:515] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.211549 19429 raft_consensus.cc:993] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: : Instructing follower 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.212164 19579 raft_consensus.cc:1081] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Signalling peer 99ebe4ab7532476c99d7b42c3ad9a53a to start an election
I20260709 13:19:19.212205 19232 leader_election.cc:290] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:19.212304 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:19.213033 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac1b8af44ba2443a9b6e042da3be38a3" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:19.213665 19383 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.214107 19309 raft_consensus.cc:3055] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.214510 19309 raft_consensus.cc:740] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:19.214641 19232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
 from {username='slave'} at 127.0.0.1:40654
I20260709 13:19:19.215368 19232 raft_consensus.cc:493] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.215819 19232 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.215459 19309 consensus_queue.cc:260] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.216872 19309 raft_consensus.cc:3060] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.220494 19383 raft_consensus.cc:2468] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.221634 19197 leader_election.cc:304] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:19.222255 19232 raft_consensus.cc:515] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.222410 19309 raft_consensus.cc:2468] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.222492 19512 raft_consensus.cc:2804] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.223340 19512 raft_consensus.cc:697] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:19.224175 19232 leader_election.cc:290] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Requested vote from peers dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119), 8ae08b51234945efa1d044e10e39b769 (127.9.68.67:44781)
I20260709 13:19:19.224149 19512 consensus_queue.cc:237] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.225167 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:19.225826 19309 raft_consensus.cc:3055] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.225903 19383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e67ceef5b54352b377cd42cb199b2b" candidate_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ae08b51234945efa1d044e10e39b769"
I20260709 13:19:19.226214 19309 raft_consensus.cc:740] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:19.226642 19383 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.227120 19309 consensus_queue.cc:260] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.228457 19309 raft_consensus.cc:3060] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.231464 19129 catalog_manager.cc:5697] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.234319 19383 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.235370 19197 leader_election.cc:304] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:19.235729 19309 raft_consensus.cc:2468] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ebe4ab7532476c99d7b42c3ad9a53a in term 2.
I20260709 13:19:19.236250 19512 raft_consensus.cc:2804] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.236773 19512 raft_consensus.cc:697] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Leader. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:19.239043 19512 consensus_queue.cc:237] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:19.245813 19129 catalog_manager.cc:5697] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a reported cstate change: term changed from 1 to 2, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65). New cstate: current_term: 2 leader_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.486991 19383 raft_consensus.cc:1275] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.488065 19512 consensus_queue.cc:1048] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.496199 19309 raft_consensus.cc:1275] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.497978 19512 consensus_queue.cc:1048] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.523895 19232 raft_consensus.cc:1275] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.524930 19579 consensus_queue.cc:1048] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.532541 19383 raft_consensus.cc:1275] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer dbc70ce0a780449ca165da665d801c28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.533790 19533 consensus_queue.cc:1048] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.617650 19309 raft_consensus.cc:1275] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.618762 19559 consensus_queue.cc:1048] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.627103 19381 raft_consensus.cc:1275] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.628584 19512 consensus_queue.cc:1048] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.692094 19309 raft_consensus.cc:1275] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.693449 19512 consensus_queue.cc:1048] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.702634 19381 raft_consensus.cc:1275] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.703922 19559 consensus_queue.cc:1048] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.721861 19309 raft_consensus.cc:1275] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.722909 19559 consensus_queue.cc:1048] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.730466 19381 raft_consensus.cc:1275] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Refusing update from remote peer 99ebe4ab7532476c99d7b42c3ad9a53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.732234 19589 consensus_queue.cc:1048] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.987392 19131 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48690:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:22.005175 19131 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48690:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:22.043211  9489 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:22.204674 19612 log.cc:927] Time spent T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:19:22.245052 19274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.65:38549, user_credentials={real_user=slave}} blocked reactor thread for 63666.7us
W20260709 13:19:22.273962 19634 log.cc:927] Time spent T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:22.285666 19647 tablet.cc:1724] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.352363 19308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6"
dest_uuid: "dbc70ce0a780449ca165da665d801c28"
mode: GRACEFUL
new_leader_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:57384
I20260709 13:19:22.353032 19308 raft_consensus.cc:606] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Received request to transfer leadership to TS 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:22.360329 19652 tablet.cc:1724] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.317152 19649 tablet.cc:1724] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.398203 19658 tablet.cc:1724] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:22.448132 19654 log.cc:927] Time spent T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:22.448346 19659 tablet.cc:1724] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.450245 19664 tablet.cc:1724] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.450992 19663 tablet.cc:1724] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.453146 19661 tablet.cc:1724] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.475150 19667 tablet.cc:1724] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.475384 19665 tablet.cc:1724] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:22.479384 19651 log.cc:927] Time spent T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:19:22.478492 19668 tablet.cc:1724] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.415364 19647 tablet.cc:1724] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.519269 19665 tablet.cc:1724] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.529253 19661 tablet.cc:1724] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.553306 19652 tablet.cc:1724] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.554104 19669 tablet.cc:1724] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.555241 19661 tablet.cc:1724] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.560118 19665 tablet.cc:1724] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.561535 19664 tablet.cc:1724] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.567919 19647 tablet.cc:1724] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.558214 19658 tablet.cc:1724] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.558274 19659 tablet.cc:1724] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.550964 19668 tablet.cc:1724] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.598048 19647 tablet.cc:1724] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.616231 19665 tablet.cc:1724] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.739244 19231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12"
dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
mode: GRACEFUL
new_leader_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:19:22.739916 19231 raft_consensus.cc:606] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Received request to transfer leadership to TS 8ae08b51234945efa1d044e10e39b769
I20260709 13:19:22.783368 19665 tablet.cc:1724] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.801107 19640 raft_consensus.cc:993] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: : Instructing follower 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:22.801865 19640 raft_consensus.cc:1081] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Signalling peer 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:22.803428 19658 tablet.cc:1724] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:22.805013 19383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:34258
I20260709 13:19:22.805600 19383 raft_consensus.cc:493] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.805953 19383 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.881127 19383 raft_consensus.cc:515] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:22.959513 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:22.960253 19231 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.973671 19627 raft_consensus.cc:993] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: : Instructing follower 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:22.974350 19627 raft_consensus.cc:1081] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Signalling peer 8ae08b51234945efa1d044e10e39b769 to start an election
I20260709 13:19:22.976462 19377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12"
dest_uuid: "8ae08b51234945efa1d044e10e39b769"
 from {username='slave'} at 127.0.0.1:34260
I20260709 13:19:22.977142 19377 raft_consensus.cc:493] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.977722 19377 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.978279  9489 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:22.979226  9489 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:22.985414 19383 leader_election.cc:290] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 3 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:22.986481 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db302b1d7e144f29aa8c22d5051751b6" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:22.987051 19309 raft_consensus.cc:3055] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:22.987344 19309 raft_consensus.cc:740] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbc70ce0a780449ca165da665d801c28, State: Running, Role: LEADER
I20260709 13:19:22.987810 19231 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 3.
I20260709 13:19:22.988113 19309 consensus_queue.cc:260] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:22.990552 19348 leader_election.cc:304] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, 99ebe4ab7532476c99d7b42c3ad9a53a; no voters: 
I20260709 13:19:22.989266 19309 raft_consensus.cc:3060] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.991566 19650 raft_consensus.cc:2804] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:22.992122 19650 raft_consensus.cc:697] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 3 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:22.993036 19650 consensus_queue.cc:237] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
W20260709 13:19:23.001539 19199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.68.66:41119, user_credentials={real_user=slave}} blocked reactor thread for 45281.3us
I20260709 13:19:23.012279 19309 raft_consensus.cc:2468] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 3.
I20260709 13:19:23.014101 19377 raft_consensus.cc:515] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:23.016707 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a"
I20260709 13:19:23.017058 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bed843100342a0b7f4c92f2e8f5e12" candidate_uuid: "8ae08b51234945efa1d044e10e39b769" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbc70ce0a780449ca165da665d801c28"
I20260709 13:19:23.017269 19231 raft_consensus.cc:3055] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:23.017540 19377 leader_election.cc:290] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 3 election: Requested vote from peers 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549), dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119)
I20260709 13:19:23.017678 19307 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.019094 19231 raft_consensus.cc:740] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ebe4ab7532476c99d7b42c3ad9a53a, State: Running, Role: LEADER
I20260709 13:19:23.020395 19231 consensus_queue.cc:260] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:23.021870 19231 raft_consensus.cc:3060] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.027560 19307 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 3.
I20260709 13:19:23.029879 19348 leader_election.cc:304] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ae08b51234945efa1d044e10e39b769, dbc70ce0a780449ca165da665d801c28; no voters: 
I20260709 13:19:23.030699 19574 raft_consensus.cc:2804] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:23.030808 19231 raft_consensus.cc:2468] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ae08b51234945efa1d044e10e39b769 in term 3.
I20260709 13:19:23.031268 19574 raft_consensus.cc:697] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 3 LEADER]: Becoming Leader. State: Replica: 8ae08b51234945efa1d044e10e39b769, State: Running, Role: LEADER
I20260709 13:19:23.032176 19574 consensus_queue.cc:237] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } }
I20260709 13:19:23.059912 19131 catalog_manager.cc:5697] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 2 to 3, leader changed from 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65) to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.061637 19131 catalog_manager.cc:5697] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 reported cstate change: term changed from 2 to 3, leader changed from dbc70ce0a780449ca165da665d801c28 (127.9.68.66) to 8ae08b51234945efa1d044e10e39b769 (127.9.68.67). New cstate: current_term: 3 leader_uuid: "8ae08b51234945efa1d044e10e39b769" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ae08b51234945efa1d044e10e39b769" member_type: VOTER last_known_addr { host: "127.9.68.67" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.066196 19130 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: soft_deleted_table [id=15d3851c3e014b18a8a701cf67648f6f] alter complete (version 1)
I20260709 13:19:23.496076 19231 raft_consensus.cc:1275] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.497352 19574 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.513484 19305 raft_consensus.cc:1275] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.515046 19650 consensus_queue.cc:1048] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.553756 19305 raft_consensus.cc:1275] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.554837 19650 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbc70ce0a780449ca165da665d801c28" member_type: VOTER last_known_addr { host: "127.9.68.66" port: 41119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.563778 19231 raft_consensus.cc:1275] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Refusing update from remote peer 8ae08b51234945efa1d044e10e39b769: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:23.565531 19574 consensus_queue.cc:1048] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ebe4ab7532476c99d7b42c3ad9a53a" member_type: VOTER last_known_addr { host: "127.9.68.65" port: 38549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:23.814682 19404 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4b60 after lost signal to thread 9492
W20260709 13:19:23.815933 19404 debug-util.cc:398] Leaking SignalData structure 0x7b0800237e80 after lost signal to thread 19166
W20260709 13:19:23.817018 19404 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8cc0 after lost signal to thread 19258
W20260709 13:19:23.818415 19404 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb400 after lost signal to thread 19333
W20260709 13:19:23.819538 19404 debug-util.cc:398] Leaking SignalData structure 0x7b08002284c0 after lost signal to thread 19407
I20260709 13:19:24.040123  9489 tablet_server.cc:179] TabletServer@127.9.68.65:0 shutting down...
I20260709 13:19:24.079955  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.080983  9489 tablet_replica.cc:333] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.081884  9489 raft_consensus.cc:2243] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.082512  9489 raft_consensus.cc:2272] T edd2620b5516408e93cba32aab1b3368 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.085229  9489 tablet_replica.cc:333] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.086030  9489 raft_consensus.cc:2243] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.086613  9489 raft_consensus.cc:2272] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.089183  9489 tablet_replica.cc:333] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.090005  9489 raft_consensus.cc:2243] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.090559  9489 raft_consensus.cc:2272] T da8212c78ea0494699dac84d10a159b2 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.093022  9489 tablet_replica.cc:333] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.093861  9489 raft_consensus.cc:2243] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.094859  9489 raft_consensus.cc:2272] T b6e67ceef5b54352b377cd42cb199b2b P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.097414  9489 tablet_replica.cc:333] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.098192  9489 raft_consensus.cc:2243] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.099176  9489 raft_consensus.cc:2272] T ac1b8af44ba2443a9b6e042da3be38a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.101608  9489 tablet_replica.cc:333] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.102339  9489 raft_consensus.cc:2243] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.102862  9489 raft_consensus.cc:2272] T 7f0a033232924cbda1452db8eb7af2c9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.105199  9489 tablet_replica.cc:333] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.105963  9489 raft_consensus.cc:2243] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.106940  9489 raft_consensus.cc:2272] T 00b2dc74db7c4ce185cce35c3b5ef86e P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.109414  9489 tablet_replica.cc:333] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.110165  9489 raft_consensus.cc:2243] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.110767  9489 raft_consensus.cc:2272] T db302b1d7e144f29aa8c22d5051751b6 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.113816  9489 tablet_replica.cc:333] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.114392  9489 raft_consensus.cc:2243] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.114918  9489 raft_consensus.cc:2272] T 277996d8c6a54315b6fe22b05f5e39a3 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.117003  9489 tablet_replica.cc:333] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.117558  9489 raft_consensus.cc:2243] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.117969  9489 raft_consensus.cc:2272] T b80ffa2003a049d8901fdf757fddbaca P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.120168  9489 tablet_replica.cc:333] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.120707  9489 raft_consensus.cc:2243] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.121173  9489 raft_consensus.cc:2272] T f9bed843100342a0b7f4c92f2e8f5e12 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.123508  9489 tablet_replica.cc:333] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.124042  9489 raft_consensus.cc:2243] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.124461  9489 raft_consensus.cc:2272] T 573610e34f184a6bb129a115635a5472 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.126629  9489 tablet_replica.cc:333] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.127179  9489 raft_consensus.cc:2243] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.127645  9489 raft_consensus.cc:2272] T 0992462a7ceb4556993aa6fb613f7a36 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.130061  9489 tablet_replica.cc:333] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.130605  9489 raft_consensus.cc:2243] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.131541  9489 raft_consensus.cc:2272] T fbc482433c0c43a7a8610404f96e98da P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.135025  9489 tablet_replica.cc:333] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.135658  9489 raft_consensus.cc:2243] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.136381  9489 raft_consensus.cc:2272] T 9c4c95abb261437c9399f639f98fa4f9 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.138592  9489 tablet_replica.cc:333] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.139138  9489 raft_consensus.cc:2243] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.139887  9489 raft_consensus.cc:2272] T 31b5b10db3974b0f838c271dbf55022f P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.141862  9489 tablet_replica.cc:333] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.142453  9489 raft_consensus.cc:2243] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.142891  9489 raft_consensus.cc:2272] T 0fda761d40a040739c7b22fe93c99a29 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.145390  9489 tablet_replica.cc:333] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a: stopping tablet replica
I20260709 13:19:24.145984  9489 raft_consensus.cc:2243] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.147060  9489 raft_consensus.cc:2272] T ba9ce0657a4c43e4b19af73ca6c703a8 P 99ebe4ab7532476c99d7b42c3ad9a53a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.171469 19198 connection.cc:466] server connection from 127.0.0.1:40658 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40658 (request call id 77) could send its response
W20260709 13:19:24.173146 19348 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.68.65:38549 (error 108) [suppressed 8 similar messages]
I20260709 13:19:24.183365  9489 tablet_server.cc:196] TabletServer@127.9.68.65:0 shutdown complete.
W20260709 13:19:24.187302 19348 consensus_peers.cc:597] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 -> Peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Couldn't send request to peer 99ebe4ab7532476c99d7b42c3ad9a53a. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:38549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.218021 19274 consensus_peers.cc:597] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 -> Peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Couldn't send request to peer 99ebe4ab7532476c99d7b42c3ad9a53a. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:38549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.219503  9489 tablet_server.cc:179] TabletServer@127.9.68.66:0 shutting down...
I20260709 13:19:24.257539  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.258279  9489 tablet_replica.cc:333] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.259191  9489 raft_consensus.cc:2243] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.259665  9489 raft_consensus.cc:2272] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.261519  9489 tablet_replica.cc:333] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.262046  9489 raft_consensus.cc:2243] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.262754  9489 raft_consensus.cc:2272] T da8212c78ea0494699dac84d10a159b2 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.264642  9489 tablet_replica.cc:333] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.265172  9489 raft_consensus.cc:2243] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.265920  9489 raft_consensus.cc:2272] T edd2620b5516408e93cba32aab1b3368 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.267910  9489 tablet_replica.cc:333] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.268457  9489 raft_consensus.cc:2243] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.268872  9489 raft_consensus.cc:2272] T b6e67ceef5b54352b377cd42cb199b2b P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.270589  9489 tablet_replica.cc:333] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.271275  9489 raft_consensus.cc:2243] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.272133  9489 raft_consensus.cc:2272] T 7f0a033232924cbda1452db8eb7af2c9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.274379  9489 tablet_replica.cc:333] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.275111  9489 raft_consensus.cc:2243] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.275604  9489 raft_consensus.cc:2272] T fbc482433c0c43a7a8610404f96e98da P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.278151  9489 tablet_replica.cc:333] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.278705  9489 raft_consensus.cc:2243] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.279224  9489 raft_consensus.cc:2272] T ac1b8af44ba2443a9b6e042da3be38a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.281383  9489 tablet_replica.cc:333] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
W20260709 13:19:24.281822 19274 consensus_peers.cc:597] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 -> Peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Couldn't send request to peer 99ebe4ab7532476c99d7b42c3ad9a53a. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:38549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.282006  9489 raft_consensus.cc:2243] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.282955  9489 raft_consensus.cc:2272] T 573610e34f184a6bb129a115635a5472 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.285116  9489 tablet_replica.cc:333] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.285693  9489 raft_consensus.cc:2243] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.286437  9489 raft_consensus.cc:2272] T 0992462a7ceb4556993aa6fb613f7a36 P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.289028  9489 tablet_replica.cc:333] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.289772  9489 raft_consensus.cc:2243] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.290251  9489 raft_consensus.cc:2272] T 00b2dc74db7c4ce185cce35c3b5ef86e P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.292598  9489 tablet_replica.cc:333] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
W20260709 13:19:24.292714 19348 consensus_peers.cc:597] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 -> Peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Couldn't send request to peer 99ebe4ab7532476c99d7b42c3ad9a53a. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:38549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.293308  9489 raft_consensus.cc:2243] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.293910  9489 raft_consensus.cc:2272] T 277996d8c6a54315b6fe22b05f5e39a3 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.296025  9489 tablet_replica.cc:333] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.296562  9489 raft_consensus.cc:2243] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.296962  9489 raft_consensus.cc:2272] T db302b1d7e144f29aa8c22d5051751b6 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.299532  9489 tablet_replica.cc:333] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.300028  9489 raft_consensus.cc:2243] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.300454  9489 raft_consensus.cc:2272] T ba9ce0657a4c43e4b19af73ca6c703a8 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.302826  9489 tablet_replica.cc:333] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.303342  9489 raft_consensus.cc:2243] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.303748  9489 raft_consensus.cc:2272] T 31b5b10db3974b0f838c271dbf55022f P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.305414  9489 tablet_replica.cc:333] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.305891  9489 raft_consensus.cc:2243] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.306725  9489 raft_consensus.cc:2272] T 0fda761d40a040739c7b22fe93c99a29 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.308842  9489 tablet_replica.cc:333] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.309289  9489 raft_consensus.cc:2243] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.309791  9489 raft_consensus.cc:2272] T 9c4c95abb261437c9399f639f98fa4f9 P dbc70ce0a780449ca165da665d801c28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.311803  9489 tablet_replica.cc:333] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.312249  9489 raft_consensus.cc:2243] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.312925  9489 raft_consensus.cc:2272] T b80ffa2003a049d8901fdf757fddbaca P dbc70ce0a780449ca165da665d801c28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.314636  9489 tablet_replica.cc:333] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28: stopping tablet replica
I20260709 13:19:24.315109  9489 raft_consensus.cc:2243] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.315516  9489 raft_consensus.cc:2272] T f9bed843100342a0b7f4c92f2e8f5e12 P dbc70ce0a780449ca165da665d801c28 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:24.327708 19348 consensus_peers.cc:597] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 -> Peer 99ebe4ab7532476c99d7b42c3ad9a53a (127.9.68.65:38549): Couldn't send request to peer 99ebe4ab7532476c99d7b42c3ad9a53a. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.65:38549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.357204 19348 consensus_peers.cc:597] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 -> Peer dbc70ce0a780449ca165da665d801c28 (127.9.68.66:41119): Couldn't send request to peer dbc70ce0a780449ca165da665d801c28. Status: Network error: Client connection negotiation failed: client connection to 127.9.68.66:41119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.357497  9489 tablet_server.cc:196] TabletServer@127.9.68.66:0 shutdown complete.
I20260709 13:19:24.391898  9489 tablet_server.cc:179] TabletServer@127.9.68.67:0 shutting down...
I20260709 13:19:24.433044  9489 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.433871  9489 tablet_replica.cc:333] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.434783  9489 raft_consensus.cc:2243] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.435794  9489 raft_consensus.cc:2272] T 3f2e9ed4bf6a4bfda492e11249ff1c3c P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.437673  9489 tablet_replica.cc:333] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.438198  9489 raft_consensus.cc:2243] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.438607  9489 raft_consensus.cc:2272] T edd2620b5516408e93cba32aab1b3368 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.440387  9489 tablet_replica.cc:333] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.440935  9489 raft_consensus.cc:2243] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.441378  9489 raft_consensus.cc:2272] T 7f0a033232924cbda1452db8eb7af2c9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.443009  9489 tablet_replica.cc:333] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.443514  9489 raft_consensus.cc:2243] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.443934  9489 raft_consensus.cc:2272] T da8212c78ea0494699dac84d10a159b2 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.445590  9489 tablet_replica.cc:333] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.446097  9489 raft_consensus.cc:2243] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.446509  9489 raft_consensus.cc:2272] T ac1b8af44ba2443a9b6e042da3be38a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.448194  9489 tablet_replica.cc:333] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.448688  9489 raft_consensus.cc:2243] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.449090  9489 raft_consensus.cc:2272] T 31b5b10db3974b0f838c271dbf55022f P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.450763  9489 tablet_replica.cc:333] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.451233  9489 raft_consensus.cc:2243] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.451625  9489 raft_consensus.cc:2272] T b6e67ceef5b54352b377cd42cb199b2b P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.453215  9489 tablet_replica.cc:333] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.453768  9489 raft_consensus.cc:2243] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.454161  9489 raft_consensus.cc:2272] T 00b2dc74db7c4ce185cce35c3b5ef86e P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.455740  9489 tablet_replica.cc:333] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.456224  9489 raft_consensus.cc:2243] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.456933  9489 raft_consensus.cc:2272] T db302b1d7e144f29aa8c22d5051751b6 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.459586  9489 tablet_replica.cc:333] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.460072  9489 raft_consensus.cc:2243] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.460902  9489 raft_consensus.cc:2272] T 277996d8c6a54315b6fe22b05f5e39a3 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.462824  9489 tablet_replica.cc:333] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.463331  9489 raft_consensus.cc:2243] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.463791  9489 raft_consensus.cc:2272] T 0fda761d40a040739c7b22fe93c99a29 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.465703  9489 tablet_replica.cc:333] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.466166  9489 raft_consensus.cc:2243] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.466603  9489 raft_consensus.cc:2272] T fbc482433c0c43a7a8610404f96e98da P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.468711  9489 tablet_replica.cc:333] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.469187  9489 raft_consensus.cc:2243] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.469620  9489 raft_consensus.cc:2272] T 0992462a7ceb4556993aa6fb613f7a36 P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.471362  9489 tablet_replica.cc:333] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.471820  9489 raft_consensus.cc:2243] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.472229  9489 raft_consensus.cc:2272] T 573610e34f184a6bb129a115635a5472 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.474200  9489 tablet_replica.cc:333] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.474659  9489 raft_consensus.cc:2243] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.475080  9489 raft_consensus.cc:2272] T ba9ce0657a4c43e4b19af73ca6c703a8 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.477005  9489 tablet_replica.cc:333] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.477555  9489 raft_consensus.cc:2243] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.477979  9489 raft_consensus.cc:2272] T 9c4c95abb261437c9399f639f98fa4f9 P 8ae08b51234945efa1d044e10e39b769 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.479900  9489 tablet_replica.cc:333] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.480350  9489 raft_consensus.cc:2243] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.480741  9489 raft_consensus.cc:2272] T b80ffa2003a049d8901fdf757fddbaca P 8ae08b51234945efa1d044e10e39b769 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.482385  9489 tablet_replica.cc:333] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769: stopping tablet replica
I20260709 13:19:24.482852  9489 raft_consensus.cc:2243] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:24.483584  9489 raft_consensus.cc:2272] T f9bed843100342a0b7f4c92f2e8f5e12 P 8ae08b51234945efa1d044e10e39b769 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.518864  9489 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19404)
W20260709 13:19:26.519388  9489 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19404)
I20260709 13:19:27.527809  9489 tablet_server.cc:196] TabletServer@127.9.68.67:0 shutdown complete.
I20260709 13:19:27.594601  9489 master.cc:562] Master@127.9.68.126:37551 shutting down...
I20260709 13:19:27.625141  9489 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:27.626156  9489 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:27.626559  9489 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7609b9e3acbf47e3a030b6b0b4f3b149: stopping tablet replica
I20260709 13:19:27.649960  9489 master.cc:584] Master@127.9.68.126:37551 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14731 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (29032 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (288529 ms total)
[  PASSED  ] 8 tests.
I20260709 13:19:27.734565  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 507 messages since previous log ~18 seconds ago
I20260709 13:19:27.734792  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 507 messages since previous log ~18 seconds ago
I20260709 13:19:27.735127  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 505 messages since previous log ~18 seconds ago
I20260709 13:19:27.735332  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5107: suppressed but not reported on 14 messages since previous log ~18 seconds ago
I20260709 13:19:27.735592  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:19:27.735780  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:19:27.736014  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 5 messages since previous log ~117 seconds ago
I20260709 13:19:27.736344  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~122 seconds ago
I20260709 13:19:27.736654  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~3 seconds ago
I20260709 13:19:27.736865  9489 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 126 messages since previous log ~37 seconds ago
